-- Logs begin at Tue 2022-05-17 21:03:56 UTC, end at Tue 2022-05-17 22:31:16 UTC. -- May 17 21:48:33.714684 dv-cinder-839987-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 21:48:33 2022] *** May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: nodename: dv-cinder-839987-6-iscsi May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: machine: x86_64 May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: clock source: unix May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: pcre jit disabled May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: detected number of CPU cores: 4 May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: current working directory: / May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: detected binary path: /usr/bin/uwsgi-core May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: your processes number limit is 47680 May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: your memory page size is 4096 bytes May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: detected max file descriptor number: 2048 May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: lock engine: pthread robust mutexes May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: thunder lock: enabled May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 17 21:48:33.727212 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 21:48:33.770575 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: Python main interpreter initialized at 0x557ce09139c0 May 17 21:48:33.770575 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: python threads support enabled May 17 21:48:33.770575 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: your server socket listen backlog is limited to 100 connections May 17 21:48:33.770575 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: your mercy for graceful operations on workers is 90 seconds May 17 21:48:33.770902 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: mapped 403077 bytes (393 KB) for 2 cores May 17 21:48:33.771000 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: *** Operational MODE: preforking *** May 17 21:48:33.771297 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: *** uWSGI is running in multiple interpreter mode *** May 17 21:48:33.771297 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: spawned uWSGI master process (pid: 80124) May 17 21:48:33.771493 dv-cinder-839987-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 17 21:48:33.772852 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: spawned uWSGI worker 1 (pid: 80134, cores: 1) May 17 21:48:33.772852 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: spawned uWSGI worker 2 (pid: 80135, cores: 1) May 17 21:48:33.772852 dv-cinder-839987-6-iscsi devstack@keystone.service[80124]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 21:48:39.550931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 21:48:39.550931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: from cryptography.utils import int_from_bytes May 17 21:48:39.552304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 21:48:39.552304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: from cryptography.utils import int_from_bytes May 17 21:48:39.575012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 21:48:39.575012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: from cryptography.utils import int_from_bytes May 17 21:48:39.576935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 21:48:39.576935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: from cryptography.utils import int_from_bytes May 17 21:48:39.601528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 21:48:39.601722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 21:48:39.601916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] command line args: [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 21:48:39.602185 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 21:48:39.602363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ================================================================================ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 21:48:39.602616 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] admin_token = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.602861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] config_dir = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.603050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.603257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] config_source = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.603438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] debug = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.603638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.605032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.605032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.605032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.605032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.605032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.605032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] log_config_append = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.605463 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.605463 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] log_dir = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.605594 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] log_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.605742 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.605991 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.606238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.606516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.606696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.606872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.607147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.607391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.607624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.607854 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.608085 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.608315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.608559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.608799 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.609075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.609563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.609745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] publish_errors = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.609975 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.610203 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.610380 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.610623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.610855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.611088 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] standard_threads = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.611345 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.611586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.611762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.611939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] use_journal = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.612114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] use_json = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.612288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] use_stderr = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.612464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] use_syslog = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.612691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.612944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.613180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.613437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.613676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.613924 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.614160 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.614406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.614640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.614885 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.615145 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.615400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.615633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.615877 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.616112 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.616362 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.616607 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.616843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.617095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.617347 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.617589 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.617822 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.618073 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.618333 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.618582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.618829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.619058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.619315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.619544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.619778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.620026 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.620273 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.620503 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.620733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.620980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.621224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.621460 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.621708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.621938 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.622704 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.622939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.623208 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.623531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.623765 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.623998 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.624236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.624335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 21:48:39.624484 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.624561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 21:48:39.624712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] command line args: [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 21:48:39.624793 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.624946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.625022 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 21:48:39.625152 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ================================================================================ {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 21:48:39.625228 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.625399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.625480 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] admin_token = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.625634 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.625712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] config_dir = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.625820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.625894 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.626003 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] config_source = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.626087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.626211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] debug = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.626328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.626406 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.626565 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.626659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.626767 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.626843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.627022 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.627116 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.627284 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.627374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.627516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.627598 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.627697 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] log_config_append = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.627772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.627875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.628025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.628098 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] log_dir = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.628208 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.628285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] log_file = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.628439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.628527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.628685 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.628767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.628922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.628996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.629152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.629229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.629330 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.629407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.629517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.629595 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.629764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.629867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.630012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.630090 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.630246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.630456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.630540 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.630699 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.630782 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.630931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.631007 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.631196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.631276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.631438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.631528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.631691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.631769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.631931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.632172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.632258 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.632357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] publish_errors = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.632431 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.632602 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.632718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.632826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.632930 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.633028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.633124 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.633219 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.633326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.633458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.633565 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.633675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] standard_threads = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.633791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.633926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.634015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.634133 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.634254 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.634331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.634446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] use_journal = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.634519 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.634645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] use_json = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.634720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.634790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] use_stderr = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.634939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] use_syslog = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.635017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.635198 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:48:39.635292 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.635436 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.635523 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.635670 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.635749 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.635902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.635982 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.636133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.636222 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.636380 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.636461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.636613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.636694 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.636854 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.636982 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.637090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.637174 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.637336 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.637418 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.637575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.637661 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.638426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.638516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.638658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.638914 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.638914 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.639062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.639169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.external = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.639248 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.639364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.639442 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.639627 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.639705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.639869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.640011 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.640087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.password = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.640156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.640306 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.token = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.640381 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.640538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.640615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.640774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.640852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.641020 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.641100 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.641251 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.641329 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.641498 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.641576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.641746 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.641824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.641979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.642056 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.642214 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.642291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.642456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.642533 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.642694 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.642771 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.642938 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.643030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.643206 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.643299 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.643438 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.643515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.643672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.643754 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.643920 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.644009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.644170 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.644247 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.644404 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.644480 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.644652 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.644736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.644892 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.644971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.645131 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.645208 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.645367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.645452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.645598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.645682 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.645831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.645908 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.646064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.646150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.646297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.646376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.646536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.646623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.646785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.646874 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.647015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.647094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.647276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.647346 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.647499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.647593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.647740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.647818 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.647975 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.648058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.648224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.648309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.648458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.648536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.648698 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.648785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.648932 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.649017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.649168 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.649244 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.649407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.649485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.649641 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.649725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.649871 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.649947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.650116 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.650192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.650348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.650434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.650585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.650676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.650816 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.650894 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.651072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.651169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.651329 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.651421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.651560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.651646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.651792 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.651943 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.652027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.652110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.652271 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.652348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.652516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.652593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.652770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.652862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.653015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.653092 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.653250 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.653407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.653540 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.653741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.653818 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.653949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.654027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.654098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.654225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.654317 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.654466 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.654546 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.654703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.654781 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.654943 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.655055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.655205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.655326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.655454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.655570 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.655683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.655814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.655928 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.656055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.656172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.656320 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.656406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.656566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.656647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.656811 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.656889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.657052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.657131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.657299 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.657380 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.657525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.657602 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.657761 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.657840 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.657997 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.658076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.658232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.658311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.658464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.658548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.658699 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.658778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.658939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.659017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.659197 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.659291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.659426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.659504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.659656 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.659734 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.659901 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.659992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.660140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.660217 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.660371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.660450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.660606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.660698 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.660841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.660920 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.661072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.661150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.external = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.661313 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.661400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.661570 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.661649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.661801 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.661887 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.662048 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.662134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.password = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.662279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.token = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.662357 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.662521 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.662599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.662753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.662842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.662983 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.663062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.663239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.663316 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.663472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.663561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.663707 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.663787 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.663940 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.664019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.664175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.664259 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.664419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.664496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.664663 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.664741 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.664908 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.664994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.665143 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.665221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.665372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.665449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.665613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.665703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.665846 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.665924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.666082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.666161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.666323 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.666414 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.666557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.666636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.666802 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.666880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.667048 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.667194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.667311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.667390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.667566 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.667651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.667794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.667884 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.668039 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.668119 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.668273 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.668352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.668509 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.668596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.668744 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.668822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.669013 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.669091 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.669256 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.669368 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.669489 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.669613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.669725 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.669873 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.669959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.670116 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.670194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.670376 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.670454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.670618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.670705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.670870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.670949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.671127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.671209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.671370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.671459 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.671614 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.671693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.671851 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.671928 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.672087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.672172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.672321 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] role.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.672400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.672553 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.672629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] role.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.672785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.672871 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.673034 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.673111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.673280 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.673357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.673512 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.673598 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.673744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.673823 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.673975 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.674054 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.674221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.674307 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.674466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.674546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.674714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.674792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.674945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.675032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.675227 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.675561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.675729 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.675808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.675975 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.676065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.676217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.676294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.676452 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.676617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.676764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.676915 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.676991 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.677090 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.677170 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.677338 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.677416 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.677587 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.677667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.677836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.677913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.678065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.678142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.678315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.678394 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.678564 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.678642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.678801 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.678886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.679034 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.679169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.679291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.679370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.679522 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.679612 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.679763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.679842 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.679995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.680074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.680233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.680319 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.680469 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.680546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.680705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.680784 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.680935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.681022 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.681169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.681246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.681402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.681520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.681650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.681780 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.681885 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.682014 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.682140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.682246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.682387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.682497 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.682623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.682757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.682865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.682995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.683124 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.683258 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.683376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.683498 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.683612 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.683731 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.683850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.683973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.684083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.684233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.684311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.684466 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.685070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.685277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.685358 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.685527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.685604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.685775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.685875 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.686011 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.686139 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.686246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.686392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.686472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.686642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.686721 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.686883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.686962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.687141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.687222 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.687382 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.687460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.687620 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.687700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.687857 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.687935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.688096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.688174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.688340 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.688419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.688571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.688648 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.688811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.688888 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.689048 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.689126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.689284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.689362 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.689515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.689592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.689750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.689829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.689979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.690056 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.690220 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.690297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.690453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.690531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.690622 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 21:48:39.690700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.690925 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.691201 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.691441 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.691679 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.691917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.692166 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.692409 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.692643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.692881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.693122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.693373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.693624 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.693861 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.694111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.694361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.694598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.694844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.695085 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.695354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.695593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] role.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.695843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] role.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.696075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.696325 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.696575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.696833 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.697082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.697331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.697579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.697827 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.698079 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.698311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.698560 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.698809 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.699056 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.699331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.699726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.699964 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.700294 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.701039 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.701291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.701542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.701779 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.702036 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.702289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.702529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.702763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.702995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.703253 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.703507 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.703764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.704012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.704262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.704501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.704735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.704971 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] token.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.705216 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.705468 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.705707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.705965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.706214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.706453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.706698 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.706942 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.707228 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.707470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.707711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.707947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.708194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.708444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.708673 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.708918 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.709213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.709477 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.connection = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.709723 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.709974 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.710223 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.710466 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.710704 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.710941 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.711208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.711450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.711698 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.711939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.712186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.712426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.712677 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.712913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.713159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.713395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.713637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.713875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:48:39.714047 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 21:48:39.722746 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.722981 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.723234 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.732752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.741616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.741852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.742080 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.751499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.761629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.761864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.770524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.770759 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.816423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.818970 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.868448 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.868690 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.883794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.884079 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.936211 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.936426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.936661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.936882 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.936970 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.937101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.937182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.937307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.937394 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.937569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.937819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.938010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.960991 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.961225 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.961322 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.961451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.961567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.961651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.961740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.961868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.961953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.962079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.962161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.962288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.962379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.962538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.973730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.974096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.988673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.988905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.989124 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.989206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.989345 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.989427 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.989561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.989645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.989775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.989857 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.989987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.990078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.990269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:39.990488 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 21:48:40.007379 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.007583 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 21:48:40.007693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.007907 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 21:48:40.007990 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.008106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 21:48:40.008242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.008378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.008468 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 21:48:40.008642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.008723 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.008900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.008982 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.009155 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.009243 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.009436 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.020776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.021052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.021133 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.021320 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.021403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.021602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.021685 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.021879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.029977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.030159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.033276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.033482 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.033564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.033766 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.033861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.034050 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.034197 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.034445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.034526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.034722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.034803 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.034984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.035064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.035281 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.035361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.035553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.035639 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.035823 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.035902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.036088 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.036175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.036356 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.063633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.063788 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.065240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.065399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.065521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.065679 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.070818 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.070953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.071051 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.071260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.071351 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.071540 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.079364 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.079459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.079648 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.079731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.084250 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.084335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.084536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.084705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.084820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.084902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.085103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.085185 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.085377 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.085466 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.085653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.085735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.085921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.086002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.086185 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.086267 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.105078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.105203 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.105354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.105481 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.110464 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.110675 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.114080 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.114300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.114396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.114595 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.119368 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.119569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.123221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.123329 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.126934 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.127018 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.127267 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.127353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.127555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.127679 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.127839 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.128001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.128117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.128403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.128485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.128731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.148062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.148163 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.148436 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.148549 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.148706 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.148821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.148988 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.149103 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.157182 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.158136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.158902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.159211 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.161126 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.161597 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.162295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.162580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.162877 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.163181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.163459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.165428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.165711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.166010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.166296 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.166575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.177689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.177975 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.178255 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.178524 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.178801 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.179078 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.179384 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.184040 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.184365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.185404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.185739 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.186026 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.186307 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.186701 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.198222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.201839 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.205179 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.206783 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.208452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.208739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.209021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.212693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.216500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.216590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.218121 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.221392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.221684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.221970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.222050 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.222248 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.224155 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.225880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.226172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.226455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.232044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.232383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.232706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.237737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.239526 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.240619 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.240905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.241186 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.241468 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.241745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.242025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.242309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.242577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.242855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.243145 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.243437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.243699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.243969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.244228 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.244891 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.245306 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.245736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.246178 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.260362 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.260658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.260941 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.270188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 21:48:40.270479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.270763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.271040 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.271343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.271634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.271910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.272181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.272458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.272734 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.273012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.273276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.273546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.273807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 21:48:40.284989 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557ce09139c0 pid: 80135 (default app) May 17 21:48:40.288393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefc765-9ddf-47bf-9fd2-ff51e105e925 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:40.288691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefc765-9ddf-47bf-9fd2-ff51e105e925 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:40.288973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefc765-9ddf-47bf-9fd2-ff51e105e925 None None] PATH_INFO: `/v3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:40.293160 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 791 bytes} [Tue May 17 21:48:40 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:48:40.313944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557ce09139c0 pid: 80134 (default app) May 17 21:48:49.156464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05957890-d2a4-4d52-a435-5b1b6dfbdbf8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:49.157004 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05957890-d2a4-4d52-a435-5b1b6dfbdbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:49.157004 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05957890-d2a4-4d52-a435-5b1b6dfbdbf8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:49.158277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 2/2] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:48:49.165978 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d423e-97d6-4a37-8406-25308f2742f8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:49.166400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d423e-97d6-4a37-8406-25308f2742f8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:49.166548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d423e-97d6-4a37-8406-25308f2742f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:49.197905 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG oslo_db.sqlalchemy.engines [None req-4a7d423e-97d6-4a37-8406-25308f2742f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 21:48:49.382706 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG passlib.handlers.bcrypt [None req-4a7d423e-97d6-4a37-8406-25308f2742f8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80134) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 17 21:48:49.383155 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG passlib.handlers.bcrypt [None req-4a7d423e-97d6-4a37-8406-25308f2742f8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80134) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 17 21:48:49.438741 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4a7d423e-97d6-4a37-8406-25308f2742f8 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:48:49.440302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4a7d423e-97d6-4a37-8406-25308f2742f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:48:49.563615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1/3] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:48:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 17 21:48:49.725396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05957890-d2a4-4d52-a435-5b1b6dfbdbf8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:49.758749 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG oslo_db.sqlalchemy.engines [None req-05957890-d2a4-4d52-a435-5b1b6dfbdbf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 21:48:49.887175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05957890-d2a4-4d52-a435-5b1b6dfbdbf8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:49.891985 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed666e-5331-4cd4-bb30-9b28aaf00d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:49.892974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed666e-5331-4cd4-bb30-9b28aaf00d15 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:49.892974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed666e-5331-4cd4-bb30-9b28aaf00d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:49.893185 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed666e-5331-4cd4-bb30-9b28aaf00d15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:49.901418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed666e-5331-4cd4-bb30-9b28aaf00d15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:49.953900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: WARNING keystone.common.rbac_enforcer.enforcer [None req-94ed666e-5331-4cd4-bb30-9b28aaf00d15 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 17 21:48:49.954234 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed666e-5331-4cd4-bb30-9b28aaf00d15 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:49.963913 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 3/4] 10.222.0.24 () {58 vars in 1324 bytes} [Tue May 17 21:48:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 21:48:49.970334 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d423e-97d6-4a37-8406-25308f2742f8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:49.985182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d423e-97d6-4a37-8406-25308f2742f8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:49.989554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090e2c4-eee0-45aa-9411-6e57e56ef395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:49.990679 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090e2c4-eee0-45aa-9411-6e57e56ef395 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:49.990966 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090e2c4-eee0-45aa-9411-6e57e56ef395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:49.991276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090e2c4-eee0-45aa-9411-6e57e56ef395 admin admin] PATH_INFO: `/v3/projects/52a8a72ae1784555b539c1867c54411c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:49.992835 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090e2c4-eee0-45aa-9411-6e57e56ef395 admin admin] RBAC: Authorizing `identity:get_project(project_id=52a8a72ae1784555b539c1867c54411c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:50.042932 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c090e2c4-eee0-45aa-9411-6e57e56ef395 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 17 21:48:50.043294 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090e2c4-eee0-45aa-9411-6e57e56ef395 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:50.048374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 2/5] 10.222.0.24 () {56 vars in 1207 bytes} [Tue May 17 21:48:49 2022] GET /identity/v3/projects/52a8a72ae1784555b539c1867c54411c => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:48:52.245287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0bbe7-5a0c-4fd6-bba5-9d69aac1faa1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:52.245843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0bbe7-5a0c-4fd6-bba5-9d69aac1faa1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:52.245843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0bbe7-5a0c-4fd6-bba5-9d69aac1faa1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:52.250464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 4/6] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:48:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:48:52.255903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ae7a9-7833-4c02-881a-060bffbd40e2 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:52.257411 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ae7a9-7833-4c02-881a-060bffbd40e2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:52.257411 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ae7a9-7833-4c02-881a-060bffbd40e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:52.275914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-555ae7a9-7833-4c02-881a-060bffbd40e2 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:48:52.277398 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-555ae7a9-7833-4c02-881a-060bffbd40e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:48:52.285061 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 3/7] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:48:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 17 21:48:52.307939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0bbe7-5a0c-4fd6-bba5-9d69aac1faa1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:52.320443 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0bbe7-5a0c-4fd6-bba5-9d69aac1faa1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:52.324588 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc250f-49d8-43f8-8cae-ef84ea4692a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:52.325457 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc250f-49d8-43f8-8cae-ef84ea4692a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:52.325747 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc250f-49d8-43f8-8cae-ef84ea4692a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:52.326027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc250f-49d8-43f8-8cae-ef84ea4692a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:52.333634 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc250f-49d8-43f8-8cae-ef84ea4692a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:52.335420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc250f-49d8-43f8-8cae-ef84ea4692a1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:52.344713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 5/8] 10.222.0.24 () {58 vars in 1324 bytes} [Tue May 17 21:48:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 21:48:52.349800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ae7a9-7833-4c02-881a-060bffbd40e2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:52.359066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ae7a9-7833-4c02-881a-060bffbd40e2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:52.363369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9029f-9041-42ad-82cf-a6c434d5a2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:52.364213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9029f-9041-42ad-82cf-a6c434d5a2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:52.364489 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9029f-9041-42ad-82cf-a6c434d5a2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:52.364759 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9029f-9041-42ad-82cf-a6c434d5a2a6 admin admin] PATH_INFO: `/v3/users/aced3dd744eb487b932a627079853c51` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:52.366123 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9029f-9041-42ad-82cf-a6c434d5a2a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=aced3dd744eb487b932a627079853c51)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:52.367963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9029f-9041-42ad-82cf-a6c434d5a2a6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:52.369489 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 4/9] 10.222.0.24 () {56 vars in 1198 bytes} [Tue May 17 21:48:52 2022] GET /identity/v3/users/aced3dd744eb487b932a627079853c51 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:48:54.625798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ad960-9038-471d-8a61-7813ef1572c4 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:54.626339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ad960-9038-471d-8a61-7813ef1572c4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:54.626461 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ad960-9038-471d-8a61-7813ef1572c4 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:54.627863 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 6/10] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:48:54.633042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedc5f4-3a56-4dbf-b25a-e73f0d30f2a9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:54.633463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedc5f4-3a56-4dbf-b25a-e73f0d30f2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:54.633721 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedc5f4-3a56-4dbf-b25a-e73f0d30f2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:54.701275 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcd161-23cf-4fd6-9d89-ad742e109669 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:54.701560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcd161-23cf-4fd6-9d89-ad742e109669 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:54.701840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcd161-23cf-4fd6-9d89-ad742e109669 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:54.703246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 7/11] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:48:54.709105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e01da0-145f-4d27-bc02-45ecb2203759 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:54.709383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e01da0-145f-4d27-bc02-45ecb2203759 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:54.709640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e01da0-145f-4d27-bc02-45ecb2203759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:54.753672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG passlib.handlers.bcrypt [None req-97e01da0-145f-4d27-bc02-45ecb2203759 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80135) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 17 21:48:54.754105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG passlib.handlers.bcrypt [None req-97e01da0-145f-4d27-bc02-45ecb2203759 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80135) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 17 21:48:54.760400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5eedc5f4-3a56-4dbf-b25a-e73f0d30f2a9 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:48:54.761588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5eedc5f4-3a56-4dbf-b25a-e73f0d30f2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:48:54.807053 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-97e01da0-145f-4d27-bc02-45ecb2203759 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:48:54.808683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-97e01da0-145f-4d27-bc02-45ecb2203759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:48:54.839793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 5/12] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:48:54.862462 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedc5f4-3a56-4dbf-b25a-e73f0d30f2a9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:54.909803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 8/13] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:48:54.931943 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e01da0-145f-4d27-bc02-45ecb2203759 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:54.968491 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedc5f4-3a56-4dbf-b25a-e73f0d30f2a9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:55.001282 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b815738-c792-42be-9c26-f0dea999fe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:55.002066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b815738-c792-42be-9c26-f0dea999fe8b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:55.002346 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b815738-c792-42be-9c26-f0dea999fe8b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:55.002620 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b815738-c792-42be-9c26-f0dea999fe8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:55.013456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b815738-c792-42be-9c26-f0dea999fe8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-1b815738-c792-42be-9c26-f0dea999fe8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:48:55.024457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:48:55.025365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:48:55.026382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:48:55.026382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:48:55.026382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:48:55.026382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:48:55.026382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:48:55.026382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:48:55.026382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:48:55.026382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:48:55.026382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:48:55.026382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:48:55.026382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:48:55.026382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:48:55.026382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 6/14] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:48:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:48:55.028416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e01da0-145f-4d27-bc02-45ecb2203759 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:55.031537 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b815738-c792-42be-9c26-f0dea999fe8b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:55.062504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bc241-59cf-4f8a-b38c-ab193e23cf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:55.063437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bc241-59cf-4f8a-b38c-ab193e23cf90 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:55.063721 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bc241-59cf-4f8a-b38c-ab193e23cf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:55.063996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bc241-59cf-4f8a-b38c-ab193e23cf90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:55.126011 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b815738-c792-42be-9c26-f0dea999fe8b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:55.128469 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bc241-59cf-4f8a-b38c-ab193e23cf90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:55.129989 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bc241-59cf-4f8a-b38c-ab193e23cf90 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:55.158489 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f179fc-457a-43ae-979a-9758168f7ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:55.159088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f179fc-457a-43ae-979a-9758168f7ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:55.159397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f179fc-457a-43ae-979a-9758168f7ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:55.159671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f179fc-457a-43ae-979a-9758168f7ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:55.160417 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f179fc-457a-43ae-979a-9758168f7ce6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:48:55.160726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f179fc-457a-43ae-979a-9758168f7ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:55.162109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f179fc-457a-43ae-979a-9758168f7ce6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:55.174844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 7/15] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:48:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:48:55.180682 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f179fc-457a-43ae-979a-9758168f7ce6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:55.224176 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 9/16] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:48:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 21:48:55.229720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bc241-59cf-4f8a-b38c-ab193e23cf90 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:55.296257 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f179fc-457a-43ae-979a-9758168f7ce6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:55.329757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905243b-cf34-4ba5-b023-4b468740831d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:55.330628 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905243b-cf34-4ba5-b023-4b468740831d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:55.330911 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905243b-cf34-4ba5-b023-4b468740831d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:55.331214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905243b-cf34-4ba5-b023-4b468740831d None admin] PATH_INFO: `/v3/users/aced3dd744eb487b932a627079853c51` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:55.332108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bc241-59cf-4f8a-b38c-ab193e23cf90 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:55.332422 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905243b-cf34-4ba5-b023-4b468740831d None admin] RBAC: Authorizing `identity:get_user(user_id=aced3dd744eb487b932a627079853c51)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:55.333885 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905243b-cf34-4ba5-b023-4b468740831d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:55.335744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 8/17] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:48:55 2022] GET /identity/v3/users/aced3dd744eb487b932a627079853c51 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:48:55.341456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905243b-cf34-4ba5-b023-4b468740831d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:55.364227 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084380c8-e6b2-4ff6-871b-36b39b005cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:55.365009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084380c8-e6b2-4ff6-871b-36b39b005cad None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:55.365290 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084380c8-e6b2-4ff6-871b-36b39b005cad None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:55.365563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084380c8-e6b2-4ff6-871b-36b39b005cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:55.441913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905243b-cf34-4ba5-b023-4b468740831d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:55.475930 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807d6a7-501f-4232-af07-20952c186e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:55.476727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807d6a7-501f-4232-af07-20952c186e05 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:55.477008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807d6a7-501f-4232-af07-20952c186e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:55.477281 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807d6a7-501f-4232-af07-20952c186e05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:55.478477 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807d6a7-501f-4232-af07-20952c186e05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:55.479979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807d6a7-501f-4232-af07-20952c186e05 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:55.482336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 9/18] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:48:55.488034 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807d6a7-501f-4232-af07-20952c186e05 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:55.492494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084380c8-e6b2-4ff6-871b-36b39b005cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:55.493948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084380c8-e6b2-4ff6-871b-36b39b005cad None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:55.514705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-084380c8-e6b2-4ff6-871b-36b39b005cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:48:55.514705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:48:55.514705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:48:55.514705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:48:55.514705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:48:55.514705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:48:55.514705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:48:55.514705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:48:55.514705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:48:55.514705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:48:55.514705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:48:55.514705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:48:55.514705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:48:55.514705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:48:55.514705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:48:55.515711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:48:55.516655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:48:55.516655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:48:55.516655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:48:55.516655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:48:55.516655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 10/19] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:48:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:48:55.521711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084380c8-e6b2-4ff6-871b-36b39b005cad None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:55.589081 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807d6a7-501f-4232-af07-20952c186e05 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:55.618278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084380c8-e6b2-4ff6-871b-36b39b005cad None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:55.622592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f76a5-d398-46e3-a20b-8923df78fc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:55.622983 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f76a5-d398-46e3-a20b-8923df78fc9a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:55.623298 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f76a5-d398-46e3-a20b-8923df78fc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:55.623573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f76a5-d398-46e3-a20b-8923df78fc9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:55.624406 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f76a5-d398-46e3-a20b-8923df78fc9a None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.domain.id=default, user.id=aced3dd744eb487b932a627079853c51) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:48:55.624715 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f76a5-d398-46e3-a20b-8923df78fc9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:55.626172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f76a5-d398-46e3-a20b-8923df78fc9a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:55.632827 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 10/20] 10.222.0.24 () {56 vars in 1322 bytes} [Tue May 17 21:48:55 2022] GET /identity/v3/role_assignments?user.id=aced3dd744eb487b932a627079853c51&scope.domain.id=default&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:48:55.652931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b0af7-7950-4092-bf13-6ee508eafafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:55.653868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b0af7-7950-4092-bf13-6ee508eafafb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:55.654173 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b0af7-7950-4092-bf13-6ee508eafafb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:55.654431 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b0af7-7950-4092-bf13-6ee508eafafb None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:55.655225 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b0af7-7950-4092-bf13-6ee508eafafb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:48:55.655540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b0af7-7950-4092-bf13-6ee508eafafb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:55.656979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b0af7-7950-4092-bf13-6ee508eafafb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:55.676897 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 11/21] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:48:58.191625 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e10fc-d594-4661-80fd-3a670e13a096 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:58.192647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e10fc-d594-4661-80fd-3a670e13a096 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:58.193136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e10fc-d594-4661-80fd-3a670e13a096 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:58.195072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 11/22] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:48:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:48:58.200957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f273ac-758c-4c41-b1dd-87f661a2b3fe None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:58.201881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f273ac-758c-4c41-b1dd-87f661a2b3fe None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:58.202378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f273ac-758c-4c41-b1dd-87f661a2b3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:58.226881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c9f273ac-758c-4c41-b1dd-87f661a2b3fe None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:48:58.229126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c9f273ac-758c-4c41-b1dd-87f661a2b3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:48:58.302824 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 12/23] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:48:58.337764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e10fc-d594-4661-80fd-3a670e13a096 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:58.484066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e10fc-d594-4661-80fd-3a670e13a096 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:58.537421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1b916-4bdc-4bae-8408-339667ece1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:58.538613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1b916-4bdc-4bae-8408-339667ece1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:58.539130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1b916-4bdc-4bae-8408-339667ece1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:58.539626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1b916-4bdc-4bae-8408-339667ece1f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:58.557555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1b916-4bdc-4bae-8408-339667ece1f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-f7d1b916-4bdc-4bae-8408-339667ece1f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:48:58.565842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:48:58.566727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:48:58.567510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:48:58.567510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:48:58.567510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:48:58.567510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:48:58.567510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:48:58.567510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:48:58.567510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:48:58.567510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:48:58.567510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:48:58.567510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:48:58.567510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:48:58.567510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:48:58.570296 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 12/24] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:48:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:48:58.575927 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f273ac-758c-4c41-b1dd-87f661a2b3fe None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:58.714078 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f273ac-758c-4c41-b1dd-87f661a2b3fe None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:58.765211 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da048586-9541-47ef-b65b-92e8735e8d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:58.766076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da048586-9541-47ef-b65b-92e8735e8d0c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:58.766374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da048586-9541-47ef-b65b-92e8735e8d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:58.766880 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da048586-9541-47ef-b65b-92e8735e8d0c None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:58.767726 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da048586-9541-47ef-b65b-92e8735e8d0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:48:58.768039 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da048586-9541-47ef-b65b-92e8735e8d0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:58.769441 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da048586-9541-47ef-b65b-92e8735e8d0c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:58.787037 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 13/25] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:48:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:48:58.793292 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1b916-4bdc-4bae-8408-339667ece1f3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:58.948268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1b916-4bdc-4bae-8408-339667ece1f3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:58.981919 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8add02-b870-4702-a512-adc33963e91f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:58.982217 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8add02-b870-4702-a512-adc33963e91f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:58.982476 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8add02-b870-4702-a512-adc33963e91f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:58.983888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 14/26] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:48:58.989677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5617cb-5b5d-447c-bf4b-50a5df6da782 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:58.989942 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5617cb-5b5d-447c-bf4b-50a5df6da782 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:58.990231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5617cb-5b5d-447c-bf4b-50a5df6da782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:59.020977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9913228-e8aa-44f2-80bd-d05c094da3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:59.021794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9913228-e8aa-44f2-80bd-d05c094da3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:59.022075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9913228-e8aa-44f2-80bd-d05c094da3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:59.022350 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9913228-e8aa-44f2-80bd-d05c094da3c4 None admin] PATH_INFO: `/v3/users/aced3dd744eb487b932a627079853c51` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:59.023599 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9913228-e8aa-44f2-80bd-d05c094da3c4 None admin] RBAC: Authorizing `identity:get_user(user_id=aced3dd744eb487b932a627079853c51)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:59.025076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9913228-e8aa-44f2-80bd-d05c094da3c4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:59.028732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 13/27] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:48:58 2022] GET /identity/v3/users/aced3dd744eb487b932a627079853c51 => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:48:59.031877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9913228-e8aa-44f2-80bd-d05c094da3c4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:59.034240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1a5617cb-5b5d-447c-bf4b-50a5df6da782 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:48:59.035456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1a5617cb-5b5d-447c-bf4b-50a5df6da782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:48:59.167762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 15/28] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:48:59.169889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad48ca-3f9f-4fbb-b88b-72592ce65931 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:59.170179 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad48ca-3f9f-4fbb-b88b-72592ce65931 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:59.170457 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad48ca-3f9f-4fbb-b88b-72592ce65931 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:59.177720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 16/29] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:48:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:48:59.179137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c570d-9995-47c8-93ac-a6b391c5d7cb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:59.179434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c570d-9995-47c8-93ac-a6b391c5d7cb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:59.179713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c570d-9995-47c8-93ac-a6b391c5d7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:59.216681 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-065c570d-9995-47c8-93ac-a6b391c5d7cb None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:48:59.217870 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-065c570d-9995-47c8-93ac-a6b391c5d7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:48:59.236874 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9913228-e8aa-44f2-80bd-d05c094da3c4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:59.278126 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecb9e2-f32f-4a0b-821c-b700f8850185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:59.278846 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecb9e2-f32f-4a0b-821c-b700f8850185 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:59.279142 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecb9e2-f32f-4a0b-821c-b700f8850185 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:59.279427 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecb9e2-f32f-4a0b-821c-b700f8850185 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:59.282293 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecb9e2-f32f-4a0b-821c-b700f8850185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:59.283853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecb9e2-f32f-4a0b-821c-b700f8850185 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:59.285825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 14/30] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:48:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:48:59.286637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecb9e2-f32f-4a0b-821c-b700f8850185 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:59.308017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 17/31] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:48:59.308586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c570d-9995-47c8-93ac-a6b391c5d7cb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:59.427521 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecb9e2-f32f-4a0b-821c-b700f8850185 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:59.469945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e79fce-c4ec-43ae-820e-59c85fb7ff7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:59.470883 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e79fce-c4ec-43ae-820e-59c85fb7ff7b None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:59.471329 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e79fce-c4ec-43ae-820e-59c85fb7ff7b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:59.471755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e79fce-c4ec-43ae-820e-59c85fb7ff7b None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:59.472633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e79fce-c4ec-43ae-820e-59c85fb7ff7b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:59.473557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c570d-9995-47c8-93ac-a6b391c5d7cb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:59.474304 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e79fce-c4ec-43ae-820e-59c85fb7ff7b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:59.510715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac21c9-fd48-44a3-b695-9f531e35bd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:59.511840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac21c9-fd48-44a3-b695-9f531e35bd90 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:59.512370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac21c9-fd48-44a3-b695-9f531e35bd90 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:59.512810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac21c9-fd48-44a3-b695-9f531e35bd90 None admin] PATH_INFO: `/v3/domains/default/users/aced3dd744eb487b932a627079853c51/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:59.515430 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac21c9-fd48-44a3-b695-9f531e35bd90 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=aced3dd744eb487b932a627079853c51, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:59.517094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac21c9-fd48-44a3-b695-9f531e35bd90 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:59.743589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 15/32] 10.222.0.24 () {60 vars in 1131 bytes} [Tue May 17 21:48:59 2022] POST /identity/v3/roles => generated 225 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:48:59.744687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e79fce-c4ec-43ae-820e-59c85fb7ff7b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:48:59.775392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 18/33] 10.222.0.24 () {58 vars in 1361 bytes} [Tue May 17 21:48:59 2022] PUT /identity/v3/domains/default/users/aced3dd744eb487b932a627079853c51/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:48:59.777785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e622b-a22f-49fc-901e-7f381bd5c7b7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:59.778337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e622b-a22f-49fc-901e-7f381bd5c7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:59.778777 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e622b-a22f-49fc-901e-7f381bd5c7b7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:59.783924 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 19/34] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:48:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:48:59.785557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d48c59-ec56-4709-8030-622bf2bbbded None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:59.786006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d48c59-ec56-4709-8030-622bf2bbbded None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:59.786405 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d48c59-ec56-4709-8030-622bf2bbbded None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:59.788375 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 20/35] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:48:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:48:59.791631 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec51058-181d-4871-bbdd-a0ce5ac0e1cf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:59.792082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec51058-181d-4871-bbdd-a0ce5ac0e1cf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:59.792686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec51058-181d-4871-bbdd-a0ce5ac0e1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:59.815493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-aec51058-181d-4871-bbdd-a0ce5ac0e1cf None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:48:59.818090 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-aec51058-181d-4871-bbdd-a0ce5ac0e1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:48:59.912305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e79fce-c4ec-43ae-820e-59c85fb7ff7b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:48:59.954905 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828399e2-b1df-4041-a33d-e7ed1a997070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:48:59.956032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828399e2-b1df-4041-a33d-e7ed1a997070 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:59.957393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828399e2-b1df-4041-a33d-e7ed1a997070 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:59.958615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828399e2-b1df-4041-a33d-e7ed1a997070 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:48:59.959655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828399e2-b1df-4041-a33d-e7ed1a997070 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:48:59.961665 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828399e2-b1df-4041-a33d-e7ed1a997070 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:48:59.973765 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 21/36] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:48:59.975623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b17dca-11f5-473b-be16-9e5eb217654c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:48:59.976106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b17dca-11f5-473b-be16-9e5eb217654c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:48:59.976573 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b17dca-11f5-473b-be16-9e5eb217654c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:00.002272 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-37b17dca-11f5-473b-be16-9e5eb217654c None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:00.003606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-37b17dca-11f5-473b-be16-9e5eb217654c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:00.068395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 16/37] 10.222.0.24 () {60 vars in 1131 bytes} [Tue May 17 21:48:59 2022] POST /identity/v3/roles => generated 219 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:49:00.069867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828399e2-b1df-4041-a33d-e7ed1a997070 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:00.088028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 22/38] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:00.110369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b17dca-11f5-473b-be16-9e5eb217654c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:00.200980 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828399e2-b1df-4041-a33d-e7ed1a997070 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:00.227593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b17dca-11f5-473b-be16-9e5eb217654c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:00.246705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30633380-138b-4418-9968-02372287c635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:00.248277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30633380-138b-4418-9968-02372287c635 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:00.248768 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30633380-138b-4418-9968-02372287c635 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:00.249865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30633380-138b-4418-9968-02372287c635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:00.264723 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30633380-138b-4418-9968-02372287c635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:00.264882 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1da01d-6f55-46ff-ad08-cc3971bbc726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:00.265557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1da01d-6f55-46ff-ad08-cc3971bbc726 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:00.265959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1da01d-6f55-46ff-ad08-cc3971bbc726 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:00.266306 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1da01d-6f55-46ff-ad08-cc3971bbc726 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:00.267181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30633380-138b-4418-9968-02372287c635 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:00.267280 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1da01d-6f55-46ff-ad08-cc3971bbc726 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:00.269106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1da01d-6f55-46ff-ad08-cc3971bbc726 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:00.289076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-30633380-138b-4418-9968-02372287c635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:49:00.289076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:00.289076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:00.289076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:00.289076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:00.289076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:00.289076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:00.289076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:00.289076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:00.289076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:00.289076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:00.289076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:00.289076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:49:00.289076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:49:00.289076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:00.291902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:00.292732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:49:00.292732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:49:00.292732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:49:00.292732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:00.292732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 17/39] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:49:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:00.300232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30633380-138b-4418-9968-02372287c635 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:00.386311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 23/40] 10.222.0.24 () {60 vars in 1131 bytes} [Tue May 17 21:49:00 2022] POST /identity/v3/roles => generated 223 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:49:00.389198 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec329a-522f-4bd0-9678-50c38764a6a5 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:00.389505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec329a-522f-4bd0-9678-50c38764a6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:00.389859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec329a-522f-4bd0-9678-50c38764a6a5 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:00.392266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 24/41] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:00.398068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1dc67-30e3-4027-abef-7933fd70ace2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:00.398365 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1dc67-30e3-4027-abef-7933fd70ace2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:00.398651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1dc67-30e3-4027-abef-7933fd70ace2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:00.419208 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-48f1dc67-30e3-4027-abef-7933fd70ace2 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:00.420782 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-48f1dc67-30e3-4027-abef-7933fd70ace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:00.432002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30633380-138b-4418-9968-02372287c635 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:00.488880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa47531-d691-463a-97c4-36dd8b31b5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:00.489546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa47531-d691-463a-97c4-36dd8b31b5ef None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:00.489832 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa47531-d691-463a-97c4-36dd8b31b5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:00.490108 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa47531-d691-463a-97c4-36dd8b31b5ef None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:00.490853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa47531-d691-463a-97c4-36dd8b31b5ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:00.491186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa47531-d691-463a-97c4-36dd8b31b5ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:00.492618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa47531-d691-463a-97c4-36dd8b31b5ef None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:00.503273 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 25/42] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:00.514891 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 18/43] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:00.521281 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1dc67-30e3-4027-abef-7933fd70ace2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:00.536848 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa47531-d691-463a-97c4-36dd8b31b5ef None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:00.658290 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa47531-d691-463a-97c4-36dd8b31b5ef None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:00.659160 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1dc67-30e3-4027-abef-7933fd70ace2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:00.700476 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5793e68-3edc-4c0a-bdd3-faab0615f2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:00.701016 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3d2ab-e69d-400a-a009-12e7e36128be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:00.701142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5793e68-3edc-4c0a-bdd3-faab0615f2ef None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:00.701487 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5793e68-3edc-4c0a-bdd3-faab0615f2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:00.701770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5793e68-3edc-4c0a-bdd3-faab0615f2ef None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:00.702525 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3d2ab-e69d-400a-a009-12e7e36128be None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:00.702623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5793e68-3edc-4c0a-bdd3-faab0615f2ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:00.703132 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3d2ab-e69d-400a-a009-12e7e36128be None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:00.703419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3d2ab-e69d-400a-a009-12e7e36128be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:00.704034 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5793e68-3edc-4c0a-bdd3-faab0615f2ef None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:00.704655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3d2ab-e69d-400a-a009-12e7e36128be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:00.706104 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3d2ab-e69d-400a-a009-12e7e36128be None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:00.707795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 19/44] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:49:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:00.714025 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3d2ab-e69d-400a-a009-12e7e36128be None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:00.795526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 26/45] 10.222.0.24 () {60 vars in 1141 bytes} [Tue May 17 21:49:00 2022] POST /identity/v3/projects => generated 301 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:49:00.816713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3d2ab-e69d-400a-a009-12e7e36128be None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:00.854809 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42f38d-b54c-4a0f-b0e9-ca048f1ef75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:00.856326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42f38d-b54c-4a0f-b0e9-ca048f1ef75a None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:00.856681 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42f38d-b54c-4a0f-b0e9-ca048f1ef75a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:00.856965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42f38d-b54c-4a0f-b0e9-ca048f1ef75a None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:00.861912 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42f38d-b54c-4a0f-b0e9-ca048f1ef75a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:00.861912 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42f38d-b54c-4a0f-b0e9-ca048f1ef75a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:00.954445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 20/46] 10.222.0.24 () {60 vars in 1141 bytes} [Tue May 17 21:49:00 2022] POST /identity/v3/projects => generated 312 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:49:02.339862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75722d-7457-4363-96bc-45b33387578d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:02.340932 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75722d-7457-4363-96bc-45b33387578d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:02.340932 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75722d-7457-4363-96bc-45b33387578d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:02.342290 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 27/47] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:02.347643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe97a3b-a913-4296-b90d-8e55e44d743f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:02.348053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe97a3b-a913-4296-b90d-8e55e44d743f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:02.348210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe97a3b-a913-4296-b90d-8e55e44d743f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:02.365346 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-efe97a3b-a913-4296-b90d-8e55e44d743f None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:02.366836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-efe97a3b-a913-4296-b90d-8e55e44d743f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:02.430253 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 21/48] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:02.453875 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75722d-7457-4363-96bc-45b33387578d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:02.553489 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75722d-7457-4363-96bc-45b33387578d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:02.585784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2d2c6-ebc7-4b34-917e-6d19b620819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:02.586580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2d2c6-ebc7-4b34-917e-6d19b620819a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:02.586872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2d2c6-ebc7-4b34-917e-6d19b620819a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:02.587180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2d2c6-ebc7-4b34-917e-6d19b620819a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:02.599480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2d2c6-ebc7-4b34-917e-6d19b620819a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-44f2d2c6-ebc7-4b34-917e-6d19b620819a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:02.608800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:02.609629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:02.610522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:02.610522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:02.610522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:02.610522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:02.610522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:02.610522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:02.610522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:02.610522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:02.610522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:02.610522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:02.610522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:02.610522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:02.610522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 28/49] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:49:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:02.615772 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe97a3b-a913-4296-b90d-8e55e44d743f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:02.714822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe97a3b-a913-4296-b90d-8e55e44d743f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:02.750997 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc1090-47b5-4d16-b131-cd2eb653d5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:02.752099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc1090-47b5-4d16-b131-cd2eb653d5df None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:02.752581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc1090-47b5-4d16-b131-cd2eb653d5df None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:02.753050 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc1090-47b5-4d16-b131-cd2eb653d5df None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:02.754017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc1090-47b5-4d16-b131-cd2eb653d5df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:02.754516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc1090-47b5-4d16-b131-cd2eb653d5df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:02.756139 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc1090-47b5-4d16-b131-cd2eb653d5df None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:02.765925 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 22/50] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:02.771077 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2d2c6-ebc7-4b34-917e-6d19b620819a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:02.882430 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2d2c6-ebc7-4b34-917e-6d19b620819a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:02.916669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f1476-adfb-4cb6-82b4-54fccfafed87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:02.917563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f1476-adfb-4cb6-82b4-54fccfafed87 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:02.917853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f1476-adfb-4cb6-82b4-54fccfafed87 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:02.918816 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f1476-adfb-4cb6-82b4-54fccfafed87 None admin] PATH_INFO: `/v3/users/aced3dd744eb487b932a627079853c51` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:02.920187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f1476-adfb-4cb6-82b4-54fccfafed87 None admin] RBAC: Authorizing `identity:get_user(user_id=aced3dd744eb487b932a627079853c51)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:02.921661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f1476-adfb-4cb6-82b4-54fccfafed87 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:02.927751 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 29/51] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:02 2022] GET /identity/v3/users/aced3dd744eb487b932a627079853c51 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:02.929225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc1090-47b5-4d16-b131-cd2eb653d5df None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:03.031297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc1090-47b5-4d16-b131-cd2eb653d5df None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:03.065578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac3e85-f844-43c6-a0fb-ef4383480bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:03.066372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac3e85-f844-43c6-a0fb-ef4383480bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:03.066657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac3e85-f844-43c6-a0fb-ef4383480bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:03.066935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac3e85-f844-43c6-a0fb-ef4383480bc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:03.068159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac3e85-f844-43c6-a0fb-ef4383480bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:03.069616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac3e85-f844-43c6-a0fb-ef4383480bc1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:03.071245 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 23/52] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:49:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:03.077017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f1476-adfb-4cb6-82b4-54fccfafed87 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:03.172605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f1476-adfb-4cb6-82b4-54fccfafed87 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:03.204706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11d585-c77c-4098-a2a9-27e011480178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:03.205465 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d585-c77c-4098-a2a9-27e011480178 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:03.205754 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d585-c77c-4098-a2a9-27e011480178 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:03.206034 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d585-c77c-4098-a2a9-27e011480178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:03.206776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c7ba6-31cb-49aa-8630-dfb2272cdc6e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:03.206880 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11d585-c77c-4098-a2a9-27e011480178 None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.domain.id=default, user.id=aced3dd744eb487b932a627079853c51) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:03.207066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c7ba6-31cb-49aa-8630-dfb2272cdc6e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:03.207199 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11d585-c77c-4098-a2a9-27e011480178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:03.207388 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c7ba6-31cb-49aa-8630-dfb2272cdc6e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:03.208634 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11d585-c77c-4098-a2a9-27e011480178 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:03.208732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 24/53] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:49:03.213567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1c764-3135-45fd-82f1-48f88fc2929e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:03.213858 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1c764-3135-45fd-82f1-48f88fc2929e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:03.214138 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1c764-3135-45fd-82f1-48f88fc2929e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:03.217768 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 30/54] 10.222.0.24 () {56 vars in 1322 bytes} [Tue May 17 21:49:03 2022] GET /identity/v3/role_assignments?user.id=aced3dd744eb487b932a627079853c51&scope.domain.id=default&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:03.232718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2ec1c764-3135-45fd-82f1-48f88fc2929e None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:03.233932 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2ec1c764-3135-45fd-82f1-48f88fc2929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:03.304951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 25/55] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:03.329785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11d585-c77c-4098-a2a9-27e011480178 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:03.428967 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11d585-c77c-4098-a2a9-27e011480178 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:03.462378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991f774-b0d0-4411-8286-8fae8b2f1ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:03.463206 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991f774-b0d0-4411-8286-8fae8b2f1ddd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:03.463503 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991f774-b0d0-4411-8286-8fae8b2f1ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:03.463786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991f774-b0d0-4411-8286-8fae8b2f1ddd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:03.465002 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991f774-b0d0-4411-8286-8fae8b2f1ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:03.466599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991f774-b0d0-4411-8286-8fae8b2f1ddd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:03.468360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 31/56] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:49:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:03.474050 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1c764-3135-45fd-82f1-48f88fc2929e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:03.568444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1c764-3135-45fd-82f1-48f88fc2929e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:03.600249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ec2a0-ff32-419c-8025-48baa7e953f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:03.600902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ec2a0-ff32-419c-8025-48baa7e953f3 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:03.601187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ec2a0-ff32-419c-8025-48baa7e953f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:03.601466 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ec2a0-ff32-419c-8025-48baa7e953f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:03.602182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ec2a0-ff32-419c-8025-48baa7e953f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:03.603665 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ec2a0-ff32-419c-8025-48baa7e953f3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:03.706361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 26/57] 10.222.0.24 () {60 vars in 1140 bytes} [Tue May 17 21:49:03 2022] POST /identity/v3/projects => generated 298 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:49:05.923674 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bb415-4ba3-4011-bda5-518e79fac299 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:05.924122 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bb415-4ba3-4011-bda5-518e79fac299 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:05.924229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bb415-4ba3-4011-bda5-518e79fac299 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:05.925883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 32/58] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:05.931154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bb565-c601-4d3c-99e8-4a4d5830a25c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:05.931544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bb565-c601-4d3c-99e8-4a4d5830a25c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:05.931726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bb565-c601-4d3c-99e8-4a4d5830a25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:05.949736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8d1bb565-c601-4d3c-99e8-4a4d5830a25c None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:05.951190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8d1bb565-c601-4d3c-99e8-4a4d5830a25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:06.014777 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 27/59] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:06.039595 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bb415-4ba3-4011-bda5-518e79fac299 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:06.135770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bb415-4ba3-4011-bda5-518e79fac299 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:06.167397 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b5cb2-5355-405e-b5e0-eac175cc09ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:06.168733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b5cb2-5355-405e-b5e0-eac175cc09ff None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:06.169023 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b5cb2-5355-405e-b5e0-eac175cc09ff None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:06.169302 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b5cb2-5355-405e-b5e0-eac175cc09ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:06.170485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b5cb2-5355-405e-b5e0-eac175cc09ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:06.171977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b5cb2-5355-405e-b5e0-eac175cc09ff None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:06.173563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 33/60] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:49:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:06.179183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bb565-c601-4d3c-99e8-4a4d5830a25c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:06.272106 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bb565-c601-4d3c-99e8-4a4d5830a25c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:06.304331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17386874-c58c-480f-b6bd-d6030caea9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:06.304995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17386874-c58c-480f-b6bd-d6030caea9e5 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:06.305283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17386874-c58c-480f-b6bd-d6030caea9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:06.305567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17386874-c58c-480f-b6bd-d6030caea9e5 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:06.306273 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17386874-c58c-480f-b6bd-d6030caea9e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:06.307757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17386874-c58c-480f-b6bd-d6030caea9e5 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:06.412968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 28/61] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:49:06 2022] POST /identity/v3/users => generated 275 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:49:09.737161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb0dd0-8350-4521-af0c-e3f8c59b7e13 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:09.738044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb0dd0-8350-4521-af0c-e3f8c59b7e13 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:09.738469 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb0dd0-8350-4521-af0c-e3f8c59b7e13 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:09.740296 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 34/62] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:09.745703 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82053ce5-2472-4274-bda2-c8066de0b774 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:09.746641 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82053ce5-2472-4274-bda2-c8066de0b774 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:09.747063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82053ce5-2472-4274-bda2-c8066de0b774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:09.768115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-82053ce5-2472-4274-bda2-c8066de0b774 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:09.769534 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-82053ce5-2472-4274-bda2-c8066de0b774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:09.857960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 29/63] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:09.901237 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb0dd0-8350-4521-af0c-e3f8c59b7e13 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:09.913374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8eaf8-962d-4616-8e0b-79f0d1c6d716 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:09.915593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8eaf8-962d-4616-8e0b-79f0d1c6d716 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:09.916041 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8eaf8-962d-4616-8e0b-79f0d1c6d716 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:09.919779 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 30/64] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:09.923552 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05fd85-621e-44e2-9a40-4203684aadb5 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:09.924100 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05fd85-621e-44e2-9a40-4203684aadb5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:09.924523 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05fd85-621e-44e2-9a40-4203684aadb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:09.956115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ce05fd85-621e-44e2-9a40-4203684aadb5 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:09.957544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ce05fd85-621e-44e2-9a40-4203684aadb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:10.030478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb0dd0-8350-4521-af0c-e3f8c59b7e13 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:10.107264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3ca6b-34f1-4e13-a356-2d12e6ba392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:10.108078 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3ca6b-34f1-4e13-a356-2d12e6ba392a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:10.108364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3ca6b-34f1-4e13-a356-2d12e6ba392a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:10.108641 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3ca6b-34f1-4e13-a356-2d12e6ba392a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:10.124485 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 31/65] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:10.129869 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3ca6b-34f1-4e13-a356-2d12e6ba392a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-32a3ca6b-34f1-4e13-a356-2d12e6ba392a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:10.138582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:10.139638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:10.140580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:10.140580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:10.140580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:10.140580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:10.140580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:10.140580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:10.140580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:10.140580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:10.140580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:10.140580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:10.140580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:10.140580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:10.142752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 35/66] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:10.148200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05fd85-621e-44e2-9a40-4203684aadb5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:10.174735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7134e-9b6d-47b5-8da8-9bea3f5cf9d0 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:10.175028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7134e-9b6d-47b5-8da8-9bea3f5cf9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:10.176181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7134e-9b6d-47b5-8da8-9bea3f5cf9d0 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:10.178291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 36/67] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:10.179546 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7134e-9b6d-47b5-8da8-9bea3f5cf9d0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:10.267166 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05fd85-621e-44e2-9a40-4203684aadb5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:10.289042 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7134e-9b6d-47b5-8da8-9bea3f5cf9d0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:10.302951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781ae7c-473c-418a-ab36-b91a57708969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:10.303649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781ae7c-473c-418a-ab36-b91a57708969 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:10.304089 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781ae7c-473c-418a-ab36-b91a57708969 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:10.304504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781ae7c-473c-418a-ab36-b91a57708969 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:10.305407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781ae7c-473c-418a-ab36-b91a57708969 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:10.305715 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781ae7c-473c-418a-ab36-b91a57708969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:10.307137 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781ae7c-473c-418a-ab36-b91a57708969 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:10.315272 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 32/68] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:10.316653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34cc1c-4f16-4009-8604-98bf2ace5d0b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:10.316946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34cc1c-4f16-4009-8604-98bf2ace5d0b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:10.317223 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34cc1c-4f16-4009-8604-98bf2ace5d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:10.328475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf9a41-54ea-4986-bcde-d47785463b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:10.329275 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf9a41-54ea-4986-bcde-d47785463b31 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:10.329560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf9a41-54ea-4986-bcde-d47785463b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:10.330212 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf9a41-54ea-4986-bcde-d47785463b31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:10.335071 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ff34cc1c-4f16-4009-8604-98bf2ace5d0b None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:10.336296 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ff34cc1c-4f16-4009-8604-98bf2ace5d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:10.340018 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf9a41-54ea-4986-bcde-d47785463b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2fbf9a41-54ea-4986-bcde-d47785463b31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:10.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:10.348530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:10.349274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:10.349274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:10.349274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:10.349274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:10.349274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:10.349274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:10.349274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:10.349274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:10.349274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:10.349274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:10.349274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:10.349274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:10.349274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 37/69] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:49:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:10.350365 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4031497-3e43-46e4-9b59-55ddcbb27f6c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:10.350365 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4031497-3e43-46e4-9b59-55ddcbb27f6c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:10.350699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4031497-3e43-46e4-9b59-55ddcbb27f6c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:10.352183 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 38/70] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:10.352881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4031497-3e43-46e4-9b59-55ddcbb27f6c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:10.412530 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 33/71] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:10.413378 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34cc1c-4f16-4009-8604-98bf2ace5d0b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:10.458843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4031497-3e43-46e4-9b59-55ddcbb27f6c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:10.491027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621914d3-f523-471a-8056-1953f00f4f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:10.491935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621914d3-f523-471a-8056-1953f00f4f73 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:10.492218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621914d3-f523-471a-8056-1953f00f4f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:10.492494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621914d3-f523-471a-8056-1953f00f4f73 None admin] PATH_INFO: `/v3/users/904d6d2dd6e34c9bac78d58a88116330` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:10.506845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621914d3-f523-471a-8056-1953f00f4f73 None admin] RBAC: Authorizing `identity:get_user(user_id=904d6d2dd6e34c9bac78d58a88116330)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:10.508336 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621914d3-f523-471a-8056-1953f00f4f73 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:10.509977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 39/72] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:10 2022] GET /identity/v3/users/904d6d2dd6e34c9bac78d58a88116330 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:10.511138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ecf9a-c0f0-4f52-9dce-acd7babfc0ec None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:10.511447 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ecf9a-c0f0-4f52-9dce-acd7babfc0ec None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:10.511793 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ecf9a-c0f0-4f52-9dce-acd7babfc0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:10.514990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34cc1c-4f16-4009-8604-98bf2ace5d0b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:10.527744 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-558ecf9a-c0f0-4f52-9dce-acd7babfc0ec None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:10.529090 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-558ecf9a-c0f0-4f52-9dce-acd7babfc0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:10.547838 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5835501-b111-4881-9f07-a5d775afb815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:10.548442 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5835501-b111-4881-9f07-a5d775afb815 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:10.548728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5835501-b111-4881-9f07-a5d775afb815 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:10.549004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5835501-b111-4881-9f07-a5d775afb815 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:10.549752 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5835501-b111-4881-9f07-a5d775afb815 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:10.550060 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5835501-b111-4881-9f07-a5d775afb815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:10.551739 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5835501-b111-4881-9f07-a5d775afb815 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:10.560188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 34/73] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:10.561585 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3932d7-c916-45f0-a07c-29baa512dff8 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:10.561885 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3932d7-c916-45f0-a07c-29baa512dff8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:10.562167 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3932d7-c916-45f0-a07c-29baa512dff8 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:10.563604 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 35/74] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:10.568185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3932d7-c916-45f0-a07c-29baa512dff8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:10.603297 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 40/75] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:10.604009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ecf9a-c0f0-4f52-9dce-acd7babfc0ec None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:10.666683 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3932d7-c916-45f0-a07c-29baa512dff8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:10.698793 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ecf9a-c0f0-4f52-9dce-acd7babfc0ec None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:10.699990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48cd41-f90f-4cbe-bb91-e7a50360909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:10.700798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48cd41-f90f-4cbe-bb91-e7a50360909f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:10.701086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48cd41-f90f-4cbe-bb91-e7a50360909f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:10.701363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48cd41-f90f-4cbe-bb91-e7a50360909f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:10.711340 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48cd41-f90f-4cbe-bb91-e7a50360909f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ae48cd41-f90f-4cbe-bb91-e7a50360909f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:10.719463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:10.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:10.721311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:10.721311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:10.721311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:10.721311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:10.721311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:10.721311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:10.721311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:10.721311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:10.721311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:10.721311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:10.721311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:10.721311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:10.721311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 36/76] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:49:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:10.721917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48cd41-f90f-4cbe-bb91-e7a50360909f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:10.735274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9c358-921a-4aff-b995-858691c13e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:10.735924 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9c358-921a-4aff-b995-858691c13e05 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:10.736209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9c358-921a-4aff-b995-858691c13e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:10.736492 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9c358-921a-4aff-b995-858691c13e05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:10.800703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9c358-921a-4aff-b995-858691c13e05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:10.802120 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9c358-921a-4aff-b995-858691c13e05 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:10.817926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48cd41-f90f-4cbe-bb91-e7a50360909f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:10.849598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f18d11-9191-416c-b4c8-91b9cba452ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:10.850467 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f18d11-9191-416c-b4c8-91b9cba452ee None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:10.850751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f18d11-9191-416c-b4c8-91b9cba452ee None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:10.851058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f18d11-9191-416c-b4c8-91b9cba452ee None admin] PATH_INFO: `/v3/users/aced3dd744eb487b932a627079853c51` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:10.852293 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f18d11-9191-416c-b4c8-91b9cba452ee None admin] RBAC: Authorizing `identity:get_user(user_id=aced3dd744eb487b932a627079853c51)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:10.853768 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f18d11-9191-416c-b4c8-91b9cba452ee None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:10.856104 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 37/77] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:10 2022] GET /identity/v3/users/aced3dd744eb487b932a627079853c51 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:10.857440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc626ef-c46e-4227-bb5c-cad885c68036 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:10.857733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc626ef-c46e-4227-bb5c-cad885c68036 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:10.858014 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc626ef-c46e-4227-bb5c-cad885c68036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:10.874921 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1bc626ef-c46e-4227-bb5c-cad885c68036 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:10.876143 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1bc626ef-c46e-4227-bb5c-cad885c68036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:10.901692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 41/78] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:10.902595 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9c358-921a-4aff-b995-858691c13e05 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:10.948206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 38/79] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:10.949647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc626ef-c46e-4227-bb5c-cad885c68036 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:11.005691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9c358-921a-4aff-b995-858691c13e05 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:11.037323 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465609e-73f3-4300-bf6f-386cb44119fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:11.038111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465609e-73f3-4300-bf6f-386cb44119fb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:11.038398 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465609e-73f3-4300-bf6f-386cb44119fb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:11.038667 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465609e-73f3-4300-bf6f-386cb44119fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:11.046074 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc626ef-c46e-4227-bb5c-cad885c68036 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:11.049060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465609e-73f3-4300-bf6f-386cb44119fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2465609e-73f3-4300-bf6f-386cb44119fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:11.056978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:11.057778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:11.059165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:11.059165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:11.059165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:11.059165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:11.059165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:11.059165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:11.059165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:11.059165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:11.059165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:11.059165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:11.059165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:11.059165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:11.059165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 42/80] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:11.060326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465609e-73f3-4300-bf6f-386cb44119fb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:11.083280 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f47ac-3cf0-4807-bbd3-7257bceb34db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:11.083955 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f47ac-3cf0-4807-bbd3-7257bceb34db None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:11.084240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f47ac-3cf0-4807-bbd3-7257bceb34db None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:11.084517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f47ac-3cf0-4807-bbd3-7257bceb34db None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:11.085262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f47ac-3cf0-4807-bbd3-7257bceb34db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:11.085568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f47ac-3cf0-4807-bbd3-7257bceb34db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:11.086954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f47ac-3cf0-4807-bbd3-7257bceb34db None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:11.095198 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 39/81] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:49:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:11.095978 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f47ac-3cf0-4807-bbd3-7257bceb34db None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:11.154236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465609e-73f3-4300-bf6f-386cb44119fb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:11.186387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a797063-e6f9-494a-81fb-d09fadaccf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:11.187028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a797063-e6f9-494a-81fb-d09fadaccf72 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:11.187347 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a797063-e6f9-494a-81fb-d09fadaccf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:11.187621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a797063-e6f9-494a-81fb-d09fadaccf72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:11.190571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f47ac-3cf0-4807-bbd3-7257bceb34db None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:11.225162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727afa6-329e-4ec6-a964-d0f8c4abd3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:11.226028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727afa6-329e-4ec6-a964-d0f8c4abd3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:11.226315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727afa6-329e-4ec6-a964-d0f8c4abd3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:11.226592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727afa6-329e-4ec6-a964-d0f8c4abd3f6 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:11.227872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727afa6-329e-4ec6-a964-d0f8c4abd3f6 None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:11.229336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727afa6-329e-4ec6-a964-d0f8c4abd3f6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:11.232087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 40/82] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:11 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:11.232567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727afa6-329e-4ec6-a964-d0f8c4abd3f6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:11.253627 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a797063-e6f9-494a-81fb-d09fadaccf72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:11.255100 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a797063-e6f9-494a-81fb-d09fadaccf72 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:11.331005 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727afa6-329e-4ec6-a964-d0f8c4abd3f6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:11.348954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 43/83] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:11.349806 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a797063-e6f9-494a-81fb-d09fadaccf72 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:11.363661 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff2edc-9759-4258-90fb-50ecd6da4212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:11.364450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff2edc-9759-4258-90fb-50ecd6da4212 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:11.364731 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff2edc-9759-4258-90fb-50ecd6da4212 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:11.365002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff2edc-9759-4258-90fb-50ecd6da4212 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:11.366151 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff2edc-9759-4258-90fb-50ecd6da4212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:11.367616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff2edc-9759-4258-90fb-50ecd6da4212 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:11.369204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 41/84] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:49:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:11.369958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff2edc-9759-4258-90fb-50ecd6da4212 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:11.443956 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a797063-e6f9-494a-81fb-d09fadaccf72 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:11.466400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff2edc-9759-4258-90fb-50ecd6da4212 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:11.475712 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a34ee8-96ed-4aef-9032-25d5c8c910a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:11.476371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a34ee8-96ed-4aef-9032-25d5c8c910a6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:11.476656 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a34ee8-96ed-4aef-9032-25d5c8c910a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:11.476934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a34ee8-96ed-4aef-9032-25d5c8c910a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:11.477672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a34ee8-96ed-4aef-9032-25d5c8c910a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:11.477973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a34ee8-96ed-4aef-9032-25d5c8c910a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:11.479370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a34ee8-96ed-4aef-9032-25d5c8c910a6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:11.487834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 44/85] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:11.488613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a34ee8-96ed-4aef-9032-25d5c8c910a6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:11.499649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31901-5037-4a2a-8567-1188fd96a057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:11.500520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31901-5037-4a2a-8567-1188fd96a057 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:11.500803 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31901-5037-4a2a-8567-1188fd96a057 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:11.501080 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31901-5037-4a2a-8567-1188fd96a057 None admin] PATH_INFO: `/v3/users/904d6d2dd6e34c9bac78d58a88116330` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:11.502267 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d31901-5037-4a2a-8567-1188fd96a057 None admin] RBAC: Authorizing `identity:get_user(user_id=904d6d2dd6e34c9bac78d58a88116330)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:11.503758 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d31901-5037-4a2a-8567-1188fd96a057 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:11.505440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 42/86] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:11 2022] GET /identity/v3/users/904d6d2dd6e34c9bac78d58a88116330 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:11.506120 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31901-5037-4a2a-8567-1188fd96a057 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:11.586873 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a34ee8-96ed-4aef-9032-25d5c8c910a6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:11.602300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31901-5037-4a2a-8567-1188fd96a057 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:11.621026 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e59a1-1955-4a15-aed6-53ab88e942fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:11.621935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e59a1-1955-4a15-aed6-53ab88e942fa None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:11.622220 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e59a1-1955-4a15-aed6-53ab88e942fa None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:11.622500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e59a1-1955-4a15-aed6-53ab88e942fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:11.623372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e59a1-1955-4a15-aed6-53ab88e942fa None admin] RBAC: Adding query filter params (role.id=5c8cdbb338e0490b90a50b0b915f9000, scope.project.id=2be755a8e5a94fffa1b804fb26b77a19, user.id=904d6d2dd6e34c9bac78d58a88116330) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:11.623685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e59a1-1955-4a15-aed6-53ab88e942fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:11.625116 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e59a1-1955-4a15-aed6-53ab88e942fa None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:11.630605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 45/87] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:11 2022] GET /identity/v3/role_assignments?user.id=904d6d2dd6e34c9bac78d58a88116330&scope.project.id=2be755a8e5a94fffa1b804fb26b77a19&role.id=5c8cdbb338e0490b90a50b0b915f9000 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:11.631161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e59a1-1955-4a15-aed6-53ab88e942fa None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:11.650867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82364f44-9a63-4b1f-b72f-68406536afa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:11.651981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82364f44-9a63-4b1f-b72f-68406536afa3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:11.652992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82364f44-9a63-4b1f-b72f-68406536afa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:11.653277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82364f44-9a63-4b1f-b72f-68406536afa3 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:11.654688 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82364f44-9a63-4b1f-b72f-68406536afa3 None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:11.656249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82364f44-9a63-4b1f-b72f-68406536afa3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:11.658242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 43/88] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:11 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:11.658854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82364f44-9a63-4b1f-b72f-68406536afa3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:11.745015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e59a1-1955-4a15-aed6-53ab88e942fa None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:11.766499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82364f44-9a63-4b1f-b72f-68406536afa3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:11.780938 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e18a3-ba7e-4d6b-86b3-4fbf61a1699f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:11.781632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e18a3-ba7e-4d6b-86b3-4fbf61a1699f None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:11.781923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e18a3-ba7e-4d6b-86b3-4fbf61a1699f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:11.782206 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e18a3-ba7e-4d6b-86b3-4fbf61a1699f None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:11.782938 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e18a3-ba7e-4d6b-86b3-4fbf61a1699f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:11.784452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e18a3-ba7e-4d6b-86b3-4fbf61a1699f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:11.803316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30c0d4-149d-4d51-9244-f71354390a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:11.804220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30c0d4-149d-4d51-9244-f71354390a46 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:11.804501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30c0d4-149d-4d51-9244-f71354390a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:11.804777 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30c0d4-149d-4d51-9244-f71354390a46 None admin] PATH_INFO: `/v3/users/904d6d2dd6e34c9bac78d58a88116330` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:11.805982 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30c0d4-149d-4d51-9244-f71354390a46 None admin] RBAC: Authorizing `identity:get_user(user_id=904d6d2dd6e34c9bac78d58a88116330)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:11.807475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30c0d4-149d-4d51-9244-f71354390a46 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:11.810001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 44/89] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:11 2022] GET /identity/v3/users/904d6d2dd6e34c9bac78d58a88116330 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:11.817462 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30c0d4-149d-4d51-9244-f71354390a46 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:11.891642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 46/90] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:49:11 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:49:11.892638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e18a3-ba7e-4d6b-86b3-4fbf61a1699f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:11.919842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30c0d4-149d-4d51-9244-f71354390a46 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:11.959777 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db5ad3-7354-4124-b845-84a88b319338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:11.960847 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5ad3-7354-4124-b845-84a88b319338 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:11.961330 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5ad3-7354-4124-b845-84a88b319338 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:11.961806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5ad3-7354-4124-b845-84a88b319338 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:12.017436 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e18a3-ba7e-4d6b-86b3-4fbf61a1699f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:12.037434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db5ad3-7354-4124-b845-84a88b319338 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:12.039328 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db5ad3-7354-4124-b845-84a88b319338 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:12.055290 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf8162-9374-4017-b504-f96566748e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:12.056018 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf8162-9374-4017-b504-f96566748e52 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:12.056307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf8162-9374-4017-b504-f96566748e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:12.056643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf8162-9374-4017-b504-f96566748e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:12.057705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf8162-9374-4017-b504-f96566748e52 None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=2be755a8e5a94fffa1b804fb26b77a19, user.id=aced3dd744eb487b932a627079853c51) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:12.057887 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf8162-9374-4017-b504-f96566748e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:12.060463 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf8162-9374-4017-b504-f96566748e52 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:12.067128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 47/91] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:11 2022] GET /identity/v3/role_assignments?user.id=aced3dd744eb487b932a627079853c51&scope.project.id=2be755a8e5a94fffa1b804fb26b77a19&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:12.068101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf8162-9374-4017-b504-f96566748e52 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:12.153213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 45/92] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:12.159050 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db5ad3-7354-4124-b845-84a88b319338 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:12.183228 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf8162-9374-4017-b504-f96566748e52 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:12.223815 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb142341-ca79-4ea5-b907-92a9214d3ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:12.224505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb142341-ca79-4ea5-b907-92a9214d3ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:12.225003 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb142341-ca79-4ea5-b907-92a9214d3ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:12.225284 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb142341-ca79-4ea5-b907-92a9214d3ac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:12.270767 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db5ad3-7354-4124-b845-84a88b319338 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:12.302970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb142341-ca79-4ea5-b907-92a9214d3ac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:12.305723 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb142341-ca79-4ea5-b907-92a9214d3ac4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:12.306823 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495afe42-7593-45ec-9335-0c3f197480df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:12.307953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495afe42-7593-45ec-9335-0c3f197480df None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:12.308524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495afe42-7593-45ec-9335-0c3f197480df None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:12.309001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495afe42-7593-45ec-9335-0c3f197480df None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:12.310485 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495afe42-7593-45ec-9335-0c3f197480df None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:12.312183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495afe42-7593-45ec-9335-0c3f197480df None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:12.314164 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 46/93] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:12 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:12.319934 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495afe42-7593-45ec-9335-0c3f197480df None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:12.421003 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 48/94] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:12.426712 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb142341-ca79-4ea5-b907-92a9214d3ac4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:12.431543 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495afe42-7593-45ec-9335-0c3f197480df None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:12.466828 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2a31e-4c4b-45af-ba32-2631870ace12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:12.467792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2a31e-4c4b-45af-ba32-2631870ace12 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:12.468231 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2a31e-4c4b-45af-ba32-2631870ace12 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:12.468651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2a31e-4c4b-45af-ba32-2631870ace12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:12.469645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2a31e-4c4b-45af-ba32-2631870ace12 None admin] RBAC: Adding query filter params (role.id=e5fee74fe53d429897caab84ecf4e5d9, scope.project.id=2be755a8e5a94fffa1b804fb26b77a19, user.id=904d6d2dd6e34c9bac78d58a88116330) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:12.470105 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2a31e-4c4b-45af-ba32-2631870ace12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:12.471738 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2a31e-4c4b-45af-ba32-2631870ace12 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:12.477723 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 47/95] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:12 2022] GET /identity/v3/role_assignments?user.id=904d6d2dd6e34c9bac78d58a88116330&scope.project.id=2be755a8e5a94fffa1b804fb26b77a19&role.id=e5fee74fe53d429897caab84ecf4e5d9 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:12.540617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb142341-ca79-4ea5-b907-92a9214d3ac4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:12.586860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c24858-896e-4a29-9ae9-0bf69ac6fe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:12.587782 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c24858-896e-4a29-9ae9-0bf69ac6fe15 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:12.588064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c24858-896e-4a29-9ae9-0bf69ac6fe15 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:12.588337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c24858-896e-4a29-9ae9-0bf69ac6fe15 None admin] PATH_INFO: `/v3/projects/e0b2bed8236c45c19220276b13e059bc` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:12.591544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c24858-896e-4a29-9ae9-0bf69ac6fe15 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b2bed8236c45c19220276b13e059bc)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:12.593107 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c24858-896e-4a29-9ae9-0bf69ac6fe15 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:12.594949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 49/96] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:12 2022] GET /identity/v3/projects/e0b2bed8236c45c19220276b13e059bc => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:12.601013 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2a31e-4c4b-45af-ba32-2631870ace12 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:12.740753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2a31e-4c4b-45af-ba32-2631870ace12 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:12.778825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacdfeb-6f46-4f3d-9c7c-608cc266d66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:12.779528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacdfeb-6f46-4f3d-9c7c-608cc266d66b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:12.779807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacdfeb-6f46-4f3d-9c7c-608cc266d66b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:12.780087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacdfeb-6f46-4f3d-9c7c-608cc266d66b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:12.780926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacdfeb-6f46-4f3d-9c7c-608cc266d66b None admin] RBAC: Adding query filter params (role.id=5c8cdbb338e0490b90a50b0b915f9000, scope.project.id=e0b2bed8236c45c19220276b13e059bc, user.id=904d6d2dd6e34c9bac78d58a88116330) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:12.781241 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacdfeb-6f46-4f3d-9c7c-608cc266d66b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:12.782677 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacdfeb-6f46-4f3d-9c7c-608cc266d66b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:12.788960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 48/97] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:12 2022] GET /identity/v3/role_assignments?user.id=904d6d2dd6e34c9bac78d58a88116330&scope.project.id=e0b2bed8236c45c19220276b13e059bc&role.id=5c8cdbb338e0490b90a50b0b915f9000 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:14.237389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208bb27-3118-45fb-8e99-dae20e578044 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:14.237881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208bb27-3118-45fb-8e99-dae20e578044 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:14.237881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208bb27-3118-45fb-8e99-dae20e578044 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:14.239294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 50/98] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:14.244612 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3ede6-807f-450c-8be3-7b15922d07d9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:14.245004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3ede6-807f-450c-8be3-7b15922d07d9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:14.245169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3ede6-807f-450c-8be3-7b15922d07d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:14.268093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b5f3ede6-807f-450c-8be3-7b15922d07d9 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:14.269589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b5f3ede6-807f-450c-8be3-7b15922d07d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:14.352753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 49/99] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:14.393158 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208bb27-3118-45fb-8e99-dae20e578044 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:14.548779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208bb27-3118-45fb-8e99-dae20e578044 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:14.590697 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbef62-1889-45a3-a00f-ba88f3204456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:14.591535 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbef62-1889-45a3-a00f-ba88f3204456 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:14.591825 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbef62-1889-45a3-a00f-ba88f3204456 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:14.592109 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbef62-1889-45a3-a00f-ba88f3204456 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:14.608899 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbef62-1889-45a3-a00f-ba88f3204456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-68bbef62-1889-45a3-a00f-ba88f3204456 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:14.616745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:14.617672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:14.618523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:14.618523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:14.618523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:14.618523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:14.618523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:14.618523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:14.618523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:14.618523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:14.618523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:14.618523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:14.618523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:14.618523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:14.618523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 51/100] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:14.628334 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3ede6-807f-450c-8be3-7b15922d07d9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:14.774407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3ede6-807f-450c-8be3-7b15922d07d9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:14.818260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93f52b-ec92-4c59-9f98-90549de6cc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:14.819322 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93f52b-ec92-4c59-9f98-90549de6cc84 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:14.819824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93f52b-ec92-4c59-9f98-90549de6cc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:14.820302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93f52b-ec92-4c59-9f98-90549de6cc84 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:14.821266 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93f52b-ec92-4c59-9f98-90549de6cc84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:14.821792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93f52b-ec92-4c59-9f98-90549de6cc84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:14.823403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93f52b-ec92-4c59-9f98-90549de6cc84 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:14.832955 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 50/101] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:14.840138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbef62-1889-45a3-a00f-ba88f3204456 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:14.993755 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbef62-1889-45a3-a00f-ba88f3204456 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:15.044041 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6a803-05ef-4c00-b0d1-0f5ba8b8c0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:15.044930 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6a803-05ef-4c00-b0d1-0f5ba8b8c0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:15.045214 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6a803-05ef-4c00-b0d1-0f5ba8b8c0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:15.045489 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6a803-05ef-4c00-b0d1-0f5ba8b8c0a8 None admin] PATH_INFO: `/v3/users/904d6d2dd6e34c9bac78d58a88116330` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:15.046736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6a803-05ef-4c00-b0d1-0f5ba8b8c0a8 None admin] RBAC: Authorizing `identity:get_user(user_id=904d6d2dd6e34c9bac78d58a88116330)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:15.048198 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6a803-05ef-4c00-b0d1-0f5ba8b8c0a8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:15.050174 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 52/102] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:14 2022] GET /identity/v3/users/904d6d2dd6e34c9bac78d58a88116330 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:15.056122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93f52b-ec92-4c59-9f98-90549de6cc84 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:15.191888 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93f52b-ec92-4c59-9f98-90549de6cc84 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:15.230206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed8245-f465-474c-b131-1e839b6f067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:15.231472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed8245-f465-474c-b131-1e839b6f067f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:15.231975 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed8245-f465-474c-b131-1e839b6f067f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:15.232461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed8245-f465-474c-b131-1e839b6f067f None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:15.239837 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed8245-f465-474c-b131-1e839b6f067f None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:15.241529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed8245-f465-474c-b131-1e839b6f067f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:15.243853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 51/103] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:15 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:15.249393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6a803-05ef-4c00-b0d1-0f5ba8b8c0a8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:15.414950 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6a803-05ef-4c00-b0d1-0f5ba8b8c0a8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:15.430094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4651f7-2322-4fce-9661-a40ea3ec313d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:15.431049 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4651f7-2322-4fce-9661-a40ea3ec313d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:15.431596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4651f7-2322-4fce-9661-a40ea3ec313d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:15.433248 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 52/104] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:15.440929 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0d33-530b-4b28-a256-735bc8fdf7e8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:15.441493 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0d33-530b-4b28-a256-735bc8fdf7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:15.442052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0d33-530b-4b28-a256-735bc8fdf7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:15.468040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202e5bb-bb97-44f8-b7b8-8665cb5a3805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:15.470360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202e5bb-bb97-44f8-b7b8-8665cb5a3805 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:15.470360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202e5bb-bb97-44f8-b7b8-8665cb5a3805 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:15.470360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202e5bb-bb97-44f8-b7b8-8665cb5a3805 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19/users/904d6d2dd6e34c9bac78d58a88116330/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:15.471867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-af8a0d33-530b-4b28-a256-735bc8fdf7e8 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:15.471993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202e5bb-bb97-44f8-b7b8-8665cb5a3805 None admin] RBAC: Authorizing `identity:create_grant(project_id=2be755a8e5a94fffa1b804fb26b77a19, user_id=904d6d2dd6e34c9bac78d58a88116330, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:15.473373 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202e5bb-bb97-44f8-b7b8-8665cb5a3805 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:15.473570 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-af8a0d33-530b-4b28-a256-735bc8fdf7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:15.556493 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 53/105] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:15.558045 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c066f-2abd-4f9b-a95f-aaf8a752b79d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:15.558460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c066f-2abd-4f9b-a95f-aaf8a752b79d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:15.558855 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c066f-2abd-4f9b-a95f-aaf8a752b79d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:15.564455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 54/106] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:15.571145 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 53/107] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:49:15 2022] PUT /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19/users/904d6d2dd6e34c9bac78d58a88116330/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:49:15.572446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adecfc-2de9-424c-9854-5ca717324870 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:15.572737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adecfc-2de9-424c-9854-5ca717324870 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:15.573014 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adecfc-2de9-424c-9854-5ca717324870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:15.591144 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d6adecfc-2de9-424c-9854-5ca717324870 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:15.592322 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d6adecfc-2de9-424c-9854-5ca717324870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:15.596177 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202e5bb-bb97-44f8-b7b8-8665cb5a3805 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:15.706442 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 55/108] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:15.773719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adecfc-2de9-424c-9854-5ca717324870 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:15.810044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202e5bb-bb97-44f8-b7b8-8665cb5a3805 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:15.873618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c759f8-ed31-4e05-a4cf-fe70040b4818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:15.874454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c759f8-ed31-4e05-a4cf-fe70040b4818 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:15.874732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c759f8-ed31-4e05-a4cf-fe70040b4818 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:15.875016 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c759f8-ed31-4e05-a4cf-fe70040b4818 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:15.900256 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c759f8-ed31-4e05-a4cf-fe70040b4818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-67c759f8-ed31-4e05-a4cf-fe70040b4818 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:15.909959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:15.910833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:15.911669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:15.911669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:15.911669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:15.911669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:15.911669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:15.911669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:15.911669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:15.911669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:15.911669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:15.911669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:15.911669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:15.911669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:15.911669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 54/109] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:49:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:15.914157 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adecfc-2de9-424c-9854-5ca717324870 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:15.916891 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c759f8-ed31-4e05-a4cf-fe70040b4818 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:15.950066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36734cc-a6a7-4f92-bb10-3e8db4e58237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:15.950832 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36734cc-a6a7-4f92-bb10-3e8db4e58237 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:15.951137 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36734cc-a6a7-4f92-bb10-3e8db4e58237 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:15.951403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36734cc-a6a7-4f92-bb10-3e8db4e58237 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:15.961752 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36734cc-a6a7-4f92-bb10-3e8db4e58237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-d36734cc-a6a7-4f92-bb10-3e8db4e58237 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:15.969730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:15.970575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:15.971369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:15.971369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:15.971369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:15.971369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:15.971369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:15.971369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:15.971369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:15.971369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:15.971369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:15.971369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:15.971369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:15.971369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:15.971369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 56/110] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:49:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:49:15.978707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36734cc-a6a7-4f92-bb10-3e8db4e58237 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:16.146990 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c759f8-ed31-4e05-a4cf-fe70040b4818 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:16.149743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36734cc-a6a7-4f92-bb10-3e8db4e58237 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:16.184314 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56435e71-0525-4c11-bf56-dcd61fa68540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:16.184995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56435e71-0525-4c11-bf56-dcd61fa68540 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:16.185278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56435e71-0525-4c11-bf56-dcd61fa68540 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:16.185550 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56435e71-0525-4c11-bf56-dcd61fa68540 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:16.186301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56435e71-0525-4c11-bf56-dcd61fa68540 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:16.186604 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56435e71-0525-4c11-bf56-dcd61fa68540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:16.188017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56435e71-0525-4c11-bf56-dcd61fa68540 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:16.196470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 57/111] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:16.197920 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36699ca8-97ff-400f-840f-cd133dac3303 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:16.198214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36699ca8-97ff-400f-840f-cd133dac3303 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:16.198492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36699ca8-97ff-400f-840f-cd133dac3303 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:16.200438 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 58/112] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:16.207168 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36699ca8-97ff-400f-840f-cd133dac3303 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:16.213195 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1927a0-92f7-4d2e-b6f9-03c0e4f68a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:16.213816 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1927a0-92f7-4d2e-b6f9-03c0e4f68a87 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:16.214109 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1927a0-92f7-4d2e-b6f9-03c0e4f68a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:16.214504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1927a0-92f7-4d2e-b6f9-03c0e4f68a87 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:16.215923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1927a0-92f7-4d2e-b6f9-03c0e4f68a87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:16.216241 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1927a0-92f7-4d2e-b6f9-03c0e4f68a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:16.217642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1927a0-92f7-4d2e-b6f9-03c0e4f68a87 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:16.232618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 55/113] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:49:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:16.233964 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fc81d-eb24-477b-9bbf-99e037ce22ae None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:16.234261 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fc81d-eb24-477b-9bbf-99e037ce22ae None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:16.234545 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fc81d-eb24-477b-9bbf-99e037ce22ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:16.264341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4d2fc81d-eb24-477b-9bbf-99e037ce22ae None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:16.265583 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4d2fc81d-eb24-477b-9bbf-99e037ce22ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:16.366487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36699ca8-97ff-400f-840f-cd133dac3303 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:16.378656 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 56/114] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:16.379919 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fc81d-eb24-477b-9bbf-99e037ce22ae None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:16.402822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c2b1f-e9ac-4bf9-9cec-065d0499f261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:16.404079 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c2b1f-e9ac-4bf9-9cec-065d0499f261 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:16.404623 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c2b1f-e9ac-4bf9-9cec-065d0499f261 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:16.405096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c2b1f-e9ac-4bf9-9cec-065d0499f261 None admin] PATH_INFO: `/v3/users/aced3dd744eb487b932a627079853c51` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:16.406696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c2b1f-e9ac-4bf9-9cec-065d0499f261 None admin] RBAC: Authorizing `identity:get_user(user_id=aced3dd744eb487b932a627079853c51)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:16.408420 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c2b1f-e9ac-4bf9-9cec-065d0499f261 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:16.410710 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 59/115] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:16 2022] GET /identity/v3/users/aced3dd744eb487b932a627079853c51 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:16.416395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10923c2-e754-4e6d-9c7e-be4e3e625993 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:16.417049 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10923c2-e754-4e6d-9c7e-be4e3e625993 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:16.417624 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10923c2-e754-4e6d-9c7e-be4e3e625993 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:16.419618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 60/116] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:16.420726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10923c2-e754-4e6d-9c7e-be4e3e625993 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:16.494003 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fc81d-eb24-477b-9bbf-99e037ce22ae None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:16.533529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ad0fb-ae53-4606-95a9-6a9bce76f7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:16.534416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ad0fb-ae53-4606-95a9-6a9bce76f7ff None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:16.534701 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ad0fb-ae53-4606-95a9-6a9bce76f7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:16.534982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ad0fb-ae53-4606-95a9-6a9bce76f7ff None admin] PATH_INFO: `/v3/users/904d6d2dd6e34c9bac78d58a88116330` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:16.536220 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ad0fb-ae53-4606-95a9-6a9bce76f7ff None admin] RBAC: Authorizing `identity:get_user(user_id=904d6d2dd6e34c9bac78d58a88116330)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:16.537680 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ad0fb-ae53-4606-95a9-6a9bce76f7ff None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:16.538922 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10923c2-e754-4e6d-9c7e-be4e3e625993 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:16.539402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 57/117] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:16 2022] GET /identity/v3/users/904d6d2dd6e34c9bac78d58a88116330 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:16.540108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ad0fb-ae53-4606-95a9-6a9bce76f7ff None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:16.578403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27694f7a-fb2b-4ccb-b7b4-41ed57330ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:16.579229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27694f7a-fb2b-4ccb-b7b4-41ed57330ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:16.579528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27694f7a-fb2b-4ccb-b7b4-41ed57330ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:16.581424 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27694f7a-fb2b-4ccb-b7b4-41ed57330ce0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:16.591340 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27694f7a-fb2b-4ccb-b7b4-41ed57330ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-27694f7a-fb2b-4ccb-b7b4-41ed57330ce0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:16.599063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:16.600148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:16.606269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:16.606269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:16.606269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:16.606269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:16.606269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:16.606269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:16.606269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:16.606269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:16.606269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:16.606269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:16.606269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:16.606269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:16.606269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 61/118] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:16.606269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832735e-281b-44c2-bada-1e0c1adb71bb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:16.607127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832735e-281b-44c2-bada-1e0c1adb71bb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:16.607127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832735e-281b-44c2-bada-1e0c1adb71bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:16.622361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e832735e-281b-44c2-bada-1e0c1adb71bb None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:16.623579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e832735e-281b-44c2-bada-1e0c1adb71bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:16.649451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ad0fb-ae53-4606-95a9-6a9bce76f7ff None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:16.686566 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26a69c-d69b-4155-86ad-ccdbf12f672f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:16.687471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26a69c-d69b-4155-86ad-ccdbf12f672f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:16.687751 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26a69c-d69b-4155-86ad-ccdbf12f672f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:16.688031 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26a69c-d69b-4155-86ad-ccdbf12f672f None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:16.689210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26a69c-d69b-4155-86ad-ccdbf12f672f None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:16.690660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26a69c-d69b-4155-86ad-ccdbf12f672f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:16.697236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 58/119] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:16 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:16.697236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdad525-4477-4a17-a286-1c9c2b4a1699 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:16.697236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdad525-4477-4a17-a286-1c9c2b4a1699 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:16.697236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdad525-4477-4a17-a286-1c9c2b4a1699 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:16.697236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 59/120] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:16.697236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdad525-4477-4a17-a286-1c9c2b4a1699 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:16.699534 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 62/121] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:16.701869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832735e-281b-44c2-bada-1e0c1adb71bb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:16.798205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdad525-4477-4a17-a286-1c9c2b4a1699 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:16.799717 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832735e-281b-44c2-bada-1e0c1adb71bb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:16.831753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dc31b-a218-468e-bef3-6068a0bd366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:16.832831 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dc31b-a218-468e-bef3-6068a0bd366b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:16.832941 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de47fd-4baa-4148-b5b0-ca2e1e121968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:16.833368 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dc31b-a218-468e-bef3-6068a0bd366b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:16.833578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de47fd-4baa-4148-b5b0-ca2e1e121968 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:16.833867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de47fd-4baa-4148-b5b0-ca2e1e121968 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:16.834063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dc31b-a218-468e-bef3-6068a0bd366b None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:16.834175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de47fd-4baa-4148-b5b0-ca2e1e121968 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:16.834886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de47fd-4baa-4148-b5b0-ca2e1e121968 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:16.835230 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de47fd-4baa-4148-b5b0-ca2e1e121968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:16.835789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dc31b-a218-468e-bef3-6068a0bd366b None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:16.836653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de47fd-4baa-4148-b5b0-ca2e1e121968 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:16.837488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dc31b-a218-468e-bef3-6068a0bd366b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:16.839924 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 60/122] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:16 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:16.840791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dc31b-a218-468e-bef3-6068a0bd366b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:16.850044 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 63/123] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:16.850044 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9bc4-1975-4c3e-87f7-9a10a593f68d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:16.850044 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9bc4-1975-4c3e-87f7-9a10a593f68d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:16.850044 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9bc4-1975-4c3e-87f7-9a10a593f68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:16.864360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6afc9bc4-1975-4c3e-87f7-9a10a593f68d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:16.865643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6afc9bc4-1975-4c3e-87f7-9a10a593f68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:16.941271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 64/124] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:16.942380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc9bc4-1975-4c3e-87f7-9a10a593f68d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:16.958872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dc31b-a218-468e-bef3-6068a0bd366b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:16.997566 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74897657-e0b9-4aea-9cd7-8b67dabb3e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:16.998697 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897657-e0b9-4aea-9cd7-8b67dabb3e19 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:16.998976 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897657-e0b9-4aea-9cd7-8b67dabb3e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:16.999280 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897657-e0b9-4aea-9cd7-8b67dabb3e19 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19/users/aced3dd744eb487b932a627079853c51/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:17.001271 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74897657-e0b9-4aea-9cd7-8b67dabb3e19 None admin] RBAC: Authorizing `identity:create_grant(project_id=2be755a8e5a94fffa1b804fb26b77a19, user_id=aced3dd744eb487b932a627079853c51, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:17.002677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74897657-e0b9-4aea-9cd7-8b67dabb3e19 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:17.050281 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc9bc4-1975-4c3e-87f7-9a10a593f68d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:17.083349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd4454-98c1-4e18-b458-0169a1c1a37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:17.084140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd4454-98c1-4e18-b458-0169a1c1a37c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:17.084420 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd4454-98c1-4e18-b458-0169a1c1a37c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:17.084695 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd4454-98c1-4e18-b458-0169a1c1a37c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:17.095597 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd4454-98c1-4e18-b458-0169a1c1a37c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:17.108691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 61/125] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:49:16 2022] PUT /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19/users/aced3dd744eb487b932a627079853c51/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:49:17.108691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74897657-e0b9-4aea-9cd7-8b67dabb3e19 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-d1fd4454-98c1-4e18-b458-0169a1c1a37c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:17.108954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:17.109951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:17.110693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:17.110693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:17.110693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:17.110693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:17.110693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:17.110693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:17.110693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:17.110693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:17.110693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:17.110693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:17.110693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:17.110693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:17.110693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 65/126] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:17.110693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd4454-98c1-4e18-b458-0169a1c1a37c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:17.220155 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74897657-e0b9-4aea-9cd7-8b67dabb3e19 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:17.258860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4257f-1ae4-4b94-a1ed-2d1fb022b681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:17.259796 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4257f-1ae4-4b94-a1ed-2d1fb022b681 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:17.260081 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4257f-1ae4-4b94-a1ed-2d1fb022b681 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:17.260357 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4257f-1ae4-4b94-a1ed-2d1fb022b681 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19/users/904d6d2dd6e34c9bac78d58a88116330/roles/e5fee74fe53d429897caab84ecf4e5d9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:17.263569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4257f-1ae4-4b94-a1ed-2d1fb022b681 None admin] RBAC: Authorizing `identity:create_grant(project_id=2be755a8e5a94fffa1b804fb26b77a19, user_id=904d6d2dd6e34c9bac78d58a88116330, role_id=e5fee74fe53d429897caab84ecf4e5d9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:17.265112 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4257f-1ae4-4b94-a1ed-2d1fb022b681 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:17.275494 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd4454-98c1-4e18-b458-0169a1c1a37c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:17.311526 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6e531-b4d6-47d4-babb-98a1200f8872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:17.312362 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6e531-b4d6-47d4-babb-98a1200f8872 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:17.312646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6e531-b4d6-47d4-babb-98a1200f8872 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:17.312930 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6e531-b4d6-47d4-babb-98a1200f8872 None admin] PATH_INFO: `/v3/users/904d6d2dd6e34c9bac78d58a88116330` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:17.314163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6e531-b4d6-47d4-babb-98a1200f8872 None admin] RBAC: Authorizing `identity:get_user(user_id=904d6d2dd6e34c9bac78d58a88116330)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:17.315801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6e531-b4d6-47d4-babb-98a1200f8872 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:17.319634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 66/127] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:17 2022] GET /identity/v3/users/904d6d2dd6e34c9bac78d58a88116330 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:17.320437 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6e531-b4d6-47d4-babb-98a1200f8872 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:17.325489 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 62/128] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:49:17 2022] PUT /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19/users/904d6d2dd6e34c9bac78d58a88116330/roles/e5fee74fe53d429897caab84ecf4e5d9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:49:17.326629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4257f-1ae4-4b94-a1ed-2d1fb022b681 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:17.425845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6e531-b4d6-47d4-babb-98a1200f8872 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:17.436227 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4257f-1ae4-4b94-a1ed-2d1fb022b681 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:17.463988 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3e7cf-9394-4db8-81d5-fcdd2062a880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:17.470967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3e7cf-9394-4db8-81d5-fcdd2062a880 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:17.470967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3e7cf-9394-4db8-81d5-fcdd2062a880 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:17.470967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3e7cf-9394-4db8-81d5-fcdd2062a880 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:17.470967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3e7cf-9394-4db8-81d5-fcdd2062a880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:17.470967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3e7cf-9394-4db8-81d5-fcdd2062a880 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:17.470967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 67/129] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:49:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:17.471762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3e7cf-9394-4db8-81d5-fcdd2062a880 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:17.483010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8aef6f-d53f-4857-aa91-51366610d18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:17.483765 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8aef6f-d53f-4857-aa91-51366610d18e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:17.484056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8aef6f-d53f-4857-aa91-51366610d18e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:17.484376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8aef6f-d53f-4857-aa91-51366610d18e None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:17.485138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8aef6f-d53f-4857-aa91-51366610d18e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:17.485478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8aef6f-d53f-4857-aa91-51366610d18e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:17.487030 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8aef6f-d53f-4857-aa91-51366610d18e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:17.497632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 63/130] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:17.498525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8aef6f-d53f-4857-aa91-51366610d18e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:17.578850 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3e7cf-9394-4db8-81d5-fcdd2062a880 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:17.610955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8aef6f-d53f-4857-aa91-51366610d18e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:17.614366 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65ae1d-bd4e-4ba8-a7de-9d72f5936a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:17.615394 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65ae1d-bd4e-4ba8-a7de-9d72f5936a82 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:17.615774 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65ae1d-bd4e-4ba8-a7de-9d72f5936a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:17.616150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65ae1d-bd4e-4ba8-a7de-9d72f5936a82 None admin] PATH_INFO: `/v3/projects/e0b2bed8236c45c19220276b13e059bc` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:17.617481 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65ae1d-bd4e-4ba8-a7de-9d72f5936a82 None admin] RBAC: Authorizing `identity:get_project(project_id=e0b2bed8236c45c19220276b13e059bc)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:17.619081 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65ae1d-bd4e-4ba8-a7de-9d72f5936a82 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:17.621292 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 68/131] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:17 2022] GET /identity/v3/projects/e0b2bed8236c45c19220276b13e059bc => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:17.622169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65ae1d-bd4e-4ba8-a7de-9d72f5936a82 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:17.647070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483479b0-c95c-4d5f-a059-86ff8981b75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:17.647774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483479b0-c95c-4d5f-a059-86ff8981b75d None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:17.648058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483479b0-c95c-4d5f-a059-86ff8981b75d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:17.648335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483479b0-c95c-4d5f-a059-86ff8981b75d None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:17.649058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483479b0-c95c-4d5f-a059-86ff8981b75d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:17.650529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483479b0-c95c-4d5f-a059-86ff8981b75d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:17.726004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65ae1d-bd4e-4ba8-a7de-9d72f5936a82 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:17.759577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b318947-5472-43df-8538-596e2bdcedb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:17.760447 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b318947-5472-43df-8538-596e2bdcedb6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:17.760727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b318947-5472-43df-8538-596e2bdcedb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:17.761001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b318947-5472-43df-8538-596e2bdcedb6 None admin] PATH_INFO: `/v3/users/e7b8975004164efb8898608b1ebd3f8f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:17.768719 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 64/132] 10.222.0.24 () {60 vars in 1141 bytes} [Tue May 17 21:49:17 2022] POST /identity/v3/projects => generated 302 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:49:17.775572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483479b0-c95c-4d5f-a059-86ff8981b75d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:17.776117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b318947-5472-43df-8538-596e2bdcedb6 None admin] RBAC: Authorizing `identity:get_user(user_id=e7b8975004164efb8898608b1ebd3f8f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:17.778259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b318947-5472-43df-8538-596e2bdcedb6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:17.780111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 69/133] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:17 2022] GET /identity/v3/users/e7b8975004164efb8898608b1ebd3f8f => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:17.785620 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b318947-5472-43df-8538-596e2bdcedb6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:17.933585 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b318947-5472-43df-8538-596e2bdcedb6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:17.970365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe5cbb-1831-402a-8cfe-91df407b2ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:17.972529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe5cbb-1831-402a-8cfe-91df407b2ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:17.972879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe5cbb-1831-402a-8cfe-91df407b2ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:17.973154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe5cbb-1831-402a-8cfe-91df407b2ca1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:18.014699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483479b0-c95c-4d5f-a059-86ff8981b75d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:18.047262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe5cbb-1831-402a-8cfe-91df407b2ca1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:18.048760 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe5cbb-1831-402a-8cfe-91df407b2ca1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:18.083134 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637dec8-2981-4b23-8fe6-acfae6fecd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:18.084528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637dec8-2981-4b23-8fe6-acfae6fecd9d None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:18.085040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637dec8-2981-4b23-8fe6-acfae6fecd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:18.085516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637dec8-2981-4b23-8fe6-acfae6fecd9d None admin] PATH_INFO: `/v3/projects/e0b2bed8236c45c19220276b13e059bc/users/904d6d2dd6e34c9bac78d58a88116330/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:18.087934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637dec8-2981-4b23-8fe6-acfae6fecd9d None admin] RBAC: Authorizing `identity:create_grant(project_id=e0b2bed8236c45c19220276b13e059bc, user_id=904d6d2dd6e34c9bac78d58a88116330, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:18.090625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637dec8-2981-4b23-8fe6-acfae6fecd9d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:18.154633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 70/134] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 21:49:18.160481 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe5cbb-1831-402a-8cfe-91df407b2ca1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:18.175137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 65/135] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:49:17 2022] PUT /identity/v3/projects/e0b2bed8236c45c19220276b13e059bc/users/904d6d2dd6e34c9bac78d58a88116330/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:49:18.269135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe5cbb-1831-402a-8cfe-91df407b2ca1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:18.307490 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ef3e3-3a4b-4957-a6c5-e72d0a83c0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:18.308453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ef3e3-3a4b-4957-a6c5-e72d0a83c0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:18.308726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ef3e3-3a4b-4957-a6c5-e72d0a83c0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:18.308996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ef3e3-3a4b-4957-a6c5-e72d0a83c0f1 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:18.310196 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ef3e3-3a4b-4957-a6c5-e72d0a83c0f1 None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:18.311737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ef3e3-3a4b-4957-a6c5-e72d0a83c0f1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:18.313485 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 71/136] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:18 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:18.319451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637dec8-2981-4b23-8fe6-acfae6fecd9d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:18.459458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecb54c-6c0b-458e-a008-2bb4d396e6bf None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:18.459884 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecb54c-6c0b-458e-a008-2bb4d396e6bf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:18.460276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecb54c-6c0b-458e-a008-2bb4d396e6bf None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:18.461741 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 72/137] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:18.461986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637dec8-2981-4b23-8fe6-acfae6fecd9d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:18.470136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193bf91-7047-419a-9fd9-dd3a0f09b999 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:18.470447 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193bf91-7047-419a-9fd9-dd3a0f09b999 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:18.470700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193bf91-7047-419a-9fd9-dd3a0f09b999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:18.492455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3193bf91-7047-419a-9fd9-dd3a0f09b999 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:18.493694 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3193bf91-7047-419a-9fd9-dd3a0f09b999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:18.502346 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a7464-3210-40a0-9075-b1762cb99d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:18.503032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a7464-3210-40a0-9075-b1762cb99d80 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:18.503333 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a7464-3210-40a0-9075-b1762cb99d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:18.503612 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a7464-3210-40a0-9075-b1762cb99d80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:18.504794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a7464-3210-40a0-9075-b1762cb99d80 None admin] RBAC: Adding query filter params (role.id=2c87c506ab694d0a9cb77ab7383c7898, scope.project.id=2be755a8e5a94fffa1b804fb26b77a19, user.id=e7b8975004164efb8898608b1ebd3f8f) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:18.505112 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a7464-3210-40a0-9075-b1762cb99d80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:18.506565 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a7464-3210-40a0-9075-b1762cb99d80 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:18.513528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 66/138] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:18 2022] GET /identity/v3/role_assignments?user.id=e7b8975004164efb8898608b1ebd3f8f&scope.project.id=2be755a8e5a94fffa1b804fb26b77a19&role.id=2c87c506ab694d0a9cb77ab7383c7898 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:18.567737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 73/139] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:18.592053 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a7464-3210-40a0-9075-b1762cb99d80 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:18.708688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a7464-3210-40a0-9075-b1762cb99d80 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:18.747462 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd11d0-2207-439f-90c5-1b6e21b36f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:18.748636 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd11d0-2207-439f-90c5-1b6e21b36f9f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:18.749119 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd11d0-2207-439f-90c5-1b6e21b36f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:18.749609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd11d0-2207-439f-90c5-1b6e21b36f9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:18.764447 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd11d0-2207-439f-90c5-1b6e21b36f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e8fd11d0-2207-439f-90c5-1b6e21b36f9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:18.772668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:18.773600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:18.774341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:18.774341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:18.774341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:18.774341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:18.774341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:18.774341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:18.774341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:18.774341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:18.774341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:18.774341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:18.774341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:18.774341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:18.777398 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 67/140] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:18.784241 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193bf91-7047-419a-9fd9-dd3a0f09b999 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:18.912970 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193bf91-7047-419a-9fd9-dd3a0f09b999 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:18.948387 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74417c61-1856-4456-b315-b33d93d6acdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:18.949289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74417c61-1856-4456-b315-b33d93d6acdd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:18.949570 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74417c61-1856-4456-b315-b33d93d6acdd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:18.949843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74417c61-1856-4456-b315-b33d93d6acdd None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:18.950593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74417c61-1856-4456-b315-b33d93d6acdd None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:18.950898 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74417c61-1856-4456-b315-b33d93d6acdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:18.952305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74417c61-1856-4456-b315-b33d93d6acdd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:18.961202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 74/141] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:18.967404 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd11d0-2207-439f-90c5-1b6e21b36f9f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:19.094559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd11d0-2207-439f-90c5-1b6e21b36f9f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:19.212396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1bc02-5ac2-4710-a931-f266287134da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:19.212396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1bc02-5ac2-4710-a931-f266287134da None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:19.212396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1bc02-5ac2-4710-a931-f266287134da None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:19.212396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1bc02-5ac2-4710-a931-f266287134da None admin] PATH_INFO: `/v3/users/904d6d2dd6e34c9bac78d58a88116330` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:19.212741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1bc02-5ac2-4710-a931-f266287134da None admin] RBAC: Authorizing `identity:get_user(user_id=904d6d2dd6e34c9bac78d58a88116330)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:19.212741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1bc02-5ac2-4710-a931-f266287134da None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:19.212741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 68/142] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:18 2022] GET /identity/v3/users/904d6d2dd6e34c9bac78d58a88116330 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:19.212929 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74417c61-1856-4456-b315-b33d93d6acdd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:19.272850 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74417c61-1856-4456-b315-b33d93d6acdd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:19.310829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26c20a-7ea9-41fc-8d81-54f02924f02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:19.311589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26c20a-7ea9-41fc-8d81-54f02924f02f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:19.311875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26c20a-7ea9-41fc-8d81-54f02924f02f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:19.312174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26c20a-7ea9-41fc-8d81-54f02924f02f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:19.393076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26c20a-7ea9-41fc-8d81-54f02924f02f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:19.394492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26c20a-7ea9-41fc-8d81-54f02924f02f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:19.499244 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 75/143] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:19.504201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1bc02-5ac2-4710-a931-f266287134da None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:19.646826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1bc02-5ac2-4710-a931-f266287134da None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:19.689116 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b76a5-1e6c-46b5-a89b-5d8f74da7e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:19.689983 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b76a5-1e6c-46b5-a89b-5d8f74da7e17 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:19.690270 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b76a5-1e6c-46b5-a89b-5d8f74da7e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:19.690571 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b76a5-1e6c-46b5-a89b-5d8f74da7e17 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:19.695830 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b76a5-1e6c-46b5-a89b-5d8f74da7e17 None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:19.697292 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b76a5-1e6c-46b5-a89b-5d8f74da7e17 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:19.699132 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 69/144] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:19 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:19.704823 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26c20a-7ea9-41fc-8d81-54f02924f02f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:19.816655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26c20a-7ea9-41fc-8d81-54f02924f02f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:19.854527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957149cc-2eca-42b6-b086-7836f321b1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:19.855727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957149cc-2eca-42b6-b086-7836f321b1be None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:19.856004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957149cc-2eca-42b6-b086-7836f321b1be None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:19.856274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957149cc-2eca-42b6-b086-7836f321b1be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:19.857100 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957149cc-2eca-42b6-b086-7836f321b1be None admin] RBAC: Adding query filter params (role.id=5c8cdbb338e0490b90a50b0b915f9000, scope.project.id=2be755a8e5a94fffa1b804fb26b77a19, user.id=904d6d2dd6e34c9bac78d58a88116330) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:19.857404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957149cc-2eca-42b6-b086-7836f321b1be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:19.858841 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957149cc-2eca-42b6-b086-7836f321b1be None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:19.865046 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 76/145] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:19 2022] GET /identity/v3/role_assignments?user.id=904d6d2dd6e34c9bac78d58a88116330&scope.project.id=2be755a8e5a94fffa1b804fb26b77a19&role.id=5c8cdbb338e0490b90a50b0b915f9000 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:20.250295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f4d0e-4e17-4a62-8a6f-c26792140e33 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:20.250672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f4d0e-4e17-4a62-8a6f-c26792140e33 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:20.250865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f4d0e-4e17-4a62-8a6f-c26792140e33 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:20.252597 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 70/146] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:20.257887 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65048284-a66f-49b4-b118-4df3b0e74172 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:20.258183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65048284-a66f-49b4-b118-4df3b0e74172 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:20.258517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65048284-a66f-49b4-b118-4df3b0e74172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:20.280258 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-65048284-a66f-49b4-b118-4df3b0e74172 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:20.281431 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-65048284-a66f-49b4-b118-4df3b0e74172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:20.360743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 77/147] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:20.398392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f4d0e-4e17-4a62-8a6f-c26792140e33 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:20.515247 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f4d0e-4e17-4a62-8a6f-c26792140e33 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:20.556580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4148d09-9f8d-45ac-bbc2-bdfae5832d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:20.557387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4148d09-9f8d-45ac-bbc2-bdfae5832d8d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:20.557669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4148d09-9f8d-45ac-bbc2-bdfae5832d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:20.558001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4148d09-9f8d-45ac-bbc2-bdfae5832d8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:20.570058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4148d09-9f8d-45ac-bbc2-bdfae5832d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f4148d09-9f8d-45ac-bbc2-bdfae5832d8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:20.578378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:20.579305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:20.580086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:20.580086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:20.580086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:20.580086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:20.580086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:20.580086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:20.580086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:20.580086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:20.580086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:20.580086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:20.580086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:20.580086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:20.580086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 71/148] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:49:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:20.586961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65048284-a66f-49b4-b118-4df3b0e74172 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:20.650388 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb15f0-a2c4-4348-bfaa-e273d860448f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:20.650711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb15f0-a2c4-4348-bfaa-e273d860448f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:20.650940 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb15f0-a2c4-4348-bfaa-e273d860448f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:20.652448 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 72/149] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:49:20.658006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c177330-4da5-41a7-b4b8-428cd1200e14 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:20.658294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c177330-4da5-41a7-b4b8-428cd1200e14 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:20.658579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c177330-4da5-41a7-b4b8-428cd1200e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:20.680271 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7c177330-4da5-41a7-b4b8-428cd1200e14 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:20.681450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7c177330-4da5-41a7-b4b8-428cd1200e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:20.732320 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65048284-a66f-49b4-b118-4df3b0e74172 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:20.777705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2a081-afd4-4079-9ba2-4295321041cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:20.778295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2a081-afd4-4079-9ba2-4295321041cd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:20.778569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2a081-afd4-4079-9ba2-4295321041cd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:20.778839 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2a081-afd4-4079-9ba2-4295321041cd None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:20.779628 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2a081-afd4-4079-9ba2-4295321041cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:20.779928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2a081-afd4-4079-9ba2-4295321041cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:20.781299 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2a081-afd4-4079-9ba2-4295321041cd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:20.798520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 78/150] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:20.804455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2a081-afd4-4079-9ba2-4295321041cd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:20.820011 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 73/151] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:20.856780 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c177330-4da5-41a7-b4b8-428cd1200e14 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:20.916119 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2a081-afd4-4079-9ba2-4295321041cd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:20.964668 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21deb302-8a3f-4ff4-9007-b21382dcd351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:20.965557 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21deb302-8a3f-4ff4-9007-b21382dcd351 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:20.965838 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21deb302-8a3f-4ff4-9007-b21382dcd351 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:20.966112 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21deb302-8a3f-4ff4-9007-b21382dcd351 None admin] PATH_INFO: `/v3/users/aced3dd744eb487b932a627079853c51` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:20.972609 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21deb302-8a3f-4ff4-9007-b21382dcd351 None admin] RBAC: Authorizing `identity:get_user(user_id=aced3dd744eb487b932a627079853c51)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:20.974093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21deb302-8a3f-4ff4-9007-b21382dcd351 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:20.975954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 79/152] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:20 2022] GET /identity/v3/users/aced3dd744eb487b932a627079853c51 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:20.981932 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21deb302-8a3f-4ff4-9007-b21382dcd351 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:21.062887 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c177330-4da5-41a7-b4b8-428cd1200e14 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:21.095680 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fc1cf-3568-4711-848e-c83a23376efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:21.096501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fc1cf-3568-4711-848e-c83a23376efe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:21.096793 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fc1cf-3568-4711-848e-c83a23376efe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:21.097077 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fc1cf-3568-4711-848e-c83a23376efe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:21.107722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fc1cf-3568-4711-848e-c83a23376efe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-7b2fc1cf-3568-4711-848e-c83a23376efe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:21.115957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:21.116803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:21.117577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:21.117577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:21.117577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:21.117577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:21.117577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:21.117577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:21.117577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:21.117577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:21.117577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:21.117577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:21.117577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:21.117577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:21.117577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 74/153] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:49:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:21.127658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fc1cf-3568-4711-848e-c83a23376efe None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:21.146515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21deb302-8a3f-4ff4-9007-b21382dcd351 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:21.185585 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55a39e-a4e3-417f-91ce-98da0ae12b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:21.186643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55a39e-a4e3-417f-91ce-98da0ae12b91 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:21.187164 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55a39e-a4e3-417f-91ce-98da0ae12b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:21.187670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55a39e-a4e3-417f-91ce-98da0ae12b91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:21.326716 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fc1cf-3568-4711-848e-c83a23376efe None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:21.338352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55a39e-a4e3-417f-91ce-98da0ae12b91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:21.340545 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55a39e-a4e3-417f-91ce-98da0ae12b91 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:21.366509 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b579f-8ccd-41eb-a564-fa8221b28585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:21.370067 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b579f-8ccd-41eb-a564-fa8221b28585 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:21.370699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b579f-8ccd-41eb-a564-fa8221b28585 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:21.372046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b579f-8ccd-41eb-a564-fa8221b28585 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:21.373176 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b579f-8ccd-41eb-a564-fa8221b28585 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:21.374836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b579f-8ccd-41eb-a564-fa8221b28585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:21.377214 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b579f-8ccd-41eb-a564-fa8221b28585 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:21.394577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 75/154] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:49:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:21.402431 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b579f-8ccd-41eb-a564-fa8221b28585 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:21.493720 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 80/155] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 21:49:21.495101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b2e65-58f7-4099-8a87-84563fa15645 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:21.495517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b2e65-58f7-4099-8a87-84563fa15645 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:21.495813 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b2e65-58f7-4099-8a87-84563fa15645 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:21.497325 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 81/156] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:21.504455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b2e65-58f7-4099-8a87-84563fa15645 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:21.523353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b579f-8ccd-41eb-a564-fa8221b28585 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:21.558719 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb7b04-bb09-499c-9a54-1c2c6fd5c2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:21.559640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb7b04-bb09-499c-9a54-1c2c6fd5c2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:21.559931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb7b04-bb09-499c-9a54-1c2c6fd5c2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:21.560215 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb7b04-bb09-499c-9a54-1c2c6fd5c2f8 None admin] PATH_INFO: `/v3/users/904d6d2dd6e34c9bac78d58a88116330` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:21.561437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb7b04-bb09-499c-9a54-1c2c6fd5c2f8 None admin] RBAC: Authorizing `identity:get_user(user_id=904d6d2dd6e34c9bac78d58a88116330)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:21.562895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb7b04-bb09-499c-9a54-1c2c6fd5c2f8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:21.564550 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 76/157] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:21 2022] GET /identity/v3/users/904d6d2dd6e34c9bac78d58a88116330 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:21.565861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627c07d-2b4a-4c83-ade2-7ebfa9fce3c7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:21.566164 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627c07d-2b4a-4c83-ade2-7ebfa9fce3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:21.566445 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627c07d-2b4a-4c83-ade2-7ebfa9fce3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:21.583543 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7627c07d-2b4a-4c83-ade2-7ebfa9fce3c7 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:21.584656 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7627c07d-2b4a-4c83-ade2-7ebfa9fce3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:21.609465 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b2e65-58f7-4099-8a87-84563fa15645 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:21.648854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b9257-5b75-42d0-a436-19fc3c07c0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:21.649928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b9257-5b75-42d0-a436-19fc3c07c0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:21.650201 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b9257-5b75-42d0-a436-19fc3c07c0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:21.650467 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b9257-5b75-42d0-a436-19fc3c07c0e1 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:21.652330 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b9257-5b75-42d0-a436-19fc3c07c0e1 None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:21.653985 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b9257-5b75-42d0-a436-19fc3c07c0e1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:21.655888 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 82/158] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:21 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:21.656644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b9257-5b75-42d0-a436-19fc3c07c0e1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:21.658643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 77/159] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:21.666939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627c07d-2b4a-4c83-ade2-7ebfa9fce3c7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:21.769260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b9257-5b75-42d0-a436-19fc3c07c0e1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:21.775509 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627c07d-2b4a-4c83-ade2-7ebfa9fce3c7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:21.802796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a84a7c-cfd3-41cd-9a98-41cb59cf3a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:21.803478 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a84a7c-cfd3-41cd-9a98-41cb59cf3a7e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:21.803766 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a84a7c-cfd3-41cd-9a98-41cb59cf3a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:21.804045 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a84a7c-cfd3-41cd-9a98-41cb59cf3a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:21.810378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da08ad3-90b4-43e4-aad2-fd111e9c016d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:21.814293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da08ad3-90b4-43e4-aad2-fd111e9c016d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:21.814293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da08ad3-90b4-43e4-aad2-fd111e9c016d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:21.814293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da08ad3-90b4-43e4-aad2-fd111e9c016d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:21.814293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da08ad3-90b4-43e4-aad2-fd111e9c016d None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=2be755a8e5a94fffa1b804fb26b77a19, user.id=aced3dd744eb487b932a627079853c51) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:21.814293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da08ad3-90b4-43e4-aad2-fd111e9c016d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:21.814293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da08ad3-90b4-43e4-aad2-fd111e9c016d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:21.820053 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 78/160] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:21 2022] GET /identity/v3/role_assignments?user.id=aced3dd744eb487b932a627079853c51&scope.project.id=2be755a8e5a94fffa1b804fb26b77a19&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:21.820845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da08ad3-90b4-43e4-aad2-fd111e9c016d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:21.883174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a84a7c-cfd3-41cd-9a98-41cb59cf3a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:21.884499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a84a7c-cfd3-41cd-9a98-41cb59cf3a7e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:21.933971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da08ad3-90b4-43e4-aad2-fd111e9c016d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:21.973031 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcfbd6-3711-48fd-a5ed-a567e994c8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:21.973847 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcfbd6-3711-48fd-a5ed-a567e994c8fe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:21.974136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcfbd6-3711-48fd-a5ed-a567e994c8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:21.974417 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcfbd6-3711-48fd-a5ed-a567e994c8fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:21.985607 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dcfbd6-3711-48fd-a5ed-a567e994c8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:21.992147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 83/161] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:21.993465 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bf84d-5dfb-439e-a16a-9a601168c4f1 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:21.993752 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bf84d-5dfb-439e-a16a-9a601168c4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e2dcfbd6-3711-48fd-a5ed-a567e994c8fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:21.993848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:21.994633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:21.995866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:21.995866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:21.995866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:21.995866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:21.995866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:21.995866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:21.995866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:21.995866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:21.995866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:21.995866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:21.995866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:21.995866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:21.996752 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bf84d-5dfb-439e-a16a-9a601168c4f1 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:21.996820 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 79/162] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:21.996820 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22f2b9-0dea-42e2-b7bb-66905fb5ff6b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:21.996947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22f2b9-0dea-42e2-b7bb-66905fb5ff6b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:21.997280 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22f2b9-0dea-42e2-b7bb-66905fb5ff6b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:21.998625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 80/163] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:21.999977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 84/164] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:22.003849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bf84d-5dfb-439e-a16a-9a601168c4f1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:22.003988 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22f2b9-0dea-42e2-b7bb-66905fb5ff6b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:22.107771 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bf84d-5dfb-439e-a16a-9a601168c4f1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:22.113926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22f2b9-0dea-42e2-b7bb-66905fb5ff6b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:22.140025 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a4c1a-8bda-4c80-b9b1-a4fad415c505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:22.140622 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a4c1a-8bda-4c80-b9b1-a4fad415c505 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:22.140893 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a4c1a-8bda-4c80-b9b1-a4fad415c505 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:22.141165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a4c1a-8bda-4c80-b9b1-a4fad415c505 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:22.141899 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a4c1a-8bda-4c80-b9b1-a4fad415c505 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:22.142202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a4c1a-8bda-4c80-b9b1-a4fad415c505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:22.143600 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a4c1a-8bda-4c80-b9b1-a4fad415c505 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:22.146235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5306448-9964-4374-8213-40d50424e9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:22.147084 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5306448-9964-4374-8213-40d50424e9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:22.147411 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5306448-9964-4374-8213-40d50424e9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:22.147673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5306448-9964-4374-8213-40d50424e9b3 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:22.148825 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5306448-9964-4374-8213-40d50424e9b3 None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:22.150233 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5306448-9964-4374-8213-40d50424e9b3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:22.151771 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 85/165] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:22.152205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 81/166] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:22 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:22.153042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1521f-a971-4048-9abb-3c7e7b070ffe None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:22.153205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde6013-37ff-46b4-94b6-1bab2c46b3fb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:22.153372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1521f-a971-4048-9abb-3c7e7b070ffe None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:22.153460 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde6013-37ff-46b4-94b6-1bab2c46b3fb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:22.153620 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1521f-a971-4048-9abb-3c7e7b070ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:22.153709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde6013-37ff-46b4-94b6-1bab2c46b3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:22.170735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f4e1521f-a971-4048-9abb-3c7e7b070ffe None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:22.171015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5dde6013-37ff-46b4-94b6-1bab2c46b3fb None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:22.171942 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f4e1521f-a971-4048-9abb-3c7e7b070ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:22.172197 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5dde6013-37ff-46b4-94b6-1bab2c46b3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:22.234778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 86/167] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:22.247331 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 82/168] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:22.247428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1521f-a971-4048-9abb-3c7e7b070ffe None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:22.247507 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde6013-37ff-46b4-94b6-1bab2c46b3fb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:22.332740 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde6013-37ff-46b4-94b6-1bab2c46b3fb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:22.341133 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1521f-a971-4048-9abb-3c7e7b070ffe None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:22.365169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66238587-960b-4705-8f2c-ad3f67a4239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:22.365822 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66238587-960b-4705-8f2c-ad3f67a4239a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:22.366106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66238587-960b-4705-8f2c-ad3f67a4239a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:22.366381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66238587-960b-4705-8f2c-ad3f67a4239a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:22.367241 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66238587-960b-4705-8f2c-ad3f67a4239a None admin] RBAC: Adding query filter params (role.id=e5fee74fe53d429897caab84ecf4e5d9, scope.project.id=2be755a8e5a94fffa1b804fb26b77a19, user.id=904d6d2dd6e34c9bac78d58a88116330) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:22.367555 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66238587-960b-4705-8f2c-ad3f67a4239a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:22.368994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66238587-960b-4705-8f2c-ad3f67a4239a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:22.373103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84357a-d1be-4cdf-8456-0c0452523a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:22.374043 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84357a-d1be-4cdf-8456-0c0452523a41 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:22.374389 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84357a-d1be-4cdf-8456-0c0452523a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:22.374729 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84357a-d1be-4cdf-8456-0c0452523a41 None admin] PATH_INFO: `/v3/users/904d6d2dd6e34c9bac78d58a88116330` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:22.375385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 83/169] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:22 2022] GET /identity/v3/role_assignments?user.id=904d6d2dd6e34c9bac78d58a88116330&scope.project.id=2be755a8e5a94fffa1b804fb26b77a19&role.id=e5fee74fe53d429897caab84ecf4e5d9 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:22.376094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66238587-960b-4705-8f2c-ad3f67a4239a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:22.379878 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84357a-d1be-4cdf-8456-0c0452523a41 None admin] RBAC: Authorizing `identity:get_user(user_id=904d6d2dd6e34c9bac78d58a88116330)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:22.381376 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84357a-d1be-4cdf-8456-0c0452523a41 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:22.383305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 87/170] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:22 2022] GET /identity/v3/users/904d6d2dd6e34c9bac78d58a88116330 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:22.383910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84357a-d1be-4cdf-8456-0c0452523a41 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:22.480506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66238587-960b-4705-8f2c-ad3f67a4239a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:22.488347 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84357a-d1be-4cdf-8456-0c0452523a41 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:22.516759 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ae12b-4bf4-4b92-abe7-f55c28add9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:22.517576 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ae12b-4bf4-4b92-abe7-f55c28add9ec None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:22.517863 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ae12b-4bf4-4b92-abe7-f55c28add9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:22.518140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ae12b-4bf4-4b92-abe7-f55c28add9ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:22.524844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a1f98-ac72-445d-8436-be2e6db2ab56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:22.525640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a1f98-ac72-445d-8436-be2e6db2ab56 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:22.525921 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a1f98-ac72-445d-8436-be2e6db2ab56 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:22.526195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a1f98-ac72-445d-8436-be2e6db2ab56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:22.528076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a1f98-ac72-445d-8436-be2e6db2ab56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:22.529601 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a1f98-ac72-445d-8436-be2e6db2ab56 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:22.531515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 88/171] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:49:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:22.532215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a1f98-ac72-445d-8436-be2e6db2ab56 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:22.533658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ae12b-4bf4-4b92-abe7-f55c28add9ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c15ae12b-4bf4-4b92-abe7-f55c28add9ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:22.541916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:22.543609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:22.544590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:22.544590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:22.544590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:22.544590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:22.544590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:22.544590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:22.544590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:22.544590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:22.544590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:22.544590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:22.544590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:22.544590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:22.549330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 84/172] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:22.550209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ae12b-4bf4-4b92-abe7-f55c28add9ec None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:22.641306 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a1f98-ac72-445d-8436-be2e6db2ab56 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:22.653123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ae12b-4bf4-4b92-abe7-f55c28add9ec None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:22.674647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6572e3a-b008-4bcd-b0d7-e295ddbf6882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:22.675315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6572e3a-b008-4bcd-b0d7-e295ddbf6882 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:22.675851 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6572e3a-b008-4bcd-b0d7-e295ddbf6882 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:22.676121 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6572e3a-b008-4bcd-b0d7-e295ddbf6882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:22.685821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f035b55-b8a6-4fc4-be54-4a655c0c6c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:22.686492 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f035b55-b8a6-4fc4-be54-4a655c0c6c8c None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:22.686778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f035b55-b8a6-4fc4-be54-4a655c0c6c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:22.687054 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f035b55-b8a6-4fc4-be54-4a655c0c6c8c None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:22.687827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f035b55-b8a6-4fc4-be54-4a655c0c6c8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:22.689278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f035b55-b8a6-4fc4-be54-4a655c0c6c8c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:22.745781 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6572e3a-b008-4bcd-b0d7-e295ddbf6882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:22.747185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6572e3a-b008-4bcd-b0d7-e295ddbf6882 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:22.781181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 85/173] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:49:22 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:49:22.782003 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f035b55-b8a6-4fc4-be54-4a655c0c6c8c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:22.857808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 89/174] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:22.863621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6572e3a-b008-4bcd-b0d7-e295ddbf6882 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:22.894926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f035b55-b8a6-4fc4-be54-4a655c0c6c8c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:22.931349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65862a9c-9336-4720-8eec-55dad9312e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:22.932036 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65862a9c-9336-4720-8eec-55dad9312e32 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:22.932322 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65862a9c-9336-4720-8eec-55dad9312e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:22.932599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65862a9c-9336-4720-8eec-55dad9312e32 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:22.934681 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65862a9c-9336-4720-8eec-55dad9312e32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:22.934993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65862a9c-9336-4720-8eec-55dad9312e32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:22.936431 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65862a9c-9336-4720-8eec-55dad9312e32 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:22.945746 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 86/175] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:22.952262 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65862a9c-9336-4720-8eec-55dad9312e32 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:22.978412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6572e3a-b008-4bcd-b0d7-e295ddbf6882 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:23.016944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec66d8b-81d1-4e1c-903e-ed5ea85502cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:23.018496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec66d8b-81d1-4e1c-903e-ed5ea85502cb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:23.018968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec66d8b-81d1-4e1c-903e-ed5ea85502cb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:23.019516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec66d8b-81d1-4e1c-903e-ed5ea85502cb None admin] PATH_INFO: `/v3/projects/e0b2bed8236c45c19220276b13e059bc` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:23.020868 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec66d8b-81d1-4e1c-903e-ed5ea85502cb None admin] RBAC: Authorizing `identity:get_project(project_id=e0b2bed8236c45c19220276b13e059bc)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:23.022322 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec66d8b-81d1-4e1c-903e-ed5ea85502cb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:23.024052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 90/176] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:22 2022] GET /identity/v3/projects/e0b2bed8236c45c19220276b13e059bc => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:23.029917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec66d8b-81d1-4e1c-903e-ed5ea85502cb None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:23.071666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65862a9c-9336-4720-8eec-55dad9312e32 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:23.115946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c9161-a8f2-4bb7-a597-53defec69832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:23.117300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c9161-a8f2-4bb7-a597-53defec69832 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:23.117586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c9161-a8f2-4bb7-a597-53defec69832 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:23.117865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c9161-a8f2-4bb7-a597-53defec69832 None admin] PATH_INFO: `/v3/users/e7b8975004164efb8898608b1ebd3f8f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:23.119832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c9161-a8f2-4bb7-a597-53defec69832 None admin] RBAC: Authorizing `identity:get_user(user_id=e7b8975004164efb8898608b1ebd3f8f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:23.122286 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c9161-a8f2-4bb7-a597-53defec69832 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:23.124618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 87/177] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:22 2022] GET /identity/v3/users/e7b8975004164efb8898608b1ebd3f8f => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:23.130512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c9161-a8f2-4bb7-a597-53defec69832 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:23.144674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec66d8b-81d1-4e1c-903e-ed5ea85502cb None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:23.188514 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa722bd9-52f7-4b83-b4f0-a5e47dffb6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:23.189338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa722bd9-52f7-4b83-b4f0-a5e47dffb6fe None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:23.189621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa722bd9-52f7-4b83-b4f0-a5e47dffb6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:23.190247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa722bd9-52f7-4b83-b4f0-a5e47dffb6fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:23.191397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa722bd9-52f7-4b83-b4f0-a5e47dffb6fe None admin] RBAC: Adding query filter params (role.id=5c8cdbb338e0490b90a50b0b915f9000, scope.project.id=e0b2bed8236c45c19220276b13e059bc, user.id=904d6d2dd6e34c9bac78d58a88116330) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:23.191710 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa722bd9-52f7-4b83-b4f0-a5e47dffb6fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:23.193581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa722bd9-52f7-4b83-b4f0-a5e47dffb6fe None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:23.201363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 91/178] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:23 2022] GET /identity/v3/role_assignments?user.id=904d6d2dd6e34c9bac78d58a88116330&scope.project.id=e0b2bed8236c45c19220276b13e059bc&role.id=5c8cdbb338e0490b90a50b0b915f9000 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:23.254407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c9161-a8f2-4bb7-a597-53defec69832 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:23.293704 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecb86d-4670-4d0b-92a9-02402a118bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:23.294864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecb86d-4670-4d0b-92a9-02402a118bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:23.295318 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecb86d-4670-4d0b-92a9-02402a118bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:23.295732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecb86d-4670-4d0b-92a9-02402a118bf4 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:23.297214 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecb86d-4670-4d0b-92a9-02402a118bf4 None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:23.298832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecb86d-4670-4d0b-92a9-02402a118bf4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:23.301393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 88/179] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:23 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:23.307574 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa722bd9-52f7-4b83-b4f0-a5e47dffb6fe None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:23.418624 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa722bd9-52f7-4b83-b4f0-a5e47dffb6fe None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:23.454822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb111c-409d-402e-9271-6a10dab175b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:23.455745 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb111c-409d-402e-9271-6a10dab175b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:23.456021 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb111c-409d-402e-9271-6a10dab175b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:23.456291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb111c-409d-402e-9271-6a10dab175b3 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19/users/e7b8975004164efb8898608b1ebd3f8f/roles/2c87c506ab694d0a9cb77ab7383c7898` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:23.458984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb111c-409d-402e-9271-6a10dab175b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2be755a8e5a94fffa1b804fb26b77a19, user_id=e7b8975004164efb8898608b1ebd3f8f, role_id=2c87c506ab694d0a9cb77ab7383c7898)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:23.460564 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb111c-409d-402e-9271-6a10dab175b3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:23.559958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 92/180] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:49:23 2022] PUT /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19/users/e7b8975004164efb8898608b1ebd3f8f/roles/2c87c506ab694d0a9cb77ab7383c7898 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:49:25.209468 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee19ff-c96c-4dee-b0c8-bc17364ad3b8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:25.209969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee19ff-c96c-4dee-b0c8-bc17364ad3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:25.209969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee19ff-c96c-4dee-b0c8-bc17364ad3b8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:25.211320 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 89/181] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:25.216980 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d142aea-3a49-4630-948a-8a2d23c5d56e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:25.217815 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d142aea-3a49-4630-948a-8a2d23c5d56e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:25.218316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d142aea-3a49-4630-948a-8a2d23c5d56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:25.236324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6d142aea-3a49-4630-948a-8a2d23c5d56e None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:25.237991 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6d142aea-3a49-4630-948a-8a2d23c5d56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:25.312394 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 93/182] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:25.339855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee19ff-c96c-4dee-b0c8-bc17364ad3b8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:25.443734 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25054d-7631-4ede-aaf9-96c0a0d8a584 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:25.444359 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25054d-7631-4ede-aaf9-96c0a0d8a584 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:25.444826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25054d-7631-4ede-aaf9-96c0a0d8a584 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:25.446412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 94/183] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:49:25.452389 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29b60a-40bf-458d-9ffc-4da479f0e83d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:25.452669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29b60a-40bf-458d-9ffc-4da479f0e83d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:25.453302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29b60a-40bf-458d-9ffc-4da479f0e83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:25.453855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee19ff-c96c-4dee-b0c8-bc17364ad3b8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:25.471058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-be29b60a-40bf-458d-9ffc-4da479f0e83d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:25.472627 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-be29b60a-40bf-458d-9ffc-4da479f0e83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:25.488768 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d914e2f-33bd-4f7a-b826-798964110c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:25.489583 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d914e2f-33bd-4f7a-b826-798964110c91 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:25.489845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d914e2f-33bd-4f7a-b826-798964110c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:25.490121 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d914e2f-33bd-4f7a-b826-798964110c91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:25.501152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d914e2f-33bd-4f7a-b826-798964110c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0d914e2f-33bd-4f7a-b826-798964110c91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:25.508850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:25.509710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:25.510471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:25.510471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:25.510471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:25.510471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:25.510471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:25.510471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:25.510471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:25.510471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:25.510471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:25.510471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:25.510471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:25.510471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:25.510471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 90/184] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:49:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:25.515888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d914e2f-33bd-4f7a-b826-798964110c91 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:25.547448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 95/185] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:25.552900 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d467e27-3bb7-42cc-8c2e-a9ea416fee4a None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:25.555160 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d467e27-3bb7-42cc-8c2e-a9ea416fee4a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:25.555160 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d467e27-3bb7-42cc-8c2e-a9ea416fee4a None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:25.556028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 96/186] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:25.564113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adc205-727d-4580-b0f4-a383e2dc9316 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:25.564374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adc205-727d-4580-b0f4-a383e2dc9316 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:25.564595 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adc205-727d-4580-b0f4-a383e2dc9316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:25.582855 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f2adc205-727d-4580-b0f4-a383e2dc9316 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:25.584068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f2adc205-727d-4580-b0f4-a383e2dc9316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:25.619588 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d914e2f-33bd-4f7a-b826-798964110c91 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:25.659141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 97/187] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:25.659141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adc205-727d-4580-b0f4-a383e2dc9316 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:25.662547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3122162-3bff-40ca-86da-05d34ad672df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:25.663276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3122162-3bff-40ca-86da-05d34ad672df None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:25.663559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3122162-3bff-40ca-86da-05d34ad672df None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:25.663834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3122162-3bff-40ca-86da-05d34ad672df None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:25.664602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3122162-3bff-40ca-86da-05d34ad672df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:25.664909 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3122162-3bff-40ca-86da-05d34ad672df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:25.666368 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3122162-3bff-40ca-86da-05d34ad672df None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:25.676499 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 91/188] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:25.678802 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3122162-3bff-40ca-86da-05d34ad672df None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:25.753433 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adc205-727d-4580-b0f4-a383e2dc9316 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:25.779822 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3122162-3bff-40ca-86da-05d34ad672df None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:25.793186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e681537-514a-483d-b880-11ebb048c3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:25.794865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e681537-514a-483d-b880-11ebb048c3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:25.795393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e681537-514a-483d-b880-11ebb048c3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:25.795999 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e681537-514a-483d-b880-11ebb048c3c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:25.809358 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e681537-514a-483d-b880-11ebb048c3c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:25.814208 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab2532-fc01-4e9c-8f74-e2ecc7549286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:25.815219 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab2532-fc01-4e9c-8f74-e2ecc7549286 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:25.824517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab2532-fc01-4e9c-8f74-e2ecc7549286 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:25.824517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab2532-fc01-4e9c-8f74-e2ecc7549286 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:25.824517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab2532-fc01-4e9c-8f74-e2ecc7549286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-5e681537-514a-483d-b880-11ebb048c3c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:25.824762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:25.825576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:25.826335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:25.826335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:25.826335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:25.826335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:25.826335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:25.826335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:25.826335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:25.826335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:25.826335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:25.826335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:25.826335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:25.826335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:25.826915 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab2532-fc01-4e9c-8f74-e2ecc7549286 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:25.826983 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 98/189] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:49:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:25.826983 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e681537-514a-483d-b880-11ebb048c3c0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:25.827096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 92/190] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:49:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:25.827096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab2532-fc01-4e9c-8f74-e2ecc7549286 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:25.922310 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e681537-514a-483d-b880-11ebb048c3c0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:25.926406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab2532-fc01-4e9c-8f74-e2ecc7549286 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:25.955039 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d8ba3-9f0c-4c17-8bcd-a083df008047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:25.955946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d8ba3-9f0c-4c17-8bcd-a083df008047 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:25.956221 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d8ba3-9f0c-4c17-8bcd-a083df008047 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:25.956495 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d8ba3-9f0c-4c17-8bcd-a083df008047 None admin] PATH_INFO: `/v3/users/0a7c3974c2734a1e83cd7ce14c50346f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:25.959281 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ce9a0-ef06-4707-bf91-05f9d5b685f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:25.959941 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ce9a0-ef06-4707-bf91-05f9d5b685f1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:25.960220 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ce9a0-ef06-4707-bf91-05f9d5b685f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:25.964512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ce9a0-ef06-4707-bf91-05f9d5b685f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:25.964512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ce9a0-ef06-4707-bf91-05f9d5b685f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:25.964512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ce9a0-ef06-4707-bf91-05f9d5b685f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:25.964512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ce9a0-ef06-4707-bf91-05f9d5b685f1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:25.970140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d8ba3-9f0c-4c17-8bcd-a083df008047 None admin] RBAC: Authorizing `identity:get_user(user_id=0a7c3974c2734a1e83cd7ce14c50346f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:25.970904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 93/191] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:49:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:25.971701 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ce9a0-ef06-4707-bf91-05f9d5b685f1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:25.972670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d8ba3-9f0c-4c17-8bcd-a083df008047 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:25.978813 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 99/192] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:25 2022] GET /identity/v3/users/0a7c3974c2734a1e83cd7ce14c50346f => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:25.978813 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537f6ac-f664-44fb-88c1-7e61557ca7da None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:25.978813 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537f6ac-f664-44fb-88c1-7e61557ca7da None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:25.978813 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537f6ac-f664-44fb-88c1-7e61557ca7da None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:25.978813 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 100/193] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:25.978813 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537f6ac-f664-44fb-88c1-7e61557ca7da None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:26.072361 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ce9a0-ef06-4707-bf91-05f9d5b685f1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:26.076249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537f6ac-f664-44fb-88c1-7e61557ca7da None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:26.105402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c5a9d-5de8-455d-9a1f-42937655b48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:26.106297 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c5a9d-5de8-455d-9a1f-42937655b48e None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:26.106585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c5a9d-5de8-455d-9a1f-42937655b48e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:26.106863 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c5a9d-5de8-455d-9a1f-42937655b48e None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:26.107603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c5a9d-5de8-455d-9a1f-42937655b48e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:26.109058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c5a9d-5de8-455d-9a1f-42937655b48e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:26.109268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde9888-00de-4b99-8502-17b05778a039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:26.110134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde9888-00de-4b99-8502-17b05778a039 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:26.110419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde9888-00de-4b99-8502-17b05778a039 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:26.110692 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde9888-00de-4b99-8502-17b05778a039 None admin] PATH_INFO: `/v3/users/0a7c3974c2734a1e83cd7ce14c50346f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:26.111893 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde9888-00de-4b99-8502-17b05778a039 None admin] RBAC: Authorizing `identity:get_user(user_id=0a7c3974c2734a1e83cd7ce14c50346f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:26.116178 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde9888-00de-4b99-8502-17b05778a039 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:26.116178 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 101/194] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:25 2022] GET /identity/v3/users/0a7c3974c2734a1e83cd7ce14c50346f => generated 283 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:26.116178 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde9888-00de-4b99-8502-17b05778a039 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:26.214990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde9888-00de-4b99-8502-17b05778a039 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:26.247131 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe63719-b234-4543-aeb6-8fa22e293f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:26.247770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe63719-b234-4543-aeb6-8fa22e293f2b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:26.248052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe63719-b234-4543-aeb6-8fa22e293f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:26.248326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe63719-b234-4543-aeb6-8fa22e293f2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:26.278959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 94/195] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:49:25 2022] POST /identity/v3/users => generated 297 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:49:26.280257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af498689-4e17-4913-9389-a4c3dc850285 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:26.280549 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af498689-4e17-4913-9389-a4c3dc850285 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:26.280829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af498689-4e17-4913-9389-a4c3dc850285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:26.298863 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-af498689-4e17-4913-9389-a4c3dc850285 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:26.300162 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-af498689-4e17-4913-9389-a4c3dc850285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:26.319262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe63719-b234-4543-aeb6-8fa22e293f2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:26.320996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe63719-b234-4543-aeb6-8fa22e293f2b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:26.372391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 95/196] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:26.373482 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af498689-4e17-4913-9389-a4c3dc850285 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:26.438716 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 102/197] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:26.438716 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe63719-b234-4543-aeb6-8fa22e293f2b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:26.481379 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af498689-4e17-4913-9389-a4c3dc850285 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:26.518013 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b7e2a-707b-46df-a383-e466a8cb3b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:26.518682 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b7e2a-707b-46df-a383-e466a8cb3b2f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:26.518969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b7e2a-707b-46df-a383-e466a8cb3b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:26.519288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b7e2a-707b-46df-a383-e466a8cb3b2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:26.549564 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe63719-b234-4543-aeb6-8fa22e293f2b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:26.587756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89a004-8eaf-40c0-a3dc-5a09046c26e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:26.589128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89a004-8eaf-40c0-a3dc-5a09046c26e8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:26.589128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89a004-8eaf-40c0-a3dc-5a09046c26e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:26.589379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89a004-8eaf-40c0-a3dc-5a09046c26e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:26.606090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89a004-8eaf-40c0-a3dc-5a09046c26e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-4a89a004-8eaf-40c0-a3dc-5a09046c26e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:26.614057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:26.615042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:26.615881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:26.615881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:26.615881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:26.615881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:26.615881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:26.615881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:26.615881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:26.615881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:26.615881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:26.615881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:26.615881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:26.615881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:26.616549 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b7e2a-707b-46df-a383-e466a8cb3b2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:26.616658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 103/198] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:26.616658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89a004-8eaf-40c0-a3dc-5a09046c26e8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:26.616849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b7e2a-707b-46df-a383-e466a8cb3b2f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:26.726811 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89a004-8eaf-40c0-a3dc-5a09046c26e8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:26.736480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 96/199] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:26.737408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b7e2a-707b-46df-a383-e466a8cb3b2f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:26.764101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffd340-0d9a-4385-afd8-8eb73c6320d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:26.765250 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffd340-0d9a-4385-afd8-8eb73c6320d0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:26.765621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffd340-0d9a-4385-afd8-8eb73c6320d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:26.765963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffd340-0d9a-4385-afd8-8eb73c6320d0 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:26.767257 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffd340-0d9a-4385-afd8-8eb73c6320d0 None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:26.768786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffd340-0d9a-4385-afd8-8eb73c6320d0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:26.770717 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 104/200] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:26 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:26.771402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffd340-0d9a-4385-afd8-8eb73c6320d0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:26.858488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b7e2a-707b-46df-a383-e466a8cb3b2f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:26.910465 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a1532-be35-4ac9-8daf-cae1850e290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:26.911419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a1532-be35-4ac9-8daf-cae1850e290a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:26.911762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a1532-be35-4ac9-8daf-cae1850e290a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:26.912088 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a1532-be35-4ac9-8daf-cae1850e290a None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:26.912944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a1532-be35-4ac9-8daf-cae1850e290a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:26.913348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a1532-be35-4ac9-8daf-cae1850e290a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:26.914930 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a1532-be35-4ac9-8daf-cae1850e290a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:26.917896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffd340-0d9a-4385-afd8-8eb73c6320d0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:26.924430 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 97/201] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:26.925501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a1532-be35-4ac9-8daf-cae1850e290a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:26.955800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a7093-3e88-49f6-8dc8-4ce5a6798ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:26.956943 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a7093-3e88-49f6-8dc8-4ce5a6798ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:26.957356 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a7093-3e88-49f6-8dc8-4ce5a6798ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:26.957786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a7093-3e88-49f6-8dc8-4ce5a6798ee5 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:26.959101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a7093-3e88-49f6-8dc8-4ce5a6798ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:26.960710 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a7093-3e88-49f6-8dc8-4ce5a6798ee5 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:26.962663 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 105/202] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:26 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:26.963596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a7093-3e88-49f6-8dc8-4ce5a6798ee5 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:27.031731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a1532-be35-4ac9-8daf-cae1850e290a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:27.066742 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9df8a-7b9d-46a5-bbc7-60eadd3ff5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:27.067761 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9df8a-7b9d-46a5-bbc7-60eadd3ff5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:27.068103 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9df8a-7b9d-46a5-bbc7-60eadd3ff5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:27.068477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9df8a-7b9d-46a5-bbc7-60eadd3ff5e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:27.069412 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9df8a-7b9d-46a5-bbc7-60eadd3ff5e3 None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=9a832f072c654c648482fe86fd6b1ca1, user.id=0a7c3974c2734a1e83cd7ce14c50346f) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:27.069823 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9df8a-7b9d-46a5-bbc7-60eadd3ff5e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:27.071550 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9df8a-7b9d-46a5-bbc7-60eadd3ff5e3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:27.077471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 98/203] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:26 2022] GET /identity/v3/role_assignments?user.id=0a7c3974c2734a1e83cd7ce14c50346f&scope.project.id=9a832f072c654c648482fe86fd6b1ca1&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:27.078347 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9df8a-7b9d-46a5-bbc7-60eadd3ff5e3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:27.088751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a7093-3e88-49f6-8dc8-4ce5a6798ee5 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:27.133405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428701f-c672-4685-9530-9b4e24af6d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:27.134628 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428701f-c672-4685-9530-9b4e24af6d27 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:27.135054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428701f-c672-4685-9530-9b4e24af6d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:27.135490 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428701f-c672-4685-9530-9b4e24af6d27 None admin] PATH_INFO: `/v3/users/e7b8975004164efb8898608b1ebd3f8f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:27.137830 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428701f-c672-4685-9530-9b4e24af6d27 None admin] RBAC: Authorizing `identity:get_user(user_id=e7b8975004164efb8898608b1ebd3f8f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:27.139653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428701f-c672-4685-9530-9b4e24af6d27 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:27.142544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 106/204] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:26 2022] GET /identity/v3/users/e7b8975004164efb8898608b1ebd3f8f => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:27.151069 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428701f-c672-4685-9530-9b4e24af6d27 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:27.191523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9df8a-7b9d-46a5-bbc7-60eadd3ff5e3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:27.228397 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cc4e7-a754-460b-8cf0-afd19496653f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:27.229175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cc4e7-a754-460b-8cf0-afd19496653f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:27.229559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cc4e7-a754-460b-8cf0-afd19496653f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:27.230068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cc4e7-a754-460b-8cf0-afd19496653f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:27.230998 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cc4e7-a754-460b-8cf0-afd19496653f None admin] RBAC: Adding query filter params (role.id=e5fee74fe53d429897caab84ecf4e5d9, scope.project.id=9a832f072c654c648482fe86fd6b1ca1, user.id=0a7c3974c2734a1e83cd7ce14c50346f) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:27.239209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cc4e7-a754-460b-8cf0-afd19496653f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:27.239209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cc4e7-a754-460b-8cf0-afd19496653f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:27.239761 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 99/205] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:27 2022] GET /identity/v3/role_assignments?user.id=0a7c3974c2734a1e83cd7ce14c50346f&scope.project.id=9a832f072c654c648482fe86fd6b1ca1&role.id=e5fee74fe53d429897caab84ecf4e5d9 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:27.312469 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428701f-c672-4685-9530-9b4e24af6d27 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:27.351658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e060abf-ce21-4c76-b3fd-94700ba14842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:27.352638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e060abf-ce21-4c76-b3fd-94700ba14842 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:27.353099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e060abf-ce21-4c76-b3fd-94700ba14842 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:27.353552 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e060abf-ce21-4c76-b3fd-94700ba14842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:27.430991 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e060abf-ce21-4c76-b3fd-94700ba14842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:27.433492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e060abf-ce21-4c76-b3fd-94700ba14842 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:27.536829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 107/206] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:27.543540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cc4e7-a754-460b-8cf0-afd19496653f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:27.681289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cc4e7-a754-460b-8cf0-afd19496653f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:27.717028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6add797-1faf-4285-a0fc-2b93beb1af0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:27.718206 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6add797-1faf-4285-a0fc-2b93beb1af0c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:27.718617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6add797-1faf-4285-a0fc-2b93beb1af0c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:27.719005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6add797-1faf-4285-a0fc-2b93beb1af0c None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:27.720260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6add797-1faf-4285-a0fc-2b93beb1af0c None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:27.722186 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6add797-1faf-4285-a0fc-2b93beb1af0c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:27.723924 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 100/207] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:27 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:27.731975 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e060abf-ce21-4c76-b3fd-94700ba14842 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:27.849315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e060abf-ce21-4c76-b3fd-94700ba14842 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:27.885309 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52e95f-2052-4ee2-9049-53140a010c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:27.888004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52e95f-2052-4ee2-9049-53140a010c1c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:27.888462 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52e95f-2052-4ee2-9049-53140a010c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:27.888877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52e95f-2052-4ee2-9049-53140a010c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:27.889872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52e95f-2052-4ee2-9049-53140a010c1c None admin] RBAC: Adding query filter params (role.id=2c87c506ab694d0a9cb77ab7383c7898, scope.project.id=2be755a8e5a94fffa1b804fb26b77a19, user.id=e7b8975004164efb8898608b1ebd3f8f) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:27.890324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52e95f-2052-4ee2-9049-53140a010c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:27.892039 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52e95f-2052-4ee2-9049-53140a010c1c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:27.898565 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 108/208] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:27 2022] GET /identity/v3/role_assignments?user.id=e7b8975004164efb8898608b1ebd3f8f&scope.project.id=2be755a8e5a94fffa1b804fb26b77a19&role.id=2c87c506ab694d0a9cb77ab7383c7898 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:28.853939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db788759-571e-4c9a-9da1-3b3aec679ce0 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:28.854993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db788759-571e-4c9a-9da1-3b3aec679ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:28.855517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db788759-571e-4c9a-9da1-3b3aec679ce0 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:28.856978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 101/209] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:28.863139 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ef68-43a4-4e50-b01b-607aa00bb425 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:28.863603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ef68-43a4-4e50-b01b-607aa00bb425 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:28.863846 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ef68-43a4-4e50-b01b-607aa00bb425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:28.881408 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3d85ef68-43a4-4e50-b01b-607aa00bb425 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:28.882633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3d85ef68-43a4-4e50-b01b-607aa00bb425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:28.954678 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 109/210] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:28.977171 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db788759-571e-4c9a-9da1-3b3aec679ce0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:29.041210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b50764-2681-450f-8b3b-5f885258e52e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:29.041850 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b50764-2681-450f-8b3b-5f885258e52e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:29.042960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b50764-2681-450f-8b3b-5f885258e52e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:29.044561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 110/211] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:29.049735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5515ff-fa22-47c0-9801-d3b561a23fb8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:29.050253 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5515ff-fa22-47c0-9801-d3b561a23fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:29.050984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5515ff-fa22-47c0-9801-d3b561a23fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:29.070055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ad5515ff-fa22-47c0-9801-d3b561a23fb8 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:29.071619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ad5515ff-fa22-47c0-9801-d3b561a23fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:29.099831 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db788759-571e-4c9a-9da1-3b3aec679ce0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:29.135852 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7781e-c975-47fc-91de-32995596e23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:29.136991 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7781e-c975-47fc-91de-32995596e23b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:29.137510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7781e-c975-47fc-91de-32995596e23b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:29.137981 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7781e-c975-47fc-91de-32995596e23b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:29.149803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7781e-c975-47fc-91de-32995596e23b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:29.152731 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 111/212] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-56e7781e-c975-47fc-91de-32995596e23b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:29.159000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:29.160025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:29.160804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:29.160804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:29.160804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:29.160804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:29.160804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:29.160804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:29.160804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:29.160804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:29.160804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:29.160804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:29.160804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:29.160804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:29.163195 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 102/213] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:29.171153 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5515ff-fa22-47c0-9801-d3b561a23fb8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:29.181432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7781e-c975-47fc-91de-32995596e23b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:29.287498 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5515ff-fa22-47c0-9801-d3b561a23fb8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:29.291771 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7781e-c975-47fc-91de-32995596e23b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:29.325215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44525-ebb1-4fa3-9ee2-659aec29249c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:29.326283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44525-ebb1-4fa3-9ee2-659aec29249c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:29.326806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44525-ebb1-4fa3-9ee2-659aec29249c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:29.327326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab44525-ebb1-4fa3-9ee2-659aec29249c None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:29.328279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab44525-ebb1-4fa3-9ee2-659aec29249c None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:29.328783 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab44525-ebb1-4fa3-9ee2-659aec29249c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:29.330455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab44525-ebb1-4fa3-9ee2-659aec29249c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:29.332676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e3dac-2c0c-4f99-a794-6f4a284a0abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:29.333832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e3dac-2c0c-4f99-a794-6f4a284a0abc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:29.334117 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e3dac-2c0c-4f99-a794-6f4a284a0abc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:29.334394 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e3dac-2c0c-4f99-a794-6f4a284a0abc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:29.335642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e3dac-2c0c-4f99-a794-6f4a284a0abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:29.337586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e3dac-2c0c-4f99-a794-6f4a284a0abc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:29.340244 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 103/214] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:49:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:29.341836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 112/215] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:29.347180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e3dac-2c0c-4f99-a794-6f4a284a0abc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:29.348881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44525-ebb1-4fa3-9ee2-659aec29249c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:29.452106 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab44525-ebb1-4fa3-9ee2-659aec29249c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:29.473106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e3dac-2c0c-4f99-a794-6f4a284a0abc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:29.488659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63cb94-df88-45ff-97f1-8cb97c43ab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:29.489849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63cb94-df88-45ff-97f1-8cb97c43ab29 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:29.490331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63cb94-df88-45ff-97f1-8cb97c43ab29 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:29.490805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63cb94-df88-45ff-97f1-8cb97c43ab29 None admin] PATH_INFO: `/v3/users/43959a9c002b4c71b78ecd947f031619` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:29.505485 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63cb94-df88-45ff-97f1-8cb97c43ab29 None admin] RBAC: Authorizing `identity:get_user(user_id=43959a9c002b4c71b78ecd947f031619)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:29.507996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63cb94-df88-45ff-97f1-8cb97c43ab29 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:29.510254 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 113/216] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:29 2022] GET /identity/v3/users/43959a9c002b4c71b78ecd947f031619 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:29.522975 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63cb94-df88-45ff-97f1-8cb97c43ab29 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:29.523146 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4c9dc-c050-492a-b820-d58fb8b475c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:29.523146 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4c9dc-c050-492a-b820-d58fb8b475c0 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:29.523146 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4c9dc-c050-492a-b820-d58fb8b475c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:29.523146 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4c9dc-c050-492a-b820-d58fb8b475c0 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:29.523441 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4c9dc-c050-492a-b820-d58fb8b475c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:29.523441 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4c9dc-c050-492a-b820-d58fb8b475c0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:29.622605 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63cb94-df88-45ff-97f1-8cb97c43ab29 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:29.643150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 104/217] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:49:29 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:49:29.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbad96e-adc5-4fc7-97be-146520c42028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:29.667594 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbad96e-adc5-4fc7-97be-146520c42028 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:29.668443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbad96e-adc5-4fc7-97be-146520c42028 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:29.668973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbad96e-adc5-4fc7-97be-146520c42028 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:29.744975 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbad96e-adc5-4fc7-97be-146520c42028 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:29.747624 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbad96e-adc5-4fc7-97be-146520c42028 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:29.776817 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49fbf8-04da-42cc-8cdb-e7a089b5a302 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:29.777152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49fbf8-04da-42cc-8cdb-e7a089b5a302 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:29.777395 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49fbf8-04da-42cc-8cdb-e7a089b5a302 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:29.778777 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 105/218] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:29.784619 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376f96e-fd4c-4ce0-ba86-ecf912867cd6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:29.784907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376f96e-fd4c-4ce0-ba86-ecf912867cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:29.785186 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376f96e-fd4c-4ce0-ba86-ecf912867cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:29.808559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9376f96e-fd4c-4ce0-ba86-ecf912867cd6 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:29.810654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9376f96e-fd4c-4ce0-ba86-ecf912867cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:29.868675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 114/219] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:29.871395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7cb9f-bdf5-43c5-b78b-475c1826af84 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:29.871911 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7cb9f-bdf5-43c5-b78b-475c1826af84 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:29.872191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7cb9f-bdf5-43c5-b78b-475c1826af84 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:29.873662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 115/220] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:29.876008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7cb9f-bdf5-43c5-b78b-475c1826af84 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:29.889850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 106/221] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:29.891536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c5450-9448-4513-8165-319ea91c1a10 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:29.891536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c5450-9448-4513-8165-319ea91c1a10 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:29.891718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c5450-9448-4513-8165-319ea91c1a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:29.916314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c19c5450-9448-4513-8165-319ea91c1a10 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:29.917636 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c19c5450-9448-4513-8165-319ea91c1a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:30.002173 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 107/222] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:30.003299 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c5450-9448-4513-8165-319ea91c1a10 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:30.014373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7cb9f-bdf5-43c5-b78b-475c1826af84 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:30.059132 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6eb50-fa56-4d7b-99f7-004f8e98dd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:30.060023 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6eb50-fa56-4d7b-99f7-004f8e98dd71 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:30.060306 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6eb50-fa56-4d7b-99f7-004f8e98dd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:30.060580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6eb50-fa56-4d7b-99f7-004f8e98dd71 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:30.061785 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6eb50-fa56-4d7b-99f7-004f8e98dd71 None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:30.063693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6eb50-fa56-4d7b-99f7-004f8e98dd71 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:30.065192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 116/223] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:29 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:30.066000 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6eb50-fa56-4d7b-99f7-004f8e98dd71 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:30.127605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c5450-9448-4513-8165-319ea91c1a10 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:30.178569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec524d06-9963-4e08-8bec-b899718ac539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:30.179771 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec524d06-9963-4e08-8bec-b899718ac539 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:30.180254 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec524d06-9963-4e08-8bec-b899718ac539 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:30.180747 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec524d06-9963-4e08-8bec-b899718ac539 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:30.187228 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6eb50-fa56-4d7b-99f7-004f8e98dd71 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:30.192063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec524d06-9963-4e08-8bec-b899718ac539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ec524d06-9963-4e08-8bec-b899718ac539 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:30.200202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:30.201108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:30.201874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:30.201874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:30.201874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:30.201874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:30.201874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:30.201874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:30.201874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:30.201874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:30.201874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:30.201874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:30.201874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:30.201874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:30.204308 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 108/224] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:49:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:30.206375 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec524d06-9963-4e08-8bec-b899718ac539 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:30.221698 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12afe47-737b-4f04-8a4c-1262cc01ab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:30.222506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12afe47-737b-4f04-8a4c-1262cc01ab0c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:30.222782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12afe47-737b-4f04-8a4c-1262cc01ab0c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:30.223057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12afe47-737b-4f04-8a4c-1262cc01ab0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:30.234713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12afe47-737b-4f04-8a4c-1262cc01ab0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-a12afe47-737b-4f04-8a4c-1262cc01ab0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:30.242976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:30.244010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:30.244854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:30.244854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:30.244854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:30.244854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:30.244854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:30.244854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:30.244854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:30.244854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:30.244854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:30.244854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:30.244854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:30.244854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:30.244854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 117/225] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:49:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:30.245675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12afe47-737b-4f04-8a4c-1262cc01ab0c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:30.318590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec524d06-9963-4e08-8bec-b899718ac539 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:30.346220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12afe47-737b-4f04-8a4c-1262cc01ab0c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:30.356181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0799-c4f1-4a5c-b826-ded83ff25975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:30.357215 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0799-c4f1-4a5c-b826-ded83ff25975 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:30.357503 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0799-c4f1-4a5c-b826-ded83ff25975 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:30.358091 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0799-c4f1-4a5c-b826-ded83ff25975 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:30.359342 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e0799-c4f1-4a5c-b826-ded83ff25975 None admin] RBAC: Adding query filter params (role.id=5c8cdbb338e0490b90a50b0b915f9000, scope.project.id=9a832f072c654c648482fe86fd6b1ca1, user.id=43959a9c002b4c71b78ecd947f031619) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:30.359687 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e0799-c4f1-4a5c-b826-ded83ff25975 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:30.361667 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e0799-c4f1-4a5c-b826-ded83ff25975 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:30.368794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 109/226] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:30 2022] GET /identity/v3/role_assignments?user.id=43959a9c002b4c71b78ecd947f031619&scope.project.id=9a832f072c654c648482fe86fd6b1ca1&role.id=5c8cdbb338e0490b90a50b0b915f9000 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:30.372037 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0799-c4f1-4a5c-b826-ded83ff25975 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:30.408809 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3c550-8517-4dfb-9c8a-fda532b4fe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:30.409570 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3c550-8517-4dfb-9c8a-fda532b4fe24 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:30.409860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3c550-8517-4dfb-9c8a-fda532b4fe24 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:30.410139 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3c550-8517-4dfb-9c8a-fda532b4fe24 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:30.410970 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3c550-8517-4dfb-9c8a-fda532b4fe24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:30.411308 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3c550-8517-4dfb-9c8a-fda532b4fe24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:30.412778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3c550-8517-4dfb-9c8a-fda532b4fe24 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:30.441256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 118/227] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:30.450111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3c550-8517-4dfb-9c8a-fda532b4fe24 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:30.522955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0799-c4f1-4a5c-b826-ded83ff25975 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:30.562072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08537f-e72e-47ed-b41b-cd5be9021d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:30.562817 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08537f-e72e-47ed-b41b-cd5be9021d00 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:30.563172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08537f-e72e-47ed-b41b-cd5be9021d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:30.563454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08537f-e72e-47ed-b41b-cd5be9021d00 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:30.564235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08537f-e72e-47ed-b41b-cd5be9021d00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:30.564545 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08537f-e72e-47ed-b41b-cd5be9021d00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:30.565968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08537f-e72e-47ed-b41b-cd5be9021d00 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:30.576340 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 110/228] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:49:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:30.584194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08537f-e72e-47ed-b41b-cd5be9021d00 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:30.665743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3c550-8517-4dfb-9c8a-fda532b4fe24 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:30.732468 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51930a2d-cfd2-4a02-97e6-8a0fc76458de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:30.733342 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51930a2d-cfd2-4a02-97e6-8a0fc76458de None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:30.733619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51930a2d-cfd2-4a02-97e6-8a0fc76458de None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:30.733892 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51930a2d-cfd2-4a02-97e6-8a0fc76458de None admin] PATH_INFO: `/v3/users/0a7c3974c2734a1e83cd7ce14c50346f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:30.735259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51930a2d-cfd2-4a02-97e6-8a0fc76458de None admin] RBAC: Authorizing `identity:get_user(user_id=0a7c3974c2734a1e83cd7ce14c50346f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:30.736726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51930a2d-cfd2-4a02-97e6-8a0fc76458de None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:30.738338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 119/229] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:30 2022] GET /identity/v3/users/0a7c3974c2734a1e83cd7ce14c50346f => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:30.749159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51930a2d-cfd2-4a02-97e6-8a0fc76458de None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:30.753117 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08537f-e72e-47ed-b41b-cd5be9021d00 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:30.807800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852f004-2116-4ec1-a879-1cf0e919bd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:30.809215 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852f004-2116-4ec1-a879-1cf0e919bd72 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:30.809641 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852f004-2116-4ec1-a879-1cf0e919bd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:30.811123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852f004-2116-4ec1-a879-1cf0e919bd72 None admin] PATH_INFO: `/v3/users/0a7c3974c2734a1e83cd7ce14c50346f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:30.819385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852f004-2116-4ec1-a879-1cf0e919bd72 None admin] RBAC: Authorizing `identity:get_user(user_id=0a7c3974c2734a1e83cd7ce14c50346f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:30.819385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852f004-2116-4ec1-a879-1cf0e919bd72 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:30.827247 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 111/230] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:30 2022] GET /identity/v3/users/0a7c3974c2734a1e83cd7ce14c50346f => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:30.828328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852f004-2116-4ec1-a879-1cf0e919bd72 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:30.957069 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51930a2d-cfd2-4a02-97e6-8a0fc76458de None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:31.017415 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7972d-0029-41e8-a7b5-e3734153bec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:31.019281 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7972d-0029-41e8-a7b5-e3734153bec4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:31.019820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7972d-0029-41e8-a7b5-e3734153bec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:31.020306 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7972d-0029-41e8-a7b5-e3734153bec4 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:31.021207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852f004-2116-4ec1-a879-1cf0e919bd72 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:31.023137 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7972d-0029-41e8-a7b5-e3734153bec4 None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:31.025000 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7972d-0029-41e8-a7b5-e3734153bec4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:31.027287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 120/231] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:30 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:31.040142 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7972d-0029-41e8-a7b5-e3734153bec4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:31.076147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097d9a1-dc5a-4ac2-8551-c6d51e48b1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:31.077025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097d9a1-dc5a-4ac2-8551-c6d51e48b1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:31.077402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097d9a1-dc5a-4ac2-8551-c6d51e48b1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:31.077652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097d9a1-dc5a-4ac2-8551-c6d51e48b1f5 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:31.080733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097d9a1-dc5a-4ac2-8551-c6d51e48b1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:31.083334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097d9a1-dc5a-4ac2-8551-c6d51e48b1f5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:31.086702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 112/232] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:30 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:31.094452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097d9a1-dc5a-4ac2-8551-c6d51e48b1f5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:31.231596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7972d-0029-41e8-a7b5-e3734153bec4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:31.247797 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097d9a1-dc5a-4ac2-8551-c6d51e48b1f5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:31.298128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb707d-a30f-4fe5-97ab-b34ed58518bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:31.299025 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb707d-a30f-4fe5-97ab-b34ed58518bd None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:31.299335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb707d-a30f-4fe5-97ab-b34ed58518bd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:31.300289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb707d-a30f-4fe5-97ab-b34ed58518bd None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1/users/0a7c3974c2734a1e83cd7ce14c50346f/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:31.304420 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb707d-a30f-4fe5-97ab-b34ed58518bd None admin] RBAC: Authorizing `identity:create_grant(project_id=9a832f072c654c648482fe86fd6b1ca1, user_id=0a7c3974c2734a1e83cd7ce14c50346f, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:31.305875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb707d-a30f-4fe5-97ab-b34ed58518bd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:31.312644 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383b444-1daf-4d93-b103-e8a7fdd2c61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:31.313544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383b444-1daf-4d93-b103-e8a7fdd2c61a None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:31.313829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383b444-1daf-4d93-b103-e8a7fdd2c61a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:31.314104 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383b444-1daf-4d93-b103-e8a7fdd2c61a None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1/users/0a7c3974c2734a1e83cd7ce14c50346f/roles/e5fee74fe53d429897caab84ecf4e5d9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:31.318214 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383b444-1daf-4d93-b103-e8a7fdd2c61a None admin] RBAC: Authorizing `identity:create_grant(project_id=9a832f072c654c648482fe86fd6b1ca1, user_id=0a7c3974c2734a1e83cd7ce14c50346f, role_id=e5fee74fe53d429897caab84ecf4e5d9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:31.319864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383b444-1daf-4d93-b103-e8a7fdd2c61a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:31.411414 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 121/233] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:49:31 2022] PUT /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1/users/0a7c3974c2734a1e83cd7ce14c50346f/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:49:31.431360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 113/234] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:49:31 2022] PUT /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1/users/0a7c3974c2734a1e83cd7ce14c50346f/roles/e5fee74fe53d429897caab84ecf4e5d9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 21:49:32.482182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a427-365e-4d1f-82c2-5515b7741d12 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:32.482695 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a427-365e-4d1f-82c2-5515b7741d12 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:32.482695 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a427-365e-4d1f-82c2-5515b7741d12 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:32.484473 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 122/235] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:32.489338 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2cf5c-55f7-49fc-979f-0001145cf462 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:32.489736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2cf5c-55f7-49fc-979f-0001145cf462 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:32.489900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2cf5c-55f7-49fc-979f-0001145cf462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:32.511550 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-acd2cf5c-55f7-49fc-979f-0001145cf462 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:32.512740 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-acd2cf5c-55f7-49fc-979f-0001145cf462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:32.548206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfe479-435d-4d2e-b384-cabd38e7e3b7 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:32.548819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfe479-435d-4d2e-b384-cabd38e7e3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:32.549298 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfe479-435d-4d2e-b384-cabd38e7e3b7 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:32.551209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 123/236] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:32.556330 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c959a80-0b91-45fd-b275-3eb6117b2eb9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:32.556865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c959a80-0b91-45fd-b275-3eb6117b2eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:32.557347 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c959a80-0b91-45fd-b275-3eb6117b2eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:32.584616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3c959a80-0b91-45fd-b275-3eb6117b2eb9 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:32.586134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3c959a80-0b91-45fd-b275-3eb6117b2eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:32.591600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 114/237] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:32.628122 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2cf5c-55f7-49fc-979f-0001145cf462 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:32.664360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 124/238] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:32.702983 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c959a80-0b91-45fd-b275-3eb6117b2eb9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:32.811188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2cf5c-55f7-49fc-979f-0001145cf462 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:32.815328 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c959a80-0b91-45fd-b275-3eb6117b2eb9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:32.865011 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a72f7b-d997-4a0a-a9c4-a3caa7814fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:32.865821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a72f7b-d997-4a0a-a9c4-a3caa7814fbf None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:32.866101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a72f7b-d997-4a0a-a9c4-a3caa7814fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:32.866373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a72f7b-d997-4a0a-a9c4-a3caa7814fbf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:32.892622 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a72f7b-d997-4a0a-a9c4-a3caa7814fbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-a2a72f7b-d997-4a0a-a9c4-a3caa7814fbf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:32.900643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:32.902446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:32.903425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:32.903425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:32.903425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:32.903425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:32.903425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:32.903425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:32.903425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:32.903425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:32.903425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:32.903425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:32.903425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:32.903425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:32.903425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 125/239] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:49:32.910077 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e01c68-5c27-47f7-aad5-f29eab4ba1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:32.910913 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e01c68-5c27-47f7-aad5-f29eab4ba1ae None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:32.911238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e01c68-5c27-47f7-aad5-f29eab4ba1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:32.911520 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e01c68-5c27-47f7-aad5-f29eab4ba1ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:32.912159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a72f7b-d997-4a0a-a9c4-a3caa7814fbf None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:32.912782 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e01c68-5c27-47f7-aad5-f29eab4ba1ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:32.914247 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e01c68-5c27-47f7-aad5-f29eab4ba1ae None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:32.916118 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 115/240] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:49:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:32.921928 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e01c68-5c27-47f7-aad5-f29eab4ba1ae None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:33.065853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a72f7b-d997-4a0a-a9c4-a3caa7814fbf None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:33.069941 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e01c68-5c27-47f7-aad5-f29eab4ba1ae None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:33.107806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041219e-73d9-4177-a6bd-72fff482c075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:33.108817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041219e-73d9-4177-a6bd-72fff482c075 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:33.109380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041219e-73d9-4177-a6bd-72fff482c075 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:33.109791 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041219e-73d9-4177-a6bd-72fff482c075 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:33.111266 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041219e-73d9-4177-a6bd-72fff482c075 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:33.111736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041219e-73d9-4177-a6bd-72fff482c075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:33.113324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041219e-73d9-4177-a6bd-72fff482c075 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:33.116453 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110eeed-fb95-4c87-9d2c-7c333392dd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:33.117234 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110eeed-fb95-4c87-9d2c-7c333392dd68 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:33.117617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110eeed-fb95-4c87-9d2c-7c333392dd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:33.117992 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110eeed-fb95-4c87-9d2c-7c333392dd68 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:33.118805 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110eeed-fb95-4c87-9d2c-7c333392dd68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:33.121009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110eeed-fb95-4c87-9d2c-7c333392dd68 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:33.123654 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 126/241] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:33.125046 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73327994-d4c3-4e39-943b-af78abc74c9c None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:33.125491 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73327994-d4c3-4e39-943b-af78abc74c9c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:33.125904 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73327994-d4c3-4e39-943b-af78abc74c9c None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:33.127285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 127/242] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:33.129004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73327994-d4c3-4e39-943b-af78abc74c9c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:33.223063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 116/243] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:49:32 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:49:33.227403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ec23c-f66e-47f9-b114-0cac0773a356 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:33.228009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ec23c-f66e-47f9-b114-0cac0773a356 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:33.228482 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ec23c-f66e-47f9-b114-0cac0773a356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:33.244312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73327994-d4c3-4e39-943b-af78abc74c9c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:33.247696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b91ec23c-f66e-47f9-b114-0cac0773a356 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:33.249131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b91ec23c-f66e-47f9-b114-0cac0773a356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:33.290683 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45139770-a4c0-432f-8425-d01ad25c4a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:33.291593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45139770-a4c0-432f-8425-d01ad25c4a28 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:33.292447 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45139770-a4c0-432f-8425-d01ad25c4a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:33.292730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45139770-a4c0-432f-8425-d01ad25c4a28 None admin] PATH_INFO: `/v3/users/cf90807c940b42909076ffa12496cfcf` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:33.311813 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45139770-a4c0-432f-8425-d01ad25c4a28 None admin] RBAC: Authorizing `identity:get_user(user_id=cf90807c940b42909076ffa12496cfcf)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:33.313305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45139770-a4c0-432f-8425-d01ad25c4a28 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:33.316620 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 128/244] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:33 2022] GET /identity/v3/users/cf90807c940b42909076ffa12496cfcf => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:33.321340 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45139770-a4c0-432f-8425-d01ad25c4a28 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:33.337715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 117/245] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:33.380909 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ec23c-f66e-47f9-b114-0cac0773a356 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:33.439785 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45139770-a4c0-432f-8425-d01ad25c4a28 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:33.481703 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12948-db27-4900-bc8a-9e81124d4f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:33.482722 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12948-db27-4900-bc8a-9e81124d4f41 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:33.483668 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12948-db27-4900-bc8a-9e81124d4f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:33.484491 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12948-db27-4900-bc8a-9e81124d4f41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:33.559708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d12948-db27-4900-bc8a-9e81124d4f41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:33.560037 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ec23c-f66e-47f9-b114-0cac0773a356 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:33.562056 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d12948-db27-4900-bc8a-9e81124d4f41 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:33.597611 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d7e39-e1fa-41af-823c-3947b3061cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:33.599008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d7e39-e1fa-41af-823c-3947b3061cec None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:33.599008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d7e39-e1fa-41af-823c-3947b3061cec None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:33.599008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d7e39-e1fa-41af-823c-3947b3061cec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:33.609833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d7e39-e1fa-41af-823c-3947b3061cec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d72d7e39-e1fa-41af-823c-3947b3061cec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:33.617564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:33.618474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:33.619304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:33.619304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:33.619304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:33.619304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:33.619304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:33.619304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:33.619304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:33.619304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:33.619304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:33.619304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:33.619304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:33.619304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:33.619304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 118/246] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:49:33.625382 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d7e39-e1fa-41af-823c-3947b3061cec None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:33.672134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 129/247] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:33.680208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12948-db27-4900-bc8a-9e81124d4f41 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:33.738974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d7e39-e1fa-41af-823c-3947b3061cec None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:33.772868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dd150-122a-48da-a609-846fb4e0dd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:33.773366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dd150-122a-48da-a609-846fb4e0dd3e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:33.773646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dd150-122a-48da-a609-846fb4e0dd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:33.773918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dd150-122a-48da-a609-846fb4e0dd3e None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:33.774671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dd150-122a-48da-a609-846fb4e0dd3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:33.774974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dd150-122a-48da-a609-846fb4e0dd3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:33.776942 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dd150-122a-48da-a609-846fb4e0dd3e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:33.786652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 119/248] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:33.787211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12948-db27-4900-bc8a-9e81124d4f41 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:33.796457 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dd150-122a-48da-a609-846fb4e0dd3e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:33.839188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f01695-41ef-4d91-9a46-9dd7cd945511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:33.840298 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f01695-41ef-4d91-9a46-9dd7cd945511 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:33.840724 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f01695-41ef-4d91-9a46-9dd7cd945511 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:33.841176 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f01695-41ef-4d91-9a46-9dd7cd945511 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:33.842635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f01695-41ef-4d91-9a46-9dd7cd945511 None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:33.844333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f01695-41ef-4d91-9a46-9dd7cd945511 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:33.846214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 130/249] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:33 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:33.857016 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f01695-41ef-4d91-9a46-9dd7cd945511 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:33.945099 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dd150-122a-48da-a609-846fb4e0dd3e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:33.991700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261539a9-f1ee-4800-938b-074c08ffc90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:33.992938 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261539a9-f1ee-4800-938b-074c08ffc90f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:33.993425 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261539a9-f1ee-4800-938b-074c08ffc90f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:33.993937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261539a9-f1ee-4800-938b-074c08ffc90f None admin] PATH_INFO: `/v3/users/43959a9c002b4c71b78ecd947f031619` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:33.995437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261539a9-f1ee-4800-938b-074c08ffc90f None admin] RBAC: Authorizing `identity:get_user(user_id=43959a9c002b4c71b78ecd947f031619)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:33.997189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261539a9-f1ee-4800-938b-074c08ffc90f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:33.999186 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 120/250] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:33 2022] GET /identity/v3/users/43959a9c002b4c71b78ecd947f031619 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:34.008109 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261539a9-f1ee-4800-938b-074c08ffc90f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:34.024993 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f01695-41ef-4d91-9a46-9dd7cd945511 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:34.070509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8dadf-2fb1-4616-ba36-ad7f47f787ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:34.071547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8dadf-2fb1-4616-ba36-ad7f47f787ea None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:34.072056 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8dadf-2fb1-4616-ba36-ad7f47f787ea None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:34.072530 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8dadf-2fb1-4616-ba36-ad7f47f787ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:34.074909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8dadf-2fb1-4616-ba36-ad7f47f787ea None admin] RBAC: Adding query filter params (role.id=2c87c506ab694d0a9cb77ab7383c7898, scope.project.id=9a832f072c654c648482fe86fd6b1ca1, user.id=cf90807c940b42909076ffa12496cfcf) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:34.075637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8dadf-2fb1-4616-ba36-ad7f47f787ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:34.077639 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8dadf-2fb1-4616-ba36-ad7f47f787ea None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:34.085717 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 131/251] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:33 2022] GET /identity/v3/role_assignments?user.id=cf90807c940b42909076ffa12496cfcf&scope.project.id=9a832f072c654c648482fe86fd6b1ca1&role.id=2c87c506ab694d0a9cb77ab7383c7898 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:34.132056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261539a9-f1ee-4800-938b-074c08ffc90f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:34.138363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1277e2-badb-4528-a46f-b0866a569ab0 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:34.138981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1277e2-badb-4528-a46f-b0866a569ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:34.139492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1277e2-badb-4528-a46f-b0866a569ab0 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:34.141124 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 132/252] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:49:34.148762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57973f7-6e99-4306-b95e-0874a4154f3a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:34.149404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57973f7-6e99-4306-b95e-0874a4154f3a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:34.149926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57973f7-6e99-4306-b95e-0874a4154f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:34.170474 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c57973f7-6e99-4306-b95e-0874a4154f3a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:34.170902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce323d-a1a1-4337-9378-b1b9901f0fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:34.171826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce323d-a1a1-4337-9378-b1b9901f0fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:34.172106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce323d-a1a1-4337-9378-b1b9901f0fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:34.172378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce323d-a1a1-4337-9378-b1b9901f0fb4 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:34.173054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c57973f7-6e99-4306-b95e-0874a4154f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:34.173687 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce323d-a1a1-4337-9378-b1b9901f0fb4 None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:34.175247 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce323d-a1a1-4337-9378-b1b9901f0fb4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:34.177863 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 121/253] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:34 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:34.178881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6943b2-d598-44ea-a1e2-10b0a51166c6 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:34.179188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6943b2-d598-44ea-a1e2-10b0a51166c6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:34.179476 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6943b2-d598-44ea-a1e2-10b0a51166c6 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:34.181119 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 122/254] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:34.187342 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6943b2-d598-44ea-a1e2-10b0a51166c6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:34.273480 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 133/255] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:34.275339 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9323c5-0db5-4cd7-acd5-ca2332efca00 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:34.275837 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9323c5-0db5-4cd7-acd5-ca2332efca00 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:34.276909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9323c5-0db5-4cd7-acd5-ca2332efca00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:34.296366 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2d9323c5-0db5-4cd7-acd5-ca2332efca00 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:34.298552 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2d9323c5-0db5-4cd7-acd5-ca2332efca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:34.338238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6943b2-d598-44ea-a1e2-10b0a51166c6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:34.374160 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16514d-aa7b-4e19-95ec-c4e513ee37c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:34.375046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16514d-aa7b-4e19-95ec-c4e513ee37c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:34.375355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16514d-aa7b-4e19-95ec-c4e513ee37c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:34.375678 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16514d-aa7b-4e19-95ec-c4e513ee37c6 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1/users/43959a9c002b4c71b78ecd947f031619/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:34.377719 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16514d-aa7b-4e19-95ec-c4e513ee37c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a832f072c654c648482fe86fd6b1ca1, user_id=43959a9c002b4c71b78ecd947f031619, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:34.379267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16514d-aa7b-4e19-95ec-c4e513ee37c6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:34.385851 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 134/256] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:34.391403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9323c5-0db5-4cd7-acd5-ca2332efca00 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:34.493061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 123/257] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:49:34 2022] PUT /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1/users/43959a9c002b4c71b78ecd947f031619/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:49:34.493908 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16514d-aa7b-4e19-95ec-c4e513ee37c6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:34.505267 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9323c5-0db5-4cd7-acd5-ca2332efca00 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:34.544304 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8e26d-9c16-4885-9c69-15f469abe03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:34.545541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8e26d-9c16-4885-9c69-15f469abe03b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:34.546018 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8e26d-9c16-4885-9c69-15f469abe03b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:34.546486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8e26d-9c16-4885-9c69-15f469abe03b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:34.559563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8e26d-9c16-4885-9c69-15f469abe03b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e9c8e26d-9c16-4885-9c69-15f469abe03b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:34.567990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:34.568902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:34.569670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:34.569670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:34.569670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:34.569670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:34.569670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:34.569670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:34.569670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:34.569670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:34.569670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:34.569670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:34.569670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:34.569670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:34.572186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 135/258] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:34.585008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8e26d-9c16-4885-9c69-15f469abe03b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:34.755005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16514d-aa7b-4e19-95ec-c4e513ee37c6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:34.795405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8e26d-9c16-4885-9c69-15f469abe03b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:34.821270 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79822976-3df7-4cf6-b635-86878f1672c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:34.822084 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79822976-3df7-4cf6-b635-86878f1672c5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:34.822365 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79822976-3df7-4cf6-b635-86878f1672c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:34.822638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79822976-3df7-4cf6-b635-86878f1672c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:34.837582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79822976-3df7-4cf6-b635-86878f1672c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-79822976-3df7-4cf6-b635-86878f1672c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:34.846277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:34.847370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:34.848363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:34.848363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:34.848363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:34.848363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:34.848363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:34.848363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:34.848363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:34.848363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:34.848363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:34.848363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:34.848363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:34.848363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:34.848363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 124/259] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:49:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:34.856517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79822976-3df7-4cf6-b635-86878f1672c5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:34.878239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1f57e-e9ad-48b8-9e3f-4d6b596b347d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:34.878914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1f57e-e9ad-48b8-9e3f-4d6b596b347d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:34.879241 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1f57e-e9ad-48b8-9e3f-4d6b596b347d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:34.879516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1f57e-e9ad-48b8-9e3f-4d6b596b347d None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:34.880281 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1f57e-e9ad-48b8-9e3f-4d6b596b347d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:34.880585 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1f57e-e9ad-48b8-9e3f-4d6b596b347d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:34.882834 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1f57e-e9ad-48b8-9e3f-4d6b596b347d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:34.902951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 136/260] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:34.912148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1f57e-e9ad-48b8-9e3f-4d6b596b347d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:34.999820 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79822976-3df7-4cf6-b635-86878f1672c5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:35.044425 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b095701-c38d-4934-b955-90be643ba6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:35.045262 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b095701-c38d-4934-b955-90be643ba6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:35.045652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b095701-c38d-4934-b955-90be643ba6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:35.046033 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b095701-c38d-4934-b955-90be643ba6b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:35.046456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1f57e-e9ad-48b8-9e3f-4d6b596b347d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:35.046998 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b095701-c38d-4934-b955-90be643ba6b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:35.047445 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b095701-c38d-4934-b955-90be643ba6b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:35.049889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b095701-c38d-4934-b955-90be643ba6b8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:35.061881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 125/261] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:49:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:35.068840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b095701-c38d-4934-b955-90be643ba6b8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:35.088702 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4114d-82d1-4f5d-ad03-14695b33fdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:35.089954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4114d-82d1-4f5d-ad03-14695b33fdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:35.090423 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4114d-82d1-4f5d-ad03-14695b33fdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:35.090916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4114d-82d1-4f5d-ad03-14695b33fdb9 None admin] PATH_INFO: `/v3/users/0a7c3974c2734a1e83cd7ce14c50346f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:35.092337 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4114d-82d1-4f5d-ad03-14695b33fdb9 None admin] RBAC: Authorizing `identity:get_user(user_id=0a7c3974c2734a1e83cd7ce14c50346f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:35.093958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4114d-82d1-4f5d-ad03-14695b33fdb9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:35.095888 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 137/262] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:34 2022] GET /identity/v3/users/0a7c3974c2734a1e83cd7ce14c50346f => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:35.102525 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4114d-82d1-4f5d-ad03-14695b33fdb9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:35.274699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b095701-c38d-4934-b955-90be643ba6b8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:35.342819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4114d-82d1-4f5d-ad03-14695b33fdb9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:35.347798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6115f32-006b-4f7e-9856-16f4d8bb3a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:35.348689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6115f32-006b-4f7e-9856-16f4d8bb3a97 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:35.348999 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6115f32-006b-4f7e-9856-16f4d8bb3a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:35.349248 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6115f32-006b-4f7e-9856-16f4d8bb3a97 None admin] PATH_INFO: `/v3/users/0a7c3974c2734a1e83cd7ce14c50346f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:35.350454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6115f32-006b-4f7e-9856-16f4d8bb3a97 None admin] RBAC: Authorizing `identity:get_user(user_id=0a7c3974c2734a1e83cd7ce14c50346f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:35.351944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6115f32-006b-4f7e-9856-16f4d8bb3a97 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:35.359575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 126/263] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:35 2022] GET /identity/v3/users/0a7c3974c2734a1e83cd7ce14c50346f => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:35.364962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6115f32-006b-4f7e-9856-16f4d8bb3a97 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:35.395359 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117ea2-06f3-428d-a05c-b7de1758a786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:35.396806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117ea2-06f3-428d-a05c-b7de1758a786 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:35.397292 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117ea2-06f3-428d-a05c-b7de1758a786 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:35.397804 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117ea2-06f3-428d-a05c-b7de1758a786 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:35.527373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d117ea2-06f3-428d-a05c-b7de1758a786 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:35.528183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d117ea2-06f3-428d-a05c-b7de1758a786 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:35.574543 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6115f32-006b-4f7e-9856-16f4d8bb3a97 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:35.664122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 138/264] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:35.670733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117ea2-06f3-428d-a05c-b7de1758a786 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:35.676285 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85c98f-e182-48c6-b58a-374257256816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:35.676971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85c98f-e182-48c6-b58a-374257256816 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:35.677256 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85c98f-e182-48c6-b58a-374257256816 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:35.677533 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85c98f-e182-48c6-b58a-374257256816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:35.771697 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117ea2-06f3-428d-a05c-b7de1758a786 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:35.803132 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85c98f-e182-48c6-b58a-374257256816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:35.805463 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85c98f-e182-48c6-b58a-374257256816 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:35.806271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c71b20-cdf2-4765-98ec-649bfb064369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:35.807164 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c71b20-cdf2-4765-98ec-649bfb064369 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:35.807554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c71b20-cdf2-4765-98ec-649bfb064369 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:35.807924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c71b20-cdf2-4765-98ec-649bfb064369 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:35.809231 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c71b20-cdf2-4765-98ec-649bfb064369 None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:35.810662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c71b20-cdf2-4765-98ec-649bfb064369 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:35.812582 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 139/265] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:35 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:35.818138 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c71b20-cdf2-4765-98ec-649bfb064369 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:35.917657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 127/266] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 21:49:35.924926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85c98f-e182-48c6-b58a-374257256816 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:36.014718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c71b20-cdf2-4765-98ec-649bfb064369 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:36.044046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85c98f-e182-48c6-b58a-374257256816 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:36.082373 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9761e-0dd6-41e3-ad42-a6e0aaeee297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:36.083800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9761e-0dd6-41e3-ad42-a6e0aaeee297 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:36.084308 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9761e-0dd6-41e3-ad42-a6e0aaeee297 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:36.084783 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9761e-0dd6-41e3-ad42-a6e0aaeee297 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:36.086451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9761e-0dd6-41e3-ad42-a6e0aaeee297 None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:36.088448 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9761e-0dd6-41e3-ad42-a6e0aaeee297 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:36.091008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 128/267] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:35 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:36.099959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9761e-0dd6-41e3-ad42-a6e0aaeee297 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:36.100926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bc681-a91e-408c-96fd-01ae8979c1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:36.101593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bc681-a91e-408c-96fd-01ae8979c1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:36.101872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bc681-a91e-408c-96fd-01ae8979c1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:36.102145 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bc681-a91e-408c-96fd-01ae8979c1b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:36.102991 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bc681-a91e-408c-96fd-01ae8979c1b1 None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=9a832f072c654c648482fe86fd6b1ca1, user.id=0a7c3974c2734a1e83cd7ce14c50346f) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:36.103331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bc681-a91e-408c-96fd-01ae8979c1b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:36.104886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bc681-a91e-408c-96fd-01ae8979c1b1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:36.122056 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 140/268] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:35 2022] GET /identity/v3/role_assignments?user.id=0a7c3974c2734a1e83cd7ce14c50346f&scope.project.id=9a832f072c654c648482fe86fd6b1ca1&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:36.250819 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9761e-0dd6-41e3-ad42-a6e0aaeee297 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:36.301184 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073b42f-f73f-4779-9350-14f0e1519a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:36.301871 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073b42f-f73f-4779-9350-14f0e1519a55 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:36.302156 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073b42f-f73f-4779-9350-14f0e1519a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:36.302431 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073b42f-f73f-4779-9350-14f0e1519a55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:36.303313 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073b42f-f73f-4779-9350-14f0e1519a55 None admin] RBAC: Adding query filter params (role.id=e5fee74fe53d429897caab84ecf4e5d9, scope.project.id=9a832f072c654c648482fe86fd6b1ca1, user.id=0a7c3974c2734a1e83cd7ce14c50346f) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:36.303629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073b42f-f73f-4779-9350-14f0e1519a55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:36.305122 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073b42f-f73f-4779-9350-14f0e1519a55 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:36.316442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 129/269] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:36 2022] GET /identity/v3/role_assignments?user.id=0a7c3974c2734a1e83cd7ce14c50346f&scope.project.id=9a832f072c654c648482fe86fd6b1ca1&role.id=e5fee74fe53d429897caab84ecf4e5d9 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:36.955569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92601e-acd2-49df-aa59-4da213d80128 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:36.956091 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92601e-acd2-49df-aa59-4da213d80128 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:36.956167 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92601e-acd2-49df-aa59-4da213d80128 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:36.957664 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 141/270] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:36.963158 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29e85-b752-4ce9-8691-09e0ae63bdc8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:36.963608 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29e85-b752-4ce9-8691-09e0ae63bdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:36.963782 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29e85-b752-4ce9-8691-09e0ae63bdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:36.987560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e1c29e85-b752-4ce9-8691-09e0ae63bdc8 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:36.988722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e1c29e85-b752-4ce9-8691-09e0ae63bdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:37.064476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b93b4-49f4-400f-aa2b-22c03f66f3c0 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:37.064806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b93b4-49f4-400f-aa2b-22c03f66f3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:37.065047 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b93b4-49f4-400f-aa2b-22c03f66f3c0 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:37.066428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 142/271] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:37.071090 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 130/272] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:37.076371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616efb23-eea1-4715-bb84-57c1fef585d5 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:37.076662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616efb23-eea1-4715-bb84-57c1fef585d5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:37.076941 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616efb23-eea1-4715-bb84-57c1fef585d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:37.098953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c29e85-b752-4ce9-8691-09e0ae63bdc8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:37.102863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-616efb23-eea1-4715-bb84-57c1fef585d5 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:37.102863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-616efb23-eea1-4715-bb84-57c1fef585d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:37.171582 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 143/273] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:37.172653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba50e7-f13a-4700-9b25-82ee08de552d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:37.172939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba50e7-f13a-4700-9b25-82ee08de552d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:37.173218 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba50e7-f13a-4700-9b25-82ee08de552d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:37.174479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 144/274] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:37.180017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189d2a6-b5b5-455b-9772-f315185bee28 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:37.180303 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189d2a6-b5b5-455b-9772-f315185bee28 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:37.180580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189d2a6-b5b5-455b-9772-f315185bee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:37.200924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5189d2a6-b5b5-455b-9772-f315185bee28 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:37.202111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5189d2a6-b5b5-455b-9772-f315185bee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:37.210593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c29e85-b752-4ce9-8691-09e0ae63bdc8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:37.248247 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2996da7-c8df-4e38-b1c7-e928cf46dc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:37.249042 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2996da7-c8df-4e38-b1c7-e928cf46dc89 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:37.249322 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2996da7-c8df-4e38-b1c7-e928cf46dc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:37.249586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2996da7-c8df-4e38-b1c7-e928cf46dc89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:37.250749 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2996da7-c8df-4e38-b1c7-e928cf46dc89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:37.252246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2996da7-c8df-4e38-b1c7-e928cf46dc89 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:37.258292 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 131/275] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:49:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:37.258292 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2996da7-c8df-4e38-b1c7-e928cf46dc89 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:37.273520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 145/276] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:37.274341 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189d2a6-b5b5-455b-9772-f315185bee28 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:37.360294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2996da7-c8df-4e38-b1c7-e928cf46dc89 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:37.383345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189d2a6-b5b5-455b-9772-f315185bee28 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:37.394486 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453996be-cee2-46cf-9c0a-9cf621a11943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:37.395302 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453996be-cee2-46cf-9c0a-9cf621a11943 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:37.395581 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453996be-cee2-46cf-9c0a-9cf621a11943 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:37.395851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453996be-cee2-46cf-9c0a-9cf621a11943 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:37.406029 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453996be-cee2-46cf-9c0a-9cf621a11943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-453996be-cee2-46cf-9c0a-9cf621a11943 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:37.413770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:37.414865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:37.415713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:37.415713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:37.415713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:37.415713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:37.415713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:37.415713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:37.415713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:37.415713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:37.415713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:37.415713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:37.415713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:37.415713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:37.415713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 132/277] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:37.416364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453996be-cee2-46cf-9c0a-9cf621a11943 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:37.422443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0139e8-9989-4b6f-be0c-19f2c2bc6dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:37.423070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0139e8-9989-4b6f-be0c-19f2c2bc6dab None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:37.423374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0139e8-9989-4b6f-be0c-19f2c2bc6dab None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:37.423649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0139e8-9989-4b6f-be0c-19f2c2bc6dab None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:37.424361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0139e8-9989-4b6f-be0c-19f2c2bc6dab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:37.426075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0139e8-9989-4b6f-be0c-19f2c2bc6dab None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:37.512249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 146/278] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:49:37 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:49:37.513351 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0139e8-9989-4b6f-be0c-19f2c2bc6dab None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:37.532583 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453996be-cee2-46cf-9c0a-9cf621a11943 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:37.580126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902ebeb-da2a-4c8e-8cc2-d75cf73c436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:37.581465 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902ebeb-da2a-4c8e-8cc2-d75cf73c436e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:37.581821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902ebeb-da2a-4c8e-8cc2-d75cf73c436e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:37.582174 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902ebeb-da2a-4c8e-8cc2-d75cf73c436e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:37.599200 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902ebeb-da2a-4c8e-8cc2-d75cf73c436e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5902ebeb-da2a-4c8e-8cc2-d75cf73c436e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:37.610437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:37.611600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:37.612363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:37.612363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:37.612363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:37.612363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:37.612363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:37.612363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:37.612363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:37.612363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:37.612363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:37.612363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:37.612363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:37.612363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:37.612363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 133/279] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:37.618307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902ebeb-da2a-4c8e-8cc2-d75cf73c436e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:37.657963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0139e8-9989-4b6f-be0c-19f2c2bc6dab None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:37.705644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a18846-2b05-484d-a486-bce00c31c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:37.706417 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a18846-2b05-484d-a486-bce00c31c4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:37.706788 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a18846-2b05-484d-a486-bce00c31c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:37.707205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a18846-2b05-484d-a486-bce00c31c4e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:37.708062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a18846-2b05-484d-a486-bce00c31c4e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:37.708462 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a18846-2b05-484d-a486-bce00c31c4e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:37.709992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a18846-2b05-484d-a486-bce00c31c4e8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:37.719913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 147/280] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:37.726239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a18846-2b05-484d-a486-bce00c31c4e8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:37.737300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902ebeb-da2a-4c8e-8cc2-d75cf73c436e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:37.779686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e0941-9611-4bfa-878d-99548ead144a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:37.780955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e0941-9611-4bfa-878d-99548ead144a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:37.781646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e0941-9611-4bfa-878d-99548ead144a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:37.782065 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e0941-9611-4bfa-878d-99548ead144a None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:37.783154 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e0941-9611-4bfa-878d-99548ead144a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:37.783636 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e0941-9611-4bfa-878d-99548ead144a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:37.785035 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e0941-9611-4bfa-878d-99548ead144a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:37.793907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 134/281] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:37.796257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f69479-8685-471a-b78a-22e12bb31d67 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:37.796551 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f69479-8685-471a-b78a-22e12bb31d67 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:37.796831 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f69479-8685-471a-b78a-22e12bb31d67 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:37.798257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 135/282] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:37.801095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f69479-8685-471a-b78a-22e12bb31d67 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:37.844881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a18846-2b05-484d-a486-bce00c31c4e8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:37.914342 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3cdd6-1fe5-408d-93c6-55adff250f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:37.916030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3cdd6-1fe5-408d-93c6-55adff250f35 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:37.916030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3cdd6-1fe5-408d-93c6-55adff250f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:37.916030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3cdd6-1fe5-408d-93c6-55adff250f35 None admin] PATH_INFO: `/v3/users/1dfee748f98848958227ecc44c72c0fa` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:37.933556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3cdd6-1fe5-408d-93c6-55adff250f35 None admin] RBAC: Authorizing `identity:get_user(user_id=1dfee748f98848958227ecc44c72c0fa)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:37.935366 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3cdd6-1fe5-408d-93c6-55adff250f35 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:37.937354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 148/283] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:37 2022] GET /identity/v3/users/1dfee748f98848958227ecc44c72c0fa => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:37.938741 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a621c2e-20be-43a6-8f96-525e94235fe7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:37.939213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a621c2e-20be-43a6-8f96-525e94235fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:37.939638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a621c2e-20be-43a6-8f96-525e94235fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:37.959470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f69479-8685-471a-b78a-22e12bb31d67 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:37.965183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0a621c2e-20be-43a6-8f96-525e94235fe7 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:37.966428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0a621c2e-20be-43a6-8f96-525e94235fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:37.994273 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c199a36-2c2a-45a1-ac4d-733a9fcc3ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:37.995215 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c199a36-2c2a-45a1-ac4d-733a9fcc3ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:37.995601 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c199a36-2c2a-45a1-ac4d-733a9fcc3ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:37.995878 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c199a36-2c2a-45a1-ac4d-733a9fcc3ac0 None admin] PATH_INFO: `/v3/users/cf90807c940b42909076ffa12496cfcf` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:37.997220 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c199a36-2c2a-45a1-ac4d-733a9fcc3ac0 None admin] RBAC: Authorizing `identity:get_user(user_id=cf90807c940b42909076ffa12496cfcf)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:37.998716 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c199a36-2c2a-45a1-ac4d-733a9fcc3ac0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:38.004521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 136/284] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:37 2022] GET /identity/v3/users/cf90807c940b42909076ffa12496cfcf => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:38.005418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c199a36-2c2a-45a1-ac4d-733a9fcc3ac0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:38.035120 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 149/285] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:38.035972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a621c2e-20be-43a6-8f96-525e94235fe7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:38.110048 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c199a36-2c2a-45a1-ac4d-733a9fcc3ac0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:38.134581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a621c2e-20be-43a6-8f96-525e94235fe7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:38.144407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d533d-7ab9-407d-82f8-400238fbeb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:38.145068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d533d-7ab9-407d-82f8-400238fbeb42 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:38.145351 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d533d-7ab9-407d-82f8-400238fbeb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:38.145626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d533d-7ab9-407d-82f8-400238fbeb42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:38.146461 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d533d-7ab9-407d-82f8-400238fbeb42 None admin] RBAC: Adding query filter params (role.id=5c8cdbb338e0490b90a50b0b915f9000, user.id=1dfee748f98848958227ecc44c72c0fa, scope.system=all) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:38.146771 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d533d-7ab9-407d-82f8-400238fbeb42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:38.148362 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d533d-7ab9-407d-82f8-400238fbeb42 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:38.154398 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 137/286] 10.222.0.24 () {56 vars in 1308 bytes} [Tue May 17 21:49:38 2022] GET /identity/v3/role_assignments?user.id=1dfee748f98848958227ecc44c72c0fa&scope.system=all&role.id=5c8cdbb338e0490b90a50b0b915f9000 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:38.160099 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d533d-7ab9-407d-82f8-400238fbeb42 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:38.171061 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337a35a-9f19-46c1-990c-ef08ae811b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:38.171958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337a35a-9f19-46c1-990c-ef08ae811b02 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:38.172235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337a35a-9f19-46c1-990c-ef08ae811b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:38.172504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337a35a-9f19-46c1-990c-ef08ae811b02 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:38.173691 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337a35a-9f19-46c1-990c-ef08ae811b02 None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:38.175201 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337a35a-9f19-46c1-990c-ef08ae811b02 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:38.177269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 150/287] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:38 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:38.183005 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337a35a-9f19-46c1-990c-ef08ae811b02 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:38.291876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337a35a-9f19-46c1-990c-ef08ae811b02 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:38.329338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8c042-52e6-4229-b318-bb990f929f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:38.330314 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8c042-52e6-4229-b318-bb990f929f97 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:38.330598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8c042-52e6-4229-b318-bb990f929f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:38.330877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8c042-52e6-4229-b318-bb990f929f97 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1/users/cf90807c940b42909076ffa12496cfcf/roles/2c87c506ab694d0a9cb77ab7383c7898` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:38.332950 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8c042-52e6-4229-b318-bb990f929f97 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a832f072c654c648482fe86fd6b1ca1, user_id=cf90807c940b42909076ffa12496cfcf, role_id=2c87c506ab694d0a9cb77ab7383c7898)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:38.334435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8c042-52e6-4229-b318-bb990f929f97 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:38.376918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d533d-7ab9-407d-82f8-400238fbeb42 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:38.412159 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee781303-33e3-49a4-8af0-855787386094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:38.412967 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee781303-33e3-49a4-8af0-855787386094 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:38.413248 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee781303-33e3-49a4-8af0-855787386094 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:38.413521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee781303-33e3-49a4-8af0-855787386094 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:38.430661 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 151/288] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:49:38 2022] PUT /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1/users/cf90807c940b42909076ffa12496cfcf/roles/2c87c506ab694d0a9cb77ab7383c7898 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:49:38.431170 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee781303-33e3-49a4-8af0-855787386094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ee781303-33e3-49a4-8af0-855787386094 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:38.439739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:38.441955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:38.443934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:38.443934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:38.443934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:38.443934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:38.443934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:38.443934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:38.443934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:38.443934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:38.443934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:38.443934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:38.443934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:38.443934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:38.443934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 138/289] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:38.450094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8c042-52e6-4229-b318-bb990f929f97 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:38.584942 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8c042-52e6-4229-b318-bb990f929f97 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:38.626833 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed484d-7efc-40ce-86bd-fa6feee26391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:38.627787 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed484d-7efc-40ce-86bd-fa6feee26391 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:38.628217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed484d-7efc-40ce-86bd-fa6feee26391 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:38.628667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed484d-7efc-40ce-86bd-fa6feee26391 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:38.629574 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed484d-7efc-40ce-86bd-fa6feee26391 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:38.630024 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed484d-7efc-40ce-86bd-fa6feee26391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:38.631585 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed484d-7efc-40ce-86bd-fa6feee26391 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:38.641487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 152/290] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:38.649762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee781303-33e3-49a4-8af0-855787386094 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:38.775656 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee781303-33e3-49a4-8af0-855787386094 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:38.811803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40c816-248f-45f0-b48e-b3aaf7fc791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:38.812747 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40c816-248f-45f0-b48e-b3aaf7fc791f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:38.813027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40c816-248f-45f0-b48e-b3aaf7fc791f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:38.813305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40c816-248f-45f0-b48e-b3aaf7fc791f None admin] PATH_INFO: `/v3/users/43959a9c002b4c71b78ecd947f031619` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:38.814521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40c816-248f-45f0-b48e-b3aaf7fc791f None admin] RBAC: Authorizing `identity:get_user(user_id=43959a9c002b4c71b78ecd947f031619)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:38.815998 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40c816-248f-45f0-b48e-b3aaf7fc791f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:38.818038 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 139/291] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:38 2022] GET /identity/v3/users/43959a9c002b4c71b78ecd947f031619 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:38.823679 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed484d-7efc-40ce-86bd-fa6feee26391 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:39.010720 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed484d-7efc-40ce-86bd-fa6feee26391 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:39.057110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0942c6-0c7c-4475-9243-6bc28af46d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:39.058454 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0942c6-0c7c-4475-9243-6bc28af46d76 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:39.058733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0942c6-0c7c-4475-9243-6bc28af46d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:39.059008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0942c6-0c7c-4475-9243-6bc28af46d76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:39.154910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0942c6-0c7c-4475-9243-6bc28af46d76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:39.156395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0942c6-0c7c-4475-9243-6bc28af46d76 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:39.268382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 153/292] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:39.276333 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40c816-248f-45f0-b48e-b3aaf7fc791f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:39.403395 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40c816-248f-45f0-b48e-b3aaf7fc791f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:39.446101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a08388-71e2-4047-b16c-ac3b70c6a04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:39.446947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a08388-71e2-4047-b16c-ac3b70c6a04c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:39.447264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a08388-71e2-4047-b16c-ac3b70c6a04c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:39.447542 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a08388-71e2-4047-b16c-ac3b70c6a04c None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:39.449309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a08388-71e2-4047-b16c-ac3b70c6a04c None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:39.450772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a08388-71e2-4047-b16c-ac3b70c6a04c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:39.452506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 140/293] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:39 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:39.458309 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0942c6-0c7c-4475-9243-6bc28af46d76 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:39.588059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0942c6-0c7c-4475-9243-6bc28af46d76 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:39.647870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579d3db-5f45-4240-bb2d-dd6d5c7f5dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:39.648542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579d3db-5f45-4240-bb2d-dd6d5c7f5dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:39.648823 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579d3db-5f45-4240-bb2d-dd6d5c7f5dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:39.649095 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579d3db-5f45-4240-bb2d-dd6d5c7f5dd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:39.649931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579d3db-5f45-4240-bb2d-dd6d5c7f5dd6 None admin] RBAC: Adding query filter params (role.id=5c8cdbb338e0490b90a50b0b915f9000, scope.project.id=9a832f072c654c648482fe86fd6b1ca1, user.id=43959a9c002b4c71b78ecd947f031619) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:39.650240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579d3db-5f45-4240-bb2d-dd6d5c7f5dd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:39.651751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579d3db-5f45-4240-bb2d-dd6d5c7f5dd6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:39.664022 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 154/294] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:39 2022] GET /identity/v3/role_assignments?user.id=43959a9c002b4c71b78ecd947f031619&scope.project.id=9a832f072c654c648482fe86fd6b1ca1&role.id=5c8cdbb338e0490b90a50b0b915f9000 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:40.106996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3c1fa-5603-4036-ba59-b64e27221b8b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:40.107403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3c1fa-5603-4036-ba59-b64e27221b8b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:40.107582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3c1fa-5603-4036-ba59-b64e27221b8b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:40.109057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 141/295] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:40.114464 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e901c0-0a01-4316-85a8-363a760a15fe None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:40.114905 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e901c0-0a01-4316-85a8-363a760a15fe None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:40.115094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e901c0-0a01-4316-85a8-363a760a15fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:40.134607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a4e901c0-0a01-4316-85a8-363a760a15fe None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:40.136514 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a4e901c0-0a01-4316-85a8-363a760a15fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:40.228326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 155/296] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:40.253659 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3c1fa-5603-4036-ba59-b64e27221b8b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:40.368815 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3c1fa-5603-4036-ba59-b64e27221b8b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:40.412015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf517f4-dada-4b8d-a667-198b4932af54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:40.412841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf517f4-dada-4b8d-a667-198b4932af54 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:40.413117 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf517f4-dada-4b8d-a667-198b4932af54 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:40.413392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf517f4-dada-4b8d-a667-198b4932af54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:40.430225 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf517f4-dada-4b8d-a667-198b4932af54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-dcf517f4-dada-4b8d-a667-198b4932af54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:40.438929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:40.439920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:40.440692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:40.440692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:40.440692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:40.440692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:40.440692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:40.440692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:40.440692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:40.440692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:40.440692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:40.440692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:40.440692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:40.440692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:40.440692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 142/297] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:40.446303 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e901c0-0a01-4316-85a8-363a760a15fe None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:40.552156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e901c0-0a01-4316-85a8-363a760a15fe None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:40.592388 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134b55f-1453-44f4-8580-30ab0def28fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:40.593073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b55f-1453-44f4-8580-30ab0def28fb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:40.593361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b55f-1453-44f4-8580-30ab0def28fb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:40.593640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134b55f-1453-44f4-8580-30ab0def28fb None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:40.594396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b55f-1453-44f4-8580-30ab0def28fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:40.594707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b55f-1453-44f4-8580-30ab0def28fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:40.596122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134b55f-1453-44f4-8580-30ab0def28fb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:40.603651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252cf39-b028-43d9-9912-30a7da722b69 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:40.604494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252cf39-b028-43d9-9912-30a7da722b69 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:40.605278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252cf39-b028-43d9-9912-30a7da722b69 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:40.606844 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 143/299] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:40.610964 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 156/299] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:40.611081 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252cf39-b028-43d9-9912-30a7da722b69 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:40.615411 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf97676-0d85-4843-95a4-394daa4a2a00 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:40.615698 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf97676-0d85-4843-95a4-394daa4a2a00 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:40.615972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf97676-0d85-4843-95a4-394daa4a2a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:40.633613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-dbf97676-0d85-4843-95a4-394daa4a2a00 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:40.634778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dbf97676-0d85-4843-95a4-394daa4a2a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:40.702813 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 157/300] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:40.709139 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f355881-4d82-44b1-9bf9-1c6d4b297343 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:40.709550 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f355881-4d82-44b1-9bf9-1c6d4b297343 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:40.709837 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f355881-4d82-44b1-9bf9-1c6d4b297343 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:40.715261 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 158/301] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:40 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:40.717313 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77370108-35d9-4ab1-9220-7f93d0654a75 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:40.717599 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77370108-35d9-4ab1-9220-7f93d0654a75 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:40.717875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77370108-35d9-4ab1-9220-7f93d0654a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:40.727612 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252cf39-b028-43d9-9912-30a7da722b69 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:40.741608 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-77370108-35d9-4ab1-9220-7f93d0654a75 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:40.742776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-77370108-35d9-4ab1-9220-7f93d0654a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:40.762341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2643d-44eb-4ee6-90c3-10ed5c6bb64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:40.763383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2643d-44eb-4ee6-90c3-10ed5c6bb64b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:40.763561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2643d-44eb-4ee6-90c3-10ed5c6bb64b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:40.763790 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2643d-44eb-4ee6-90c3-10ed5c6bb64b None admin] PATH_INFO: `/v3/users/e7e8a209b06f4e23b04ade2ecfcc2783` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:40.777532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2643d-44eb-4ee6-90c3-10ed5c6bb64b None admin] RBAC: Authorizing `identity:get_user(user_id=e7e8a209b06f4e23b04ade2ecfcc2783)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:40.778978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2643d-44eb-4ee6-90c3-10ed5c6bb64b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:40.780874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 144/302] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:40 2022] GET /identity/v3/users/e7e8a209b06f4e23b04ade2ecfcc2783 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:40.781471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2643d-44eb-4ee6-90c3-10ed5c6bb64b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:40.815229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 159/303] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:40.815229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77370108-35d9-4ab1-9220-7f93d0654a75 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:40.891295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2643d-44eb-4ee6-90c3-10ed5c6bb64b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:40.915205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77370108-35d9-4ab1-9220-7f93d0654a75 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:40.929995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9004b-a5fc-43f3-9be2-0f7c9780e263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:40.930988 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9004b-a5fc-43f3-9be2-0f7c9780e263 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:40.931306 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9004b-a5fc-43f3-9be2-0f7c9780e263 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:40.931576 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9004b-a5fc-43f3-9be2-0f7c9780e263 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:40.933512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9004b-a5fc-43f3-9be2-0f7c9780e263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:40.935212 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9004b-a5fc-43f3-9be2-0f7c9780e263 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:40.937246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 145/304] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:49:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:40.942333 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9004b-a5fc-43f3-9be2-0f7c9780e263 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:40.954913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892385ee-ff52-4435-a9cb-9630cb6c9eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:40.955824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892385ee-ff52-4435-a9cb-9630cb6c9eaf None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:40.956272 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892385ee-ff52-4435-a9cb-9630cb6c9eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:40.956713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892385ee-ff52-4435-a9cb-9630cb6c9eaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:40.957725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892385ee-ff52-4435-a9cb-9630cb6c9eaf None admin] RBAC: Adding query filter params (role.id=2c87c506ab694d0a9cb77ab7383c7898, user.id=e7e8a209b06f4e23b04ade2ecfcc2783, scope.system=all) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:40.958199 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892385ee-ff52-4435-a9cb-9630cb6c9eaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:40.959797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892385ee-ff52-4435-a9cb-9630cb6c9eaf None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:40.965445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 160/305] 10.222.0.24 () {56 vars in 1308 bytes} [Tue May 17 21:49:40 2022] GET /identity/v3/role_assignments?user.id=e7e8a209b06f4e23b04ade2ecfcc2783&scope.system=all&role.id=2c87c506ab694d0a9cb77ab7383c7898 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:40.966390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892385ee-ff52-4435-a9cb-9630cb6c9eaf None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:41.064140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9004b-a5fc-43f3-9be2-0f7c9780e263 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:41.107495 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28931889-299a-4025-817b-e1c0d11f5c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:41.108081 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892385ee-ff52-4435-a9cb-9630cb6c9eaf None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:41.108281 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28931889-299a-4025-817b-e1c0d11f5c1c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:41.108563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28931889-299a-4025-817b-e1c0d11f5c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:41.108836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28931889-299a-4025-817b-e1c0d11f5c1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:41.127545 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28931889-299a-4025-817b-e1c0d11f5c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-28931889-299a-4025-817b-e1c0d11f5c1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:41.136019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:41.137166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:41.138094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:41.138094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:41.138094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:41.138094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:41.138094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:41.138094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:41.138094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:41.138094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:41.138094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:41.138094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:41.138094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:41.138094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:41.142495 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 146/306] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:41.143610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28931889-299a-4025-817b-e1c0d11f5c1c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:41.154645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a336d-ce94-42e8-a594-c8696ed66ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:41.156380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a336d-ce94-42e8-a594-c8696ed66ea0 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:41.156844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a336d-ce94-42e8-a594-c8696ed66ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:41.157427 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a336d-ce94-42e8-a594-c8696ed66ea0 None admin] PATH_INFO: `/v3/groups` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:41.158930 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a336d-ce94-42e8-a594-c8696ed66ea0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:41.160800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a336d-ce94-42e8-a594-c8696ed66ea0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:41.235202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 161/307] 10.222.0.24 () {60 vars in 1134 bytes} [Tue May 17 21:49:40 2022] POST /identity/v3/groups => generated 229 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:49:41.260949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28931889-299a-4025-817b-e1c0d11f5c1c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:41.293846 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce8017-f093-4bcd-95da-1d1b80470035 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:41.294455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce8017-f093-4bcd-95da-1d1b80470035 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:41.294901 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce8017-f093-4bcd-95da-1d1b80470035 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:41.296565 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 162/308] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:49:41.302581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3bb67-bb47-4f03-8589-2db8545ed5f0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:41.302903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3bb67-bb47-4f03-8589-2db8545ed5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:41.303163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3bb67-bb47-4f03-8589-2db8545ed5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:41.308865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36781ddb-3441-48e9-b6ae-f95344f93178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:41.309956 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36781ddb-3441-48e9-b6ae-f95344f93178 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:41.310456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36781ddb-3441-48e9-b6ae-f95344f93178 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:41.310936 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36781ddb-3441-48e9-b6ae-f95344f93178 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:41.312005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36781ddb-3441-48e9-b6ae-f95344f93178 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:41.312536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36781ddb-3441-48e9-b6ae-f95344f93178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:41.314219 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36781ddb-3441-48e9-b6ae-f95344f93178 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:41.321924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5ec3bb67-bb47-4f03-8589-2db8545ed5f0 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:41.323240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5ec3bb67-bb47-4f03-8589-2db8545ed5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:41.325027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 147/309] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:41.334319 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36781ddb-3441-48e9-b6ae-f95344f93178 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:41.401954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 163/310] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:41.426177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3bb67-bb47-4f03-8589-2db8545ed5f0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:41.452785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36781ddb-3441-48e9-b6ae-f95344f93178 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:41.492184 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1404a98-6f0d-4552-978e-3ce8cb9c8ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:41.493321 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1404a98-6f0d-4552-978e-3ce8cb9c8ada None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:41.493594 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1404a98-6f0d-4552-978e-3ce8cb9c8ada None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:41.493867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1404a98-6f0d-4552-978e-3ce8cb9c8ada None admin] PATH_INFO: `/v3/users/1dfee748f98848958227ecc44c72c0fa` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:41.495466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1404a98-6f0d-4552-978e-3ce8cb9c8ada None admin] RBAC: Authorizing `identity:get_user(user_id=1dfee748f98848958227ecc44c72c0fa)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:41.496697 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1404a98-6f0d-4552-978e-3ce8cb9c8ada None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:41.498401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 148/311] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:41 2022] GET /identity/v3/users/1dfee748f98848958227ecc44c72c0fa => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:41.503761 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1404a98-6f0d-4552-978e-3ce8cb9c8ada None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:41.539457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3bb67-bb47-4f03-8589-2db8545ed5f0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:41.582778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f469fbf-ff23-4062-a94f-068171ec9389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:41.584085 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f469fbf-ff23-4062-a94f-068171ec9389 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:41.585316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f469fbf-ff23-4062-a94f-068171ec9389 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:41.585768 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f469fbf-ff23-4062-a94f-068171ec9389 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:41.599441 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f469fbf-ff23-4062-a94f-068171ec9389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-9f469fbf-ff23-4062-a94f-068171ec9389 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:41.607195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:41.608075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:41.608844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:41.608844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:41.608844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:41.608844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:41.608844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:41.608844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:41.608844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:41.608844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:41.608844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:41.608844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:41.608844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:41.608844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:41.608844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 164/312] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:49:41.614279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f469fbf-ff23-4062-a94f-068171ec9389 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:41.624888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1404a98-6f0d-4552-978e-3ce8cb9c8ada None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:41.660165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a2bb8-a2f2-4c20-a513-4ba649bb4af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:41.661367 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a2bb8-a2f2-4c20-a513-4ba649bb4af1 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:41.661838 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a2bb8-a2f2-4c20-a513-4ba649bb4af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:41.662314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a2bb8-a2f2-4c20-a513-4ba649bb4af1 None admin] PATH_INFO: `/v3/system/users/1dfee748f98848958227ecc44c72c0fa/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:41.664015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a2bb8-a2f2-4c20-a513-4ba649bb4af1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1dfee748f98848958227ecc44c72c0fa, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:41.665695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a2bb8-a2f2-4c20-a513-4ba649bb4af1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:41.716779 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f469fbf-ff23-4062-a94f-068171ec9389 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:41.749084 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705dc8d-2b08-4211-a899-6b2d81fabbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:41.749751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705dc8d-2b08-4211-a899-6b2d81fabbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:41.750031 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705dc8d-2b08-4211-a899-6b2d81fabbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:41.750298 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705dc8d-2b08-4211-a899-6b2d81fabbe8 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:41.751043 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705dc8d-2b08-4211-a899-6b2d81fabbe8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:41.751383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705dc8d-2b08-4211-a899-6b2d81fabbe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:41.752767 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705dc8d-2b08-4211-a899-6b2d81fabbe8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:41.761879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 165/313] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:41.767011 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705dc8d-2b08-4211-a899-6b2d81fabbe8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:41.786746 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 149/314] 10.222.0.24 () {58 vars in 1334 bytes} [Tue May 17 21:49:41 2022] PUT /identity/v3/system/users/1dfee748f98848958227ecc44c72c0fa/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 21:49:41.885795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705dc8d-2b08-4211-a899-6b2d81fabbe8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:41.928733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3eb9e1-b162-44e4-b085-2f64e602cc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:41.929568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3eb9e1-b162-44e4-b085-2f64e602cc91 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:41.929845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3eb9e1-b162-44e4-b085-2f64e602cc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:41.930113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3eb9e1-b162-44e4-b085-2f64e602cc91 None admin] PATH_INFO: `/v3/users/cf90807c940b42909076ffa12496cfcf` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:41.931388 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3eb9e1-b162-44e4-b085-2f64e602cc91 None admin] RBAC: Authorizing `identity:get_user(user_id=cf90807c940b42909076ffa12496cfcf)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:41.934237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3eb9e1-b162-44e4-b085-2f64e602cc91 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:41.936446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 166/315] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:41 2022] GET /identity/v3/users/cf90807c940b42909076ffa12496cfcf => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:41.942672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a2bb8-a2f2-4c20-a513-4ba649bb4af1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:42.046271 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a2bb8-a2f2-4c20-a513-4ba649bb4af1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:42.081516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4364e6-066f-43c3-94dc-81eb12898931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:42.082169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4364e6-066f-43c3-94dc-81eb12898931 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:42.082454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4364e6-066f-43c3-94dc-81eb12898931 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:42.082732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4364e6-066f-43c3-94dc-81eb12898931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:42.157881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4364e6-066f-43c3-94dc-81eb12898931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:42.159719 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4364e6-066f-43c3-94dc-81eb12898931 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:42.260042 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 150/316] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:42.266326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3eb9e1-b162-44e4-b085-2f64e602cc91 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:42.376001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3eb9e1-b162-44e4-b085-2f64e602cc91 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:42.410279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fe830-ee49-4067-ba08-78669d1c7043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:42.411573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fe830-ee49-4067-ba08-78669d1c7043 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:42.412052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fe830-ee49-4067-ba08-78669d1c7043 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:42.412538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fe830-ee49-4067-ba08-78669d1c7043 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:42.413901 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fe830-ee49-4067-ba08-78669d1c7043 None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:42.415560 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fe830-ee49-4067-ba08-78669d1c7043 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:42.417698 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 167/317] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:42 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:42.423721 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4364e6-066f-43c3-94dc-81eb12898931 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:42.525944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4364e6-066f-43c3-94dc-81eb12898931 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:42.561536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc14346-0c65-4306-bead-ffb477e233dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:42.562186 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14346-0c65-4306-bead-ffb477e233dd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:42.562467 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14346-0c65-4306-bead-ffb477e233dd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:42.562738 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14346-0c65-4306-bead-ffb477e233dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:42.563599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc14346-0c65-4306-bead-ffb477e233dd None admin] RBAC: Adding query filter params (role.id=2c87c506ab694d0a9cb77ab7383c7898, scope.project.id=9a832f072c654c648482fe86fd6b1ca1, user.id=cf90807c940b42909076ffa12496cfcf) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:42.563908 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc14346-0c65-4306-bead-ffb477e233dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:42.565343 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc14346-0c65-4306-bead-ffb477e233dd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:42.571769 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 151/318] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:49:42 2022] GET /identity/v3/role_assignments?user.id=cf90807c940b42909076ffa12496cfcf&scope.project.id=9a832f072c654c648482fe86fd6b1ca1&role.id=2c87c506ab694d0a9cb77ab7383c7898 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:43.654260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbc3a4-a8f5-40b4-b0da-3516155a03d9 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:43.654892 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbc3a4-a8f5-40b4-b0da-3516155a03d9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:43.655266 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbc3a4-a8f5-40b4-b0da-3516155a03d9 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:43.657752 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 168/319] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:43.663309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fbdbb-89d0-47ac-9c1e-349614b4ce0f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:43.663758 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fbdbb-89d0-47ac-9c1e-349614b4ce0f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:43.663840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fbdbb-89d0-47ac-9c1e-349614b4ce0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:43.681054 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-715fbdbb-89d0-47ac-9c1e-349614b4ce0f None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:43.682380 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-715fbdbb-89d0-47ac-9c1e-349614b4ce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:43.745908 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 152/320] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:43.767739 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbc3a4-a8f5-40b4-b0da-3516155a03d9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:43.867778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbc3a4-a8f5-40b4-b0da-3516155a03d9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:43.909920 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a3166-7722-41a2-b4b2-af9221f890b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:43.910653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a3166-7722-41a2-b4b2-af9221f890b6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:43.910930 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a3166-7722-41a2-b4b2-af9221f890b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:43.911232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a3166-7722-41a2-b4b2-af9221f890b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:43.925131 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a3166-7722-41a2-b4b2-af9221f890b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-975a3166-7722-41a2-b4b2-af9221f890b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:43.941952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:43.943192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:43.943968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:43.943968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:43.943968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:43.943968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:43.943968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:43.943968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:43.943968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:43.943968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:43.943968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:43.943968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:43.943968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:43.943968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:43.943968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 169/321] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:43.944642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fbdbb-89d0-47ac-9c1e-349614b4ce0f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:44.058314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fbdbb-89d0-47ac-9c1e-349614b4ce0f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:44.065973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994f8f3-fd9e-4170-9b89-fc5dbd0c8f34 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:44.066252 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994f8f3-fd9e-4170-9b89-fc5dbd0c8f34 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:44.066533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994f8f3-fd9e-4170-9b89-fc5dbd0c8f34 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:44.068069 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 170/322] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:44.073397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff211932-940d-4ba4-84b5-695d4e1ca2ba None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:44.073667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff211932-940d-4ba4-84b5-695d4e1ca2ba None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:44.073948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff211932-940d-4ba4-84b5-695d4e1ca2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:44.090605 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ff211932-940d-4ba4-84b5-695d4e1ca2ba None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:44.091789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ff211932-940d-4ba4-84b5-695d4e1ca2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:44.092834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0d184-3d36-4462-9165-718168e079b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:44.093507 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0d184-3d36-4462-9165-718168e079b3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:44.093793 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0d184-3d36-4462-9165-718168e079b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:44.094076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0d184-3d36-4462-9165-718168e079b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:44.094833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0d184-3d36-4462-9165-718168e079b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:44.095163 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0d184-3d36-4462-9165-718168e079b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:44.096541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0d184-3d36-4462-9165-718168e079b3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:44.104968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 153/323] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:44.109293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd35de-ef31-4095-b786-709a9dd5ca13 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:44.109589 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd35de-ef31-4095-b786-709a9dd5ca13 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:44.109872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd35de-ef31-4095-b786-709a9dd5ca13 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:44.111189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 154/324] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:49:44.111883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd35de-ef31-4095-b786-709a9dd5ca13 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:44.157596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 171/325] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:44.159671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76181bd6-44a8-429f-b2fe-f4f7d136755b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:44.160173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76181bd6-44a8-429f-b2fe-f4f7d136755b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:44.160402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76181bd6-44a8-429f-b2fe-f4f7d136755b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:44.180357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-76181bd6-44a8-429f-b2fe-f4f7d136755b None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:44.181527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-76181bd6-44a8-429f-b2fe-f4f7d136755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:44.212587 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd35de-ef31-4095-b786-709a9dd5ca13 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:44.244180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a592d-c15a-42aa-8eac-33e8cf511f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:44.245769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 172/326] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:44.246084 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a592d-c15a-42aa-8eac-33e8cf511f92 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:44.246366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a592d-c15a-42aa-8eac-33e8cf511f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:44.246580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76181bd6-44a8-429f-b2fe-f4f7d136755b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:44.246698 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a592d-c15a-42aa-8eac-33e8cf511f92 None admin] PATH_INFO: `/v3/users/e7e8a209b06f4e23b04ade2ecfcc2783` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:44.247989 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a592d-c15a-42aa-8eac-33e8cf511f92 None admin] RBAC: Authorizing `identity:get_user(user_id=e7e8a209b06f4e23b04ade2ecfcc2783)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:44.249407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a592d-c15a-42aa-8eac-33e8cf511f92 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:44.251190 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 155/327] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:44 2022] GET /identity/v3/users/e7e8a209b06f4e23b04ade2ecfcc2783 => generated 293 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:44.256695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a592d-c15a-42aa-8eac-33e8cf511f92 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:44.340814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76181bd6-44a8-429f-b2fe-f4f7d136755b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:44.354540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a592d-c15a-42aa-8eac-33e8cf511f92 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:44.372789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e5a63-f88f-4fe9-af3e-b7eb5841353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:44.373573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e5a63-f88f-4fe9-af3e-b7eb5841353b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:44.373841 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e5a63-f88f-4fe9-af3e-b7eb5841353b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:44.374112 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e5a63-f88f-4fe9-af3e-b7eb5841353b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:44.375281 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e5a63-f88f-4fe9-af3e-b7eb5841353b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:44.376710 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e5a63-f88f-4fe9-af3e-b7eb5841353b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:44.378284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 173/328] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:49:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:44.379025 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e5a63-f88f-4fe9-af3e-b7eb5841353b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:44.391442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9c630-a6f9-4656-9dc7-6ecc4f812d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:44.392304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9c630-a6f9-4656-9dc7-6ecc4f812d79 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:44.392588 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9c630-a6f9-4656-9dc7-6ecc4f812d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:44.392868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9c630-a6f9-4656-9dc7-6ecc4f812d79 None admin] PATH_INFO: `/v3/system/users/e7e8a209b06f4e23b04ade2ecfcc2783/roles/2c87c506ab694d0a9cb77ab7383c7898` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:44.394341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9c630-a6f9-4656-9dc7-6ecc4f812d79 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e7e8a209b06f4e23b04ade2ecfcc2783, role_id=2c87c506ab694d0a9cb77ab7383c7898)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:44.395739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9c630-a6f9-4656-9dc7-6ecc4f812d79 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:44.464856 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 156/329] 10.222.0.24 () {58 vars in 1334 bytes} [Tue May 17 21:49:44 2022] PUT /identity/v3/system/users/e7e8a209b06f4e23b04ade2ecfcc2783/roles/2c87c506ab694d0a9cb77ab7383c7898 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 21:49:44.465608 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9c630-a6f9-4656-9dc7-6ecc4f812d79 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:44.473490 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e5a63-f88f-4fe9-af3e-b7eb5841353b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:44.511633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4a5e3-543c-4b03-a82f-49b3acb74c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:44.512782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4a5e3-543c-4b03-a82f-49b3acb74c4e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:44.513225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4a5e3-543c-4b03-a82f-49b3acb74c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:44.513631 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4a5e3-543c-4b03-a82f-49b3acb74c4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:44.525316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4a5e3-543c-4b03-a82f-49b3acb74c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3dd4a5e3-543c-4b03-a82f-49b3acb74c4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:44.533538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:44.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:44.535757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:44.535757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:44.535757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:44.535757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:44.535757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:44.535757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:44.535757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:44.535757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:44.535757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:44.535757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:44.535757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:44.535757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:44.537826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 174/330] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:44.544400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4a5e3-543c-4b03-a82f-49b3acb74c4e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:44.574971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9c630-a6f9-4656-9dc7-6ecc4f812d79 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:44.609524 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15add1-e8f8-44c6-b346-787ebfa824b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:44.610347 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15add1-e8f8-44c6-b346-787ebfa824b1 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:44.610725 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15add1-e8f8-44c6-b346-787ebfa824b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:44.611071 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15add1-e8f8-44c6-b346-787ebfa824b1 None admin] PATH_INFO: `/v3/groups` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:44.611833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15add1-e8f8-44c6-b346-787ebfa824b1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:44.613280 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15add1-e8f8-44c6-b346-787ebfa824b1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:44.650398 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4a5e3-543c-4b03-a82f-49b3acb74c4e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:44.685601 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882e580-3b0f-48eb-bdfd-5bae60caaf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:44.686331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882e580-3b0f-48eb-bdfd-5bae60caaf72 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:44.686521 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882e580-3b0f-48eb-bdfd-5bae60caaf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:44.686790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882e580-3b0f-48eb-bdfd-5bae60caaf72 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:44.687589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882e580-3b0f-48eb-bdfd-5bae60caaf72 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:44.687887 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882e580-3b0f-48eb-bdfd-5bae60caaf72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:44.689244 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882e580-3b0f-48eb-bdfd-5bae60caaf72 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:44.698027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 175/331] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:44.701798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 157/332] 10.222.0.24 () {60 vars in 1134 bytes} [Tue May 17 21:49:44 2022] POST /identity/v3/groups => generated 226 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:49:44.703323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882e580-3b0f-48eb-bdfd-5bae60caaf72 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:44.814605 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882e580-3b0f-48eb-bdfd-5bae60caaf72 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:44.850936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee8802-06da-45fa-9ef8-ed6176998823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:44.851990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee8802-06da-45fa-9ef8-ed6176998823 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:44.852279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee8802-06da-45fa-9ef8-ed6176998823 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:44.852558 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee8802-06da-45fa-9ef8-ed6176998823 None admin] PATH_INFO: `/v3/users/1dfee748f98848958227ecc44c72c0fa` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:44.854088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee8802-06da-45fa-9ef8-ed6176998823 None admin] RBAC: Authorizing `identity:get_user(user_id=1dfee748f98848958227ecc44c72c0fa)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:44.855599 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee8802-06da-45fa-9ef8-ed6176998823 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:44.857676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 176/333] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:44 2022] GET /identity/v3/users/1dfee748f98848958227ecc44c72c0fa => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:44.863480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15add1-e8f8-44c6-b346-787ebfa824b1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:44.968012 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15add1-e8f8-44c6-b346-787ebfa824b1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:45.005122 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05da2a-f854-42d6-9180-6baa8194a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:45.005796 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05da2a-f854-42d6-9180-6baa8194a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:45.006082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05da2a-f854-42d6-9180-6baa8194a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:45.006357 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05da2a-f854-42d6-9180-6baa8194a8d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:45.007225 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05da2a-f854-42d6-9180-6baa8194a8d8 None admin] RBAC: Adding query filter params (role.id=5c8cdbb338e0490b90a50b0b915f9000, user.id=1dfee748f98848958227ecc44c72c0fa, scope.system=all) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:45.007545 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05da2a-f854-42d6-9180-6baa8194a8d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:45.008982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05da2a-f854-42d6-9180-6baa8194a8d8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:45.022084 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 158/334] 10.222.0.24 () {56 vars in 1308 bytes} [Tue May 17 21:49:44 2022] GET /identity/v3/role_assignments?user.id=1dfee748f98848958227ecc44c72c0fa&scope.system=all&role.id=5c8cdbb338e0490b90a50b0b915f9000 => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:46.872365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76851f89-fde3-4d77-9b15-6097cc7f5836 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:46.872941 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76851f89-fde3-4d77-9b15-6097cc7f5836 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:46.873204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76851f89-fde3-4d77-9b15-6097cc7f5836 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:46.874947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 177/335] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:46.880776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee112e3-f3ff-4800-8dc4-d8d260890c1b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:46.881221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee112e3-f3ff-4800-8dc4-d8d260890c1b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:46.881540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee112e3-f3ff-4800-8dc4-d8d260890c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:46.904639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cee112e3-f3ff-4800-8dc4-d8d260890c1b None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:46.905993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cee112e3-f3ff-4800-8dc4-d8d260890c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:46.993834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 159/336] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:47.028494 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76851f89-fde3-4d77-9b15-6097cc7f5836 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:47.133423 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76851f89-fde3-4d77-9b15-6097cc7f5836 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:47.170554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5110da-9222-420b-b4ca-136eda5269be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:47.171735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5110da-9222-420b-b4ca-136eda5269be None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:47.172222 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5110da-9222-420b-b4ca-136eda5269be None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:47.172694 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5110da-9222-420b-b4ca-136eda5269be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:47.183841 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5110da-9222-420b-b4ca-136eda5269be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-0c5110da-9222-420b-b4ca-136eda5269be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:47.191944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:47.192822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:47.193592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:47.193592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:47.193592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:47.193592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:47.193592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:47.193592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:47.193592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:47.193592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:47.193592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:47.193592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:47.193592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 21:49:47.193592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:47.195968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 178/337] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:47.204005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee112e3-f3ff-4800-8dc4-d8d260890c1b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:47.370449 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee112e3-f3ff-4800-8dc4-d8d260890c1b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:47.417052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda26af-a566-4b2c-b089-56c63c25c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:47.418070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda26af-a566-4b2c-b089-56c63c25c95d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:47.418563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda26af-a566-4b2c-b089-56c63c25c95d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:47.419030 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda26af-a566-4b2c-b089-56c63c25c95d None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:47.420027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda26af-a566-4b2c-b089-56c63c25c95d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:47.420527 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda26af-a566-4b2c-b089-56c63c25c95d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:47.422105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda26af-a566-4b2c-b089-56c63c25c95d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:47.435616 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 160/338] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:47.440687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5110da-9222-420b-b4ca-136eda5269be None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:47.574668 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5110da-9222-420b-b4ca-136eda5269be None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:47.610191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1247213-e14e-434f-938d-6b16f3106f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:47.611064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247213-e14e-434f-938d-6b16f3106f61 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:47.611368 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247213-e14e-434f-938d-6b16f3106f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:47.611640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247213-e14e-434f-938d-6b16f3106f61 None admin] PATH_INFO: `/v3/users/e7e8a209b06f4e23b04ade2ecfcc2783` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:47.612819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1247213-e14e-434f-938d-6b16f3106f61 None admin] RBAC: Authorizing `identity:get_user(user_id=e7e8a209b06f4e23b04ade2ecfcc2783)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:47.614266 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1247213-e14e-434f-938d-6b16f3106f61 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:47.616209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 179/339] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:49:47 2022] GET /identity/v3/users/e7e8a209b06f4e23b04ade2ecfcc2783 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:47.622632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda26af-a566-4b2c-b089-56c63c25c95d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:47.782753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda26af-a566-4b2c-b089-56c63c25c95d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:47.789808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615da7a-1443-4367-9113-e58b2276ad88 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:47.790388 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615da7a-1443-4367-9113-e58b2276ad88 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:47.790859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615da7a-1443-4367-9113-e58b2276ad88 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:47.792981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 180/340] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:47.805005 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d13c7-873f-4469-8be6-801347e63b9b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:47.805313 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d13c7-873f-4469-8be6-801347e63b9b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:47.805573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d13c7-873f-4469-8be6-801347e63b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:47.826604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960b49a-87ee-434e-95bc-02135b92736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:47.827198 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960b49a-87ee-434e-95bc-02135b92736f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:47.827484 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960b49a-87ee-434e-95bc-02135b92736f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:47.827762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960b49a-87ee-434e-95bc-02135b92736f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:47.828600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960b49a-87ee-434e-95bc-02135b92736f None admin] RBAC: Adding query filter params (role.id=2c87c506ab694d0a9cb77ab7383c7898, user.id=e7e8a209b06f4e23b04ade2ecfcc2783, scope.system=all) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:47.828914 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960b49a-87ee-434e-95bc-02135b92736f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:47.830350 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960b49a-87ee-434e-95bc-02135b92736f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:47.843231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 161/341] 10.222.0.24 () {56 vars in 1308 bytes} [Tue May 17 21:49:47 2022] GET /identity/v3/role_assignments?user.id=e7e8a209b06f4e23b04ade2ecfcc2783&scope.system=all&role.id=2c87c506ab694d0a9cb77ab7383c7898 => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:47.844224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-697d13c7-873f-4469-8be6-801347e63b9b None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:47.845695 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-697d13c7-873f-4469-8be6-801347e63b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:47.949997 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 181/342] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:47.988351 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47ca33-22bf-4deb-b50e-900044327d79 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:47.988861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47ca33-22bf-4deb-b50e-900044327d79 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:47.988968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47ca33-22bf-4deb-b50e-900044327d79 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:47.990315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 162/343] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:47.992010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d13c7-873f-4469-8be6-801347e63b9b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:48.012761 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d924ec-87d1-41a7-a62c-5ccb47314ad3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:48.013099 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d924ec-87d1-41a7-a62c-5ccb47314ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:48.013323 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d924ec-87d1-41a7-a62c-5ccb47314ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:48.043417 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c9d924ec-87d1-41a7-a62c-5ccb47314ad3 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:48.044640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c9d924ec-87d1-41a7-a62c-5ccb47314ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:48.149692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 163/344] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:48.151058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfd90b-5bcf-45a8-8cce-a8c7a2a11d48 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:48.151371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfd90b-5bcf-45a8-8cce-a8c7a2a11d48 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:48.151687 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfd90b-5bcf-45a8-8cce-a8c7a2a11d48 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:48.153472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 164/345] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:48.164770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b6750-952b-4144-871b-95d43dcf82cd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:48.165108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b6750-952b-4144-871b-95d43dcf82cd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:48.165318 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b6750-952b-4144-871b-95d43dcf82cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:48.174916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d13c7-873f-4469-8be6-801347e63b9b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:48.195426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-006b6750-952b-4144-871b-95d43dcf82cd None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:48.196817 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-006b6750-952b-4144-871b-95d43dcf82cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:48.219840 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c833f-092d-453c-b2a8-5291c27beefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:48.221088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c833f-092d-453c-b2a8-5291c27beefc None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:48.221794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c833f-092d-453c-b2a8-5291c27beefc None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:48.222204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c833f-092d-453c-b2a8-5291c27beefc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:48.235205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c833f-092d-453c-b2a8-5291c27beefc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-df0c833f-092d-453c-b2a8-5291c27beefc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:48.246315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:48.247501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:48.248407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:48.248407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:48.248407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:48.248407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:48.248407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:48.248407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:48.248407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:48.248407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:48.248407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:48.248407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:48.248407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:48.248407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:48.251007 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 182/346] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:49:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:48.252370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c833f-092d-453c-b2a8-5291c27beefc None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:48.283456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 165/347] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:48.284519 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b6750-952b-4144-871b-95d43dcf82cd None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:48.370919 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c833f-092d-453c-b2a8-5291c27beefc None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:48.406150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe901796-ec68-4d92-8419-976f24ce2d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:48.407231 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe901796-ec68-4d92-8419-976f24ce2d0f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:48.407644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe901796-ec68-4d92-8419-976f24ce2d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:48.409861 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe901796-ec68-4d92-8419-976f24ce2d0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:48.411250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b6750-952b-4144-871b-95d43dcf82cd None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:48.419216 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe901796-ec68-4d92-8419-976f24ce2d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-fe901796-ec68-4d92-8419-976f24ce2d0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:48.427655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:48.428541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:48.429331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:48.429331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:48.429331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:48.429331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:48.429331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:48.429331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:48.429331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:48.429331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:48.429331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:48.429331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:48.429331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:48.429331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:48.431696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 183/348] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:48.432800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe901796-ec68-4d92-8419-976f24ce2d0f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:48.450067 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be2a98-8c6f-4b6e-803d-2be3014b71be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:48.450874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be2a98-8c6f-4b6e-803d-2be3014b71be None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:48.451344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be2a98-8c6f-4b6e-803d-2be3014b71be None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:48.451639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be2a98-8c6f-4b6e-803d-2be3014b71be None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:48.452512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be2a98-8c6f-4b6e-803d-2be3014b71be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:48.452931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be2a98-8c6f-4b6e-803d-2be3014b71be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:48.454420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be2a98-8c6f-4b6e-803d-2be3014b71be None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:48.463622 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 166/349] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:49:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:48.464341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be2a98-8c6f-4b6e-803d-2be3014b71be None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:48.537039 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe901796-ec68-4d92-8419-976f24ce2d0f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:48.569797 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be2a98-8c6f-4b6e-803d-2be3014b71be None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:48.573217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a9c7d-9827-4b39-9ff7-95ce0247088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:48.574262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a9c7d-9827-4b39-9ff7-95ce0247088f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:48.574715 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a9c7d-9827-4b39-9ff7-95ce0247088f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:48.575184 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a9c7d-9827-4b39-9ff7-95ce0247088f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:48.586028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a9c7d-9827-4b39-9ff7-95ce0247088f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ba7a9c7d-9827-4b39-9ff7-95ce0247088f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:48.594392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:48.595367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:48.596324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:48.596324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:48.596324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:48.596324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:48.596324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:48.596324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:48.596324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:48.596324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:48.596324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:48.596324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:48.596324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:48.596324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:48.598230 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 184/350] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:48.599675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a9c7d-9827-4b39-9ff7-95ce0247088f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:48.607072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d6019-bf75-4bf9-a4bd-b553d0592eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:48.607885 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d6019-bf75-4bf9-a4bd-b553d0592eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:48.608172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d6019-bf75-4bf9-a4bd-b553d0592eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:48.608450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d6019-bf75-4bf9-a4bd-b553d0592eb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:48.609269 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d6019-bf75-4bf9-a4bd-b553d0592eb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:48.609578 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d6019-bf75-4bf9-a4bd-b553d0592eb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:48.612236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d6019-bf75-4bf9-a4bd-b553d0592eb6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:48.622330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 167/351] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:48.623161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d6019-bf75-4bf9-a4bd-b553d0592eb6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:48.704592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a9c7d-9827-4b39-9ff7-95ce0247088f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:48.729424 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d6019-bf75-4bf9-a4bd-b553d0592eb6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:48.738931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a7a37-1c38-47a2-a6d8-bb32316bdc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:48.739840 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a7a37-1c38-47a2-a6d8-bb32316bdc6f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:48.740291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a7a37-1c38-47a2-a6d8-bb32316bdc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:48.740729 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a7a37-1c38-47a2-a6d8-bb32316bdc6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:48.764273 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de23970-3a0f-4497-aad2-801de7f3e76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:48.764955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de23970-3a0f-4497-aad2-801de7f3e76f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:48.765244 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de23970-3a0f-4497-aad2-801de7f3e76f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:48.765526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de23970-3a0f-4497-aad2-801de7f3e76f None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:48.766282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de23970-3a0f-4497-aad2-801de7f3e76f None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:48.766594 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de23970-3a0f-4497-aad2-801de7f3e76f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:48.768056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de23970-3a0f-4497-aad2-801de7f3e76f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:48.778086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 168/352] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:48.779177 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de23970-3a0f-4497-aad2-801de7f3e76f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:48.812776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a7a37-1c38-47a2-a6d8-bb32316bdc6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:48.814525 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a7a37-1c38-47a2-a6d8-bb32316bdc6f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:48.884772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de23970-3a0f-4497-aad2-801de7f3e76f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:48.920004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 185/353] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:48.920591 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f66e11-8916-415c-bfa9-272966b8cdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:48.921327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f66e11-8916-415c-bfa9-272966b8cdff None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:48.921453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a7a37-1c38-47a2-a6d8-bb32316bdc6f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:48.921602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f66e11-8916-415c-bfa9-272966b8cdff None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:48.921883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f66e11-8916-415c-bfa9-272966b8cdff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:48.993328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f66e11-8916-415c-bfa9-272966b8cdff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:48.994959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f66e11-8916-415c-bfa9-272966b8cdff None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:49.027301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a7a37-1c38-47a2-a6d8-bb32316bdc6f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:49.062236 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af680ec2-63dd-413a-a968-5cd0ac502da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:49.063218 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af680ec2-63dd-413a-a968-5cd0ac502da4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:49.063669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af680ec2-63dd-413a-a968-5cd0ac502da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:49.064124 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af680ec2-63dd-413a-a968-5cd0ac502da4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:49.100113 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 169/354] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:49.101250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f66e11-8916-415c-bfa9-272966b8cdff None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:49.132804 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af680ec2-63dd-413a-a968-5cd0ac502da4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:49.134378 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af680ec2-63dd-413a-a968-5cd0ac502da4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:49.212230 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f66e11-8916-415c-bfa9-272966b8cdff None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:49.238921 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 186/355] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:49.239909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af680ec2-63dd-413a-a968-5cd0ac502da4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:49.255000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb08bf0-ce27-43bb-9d67-2d6b22bee9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:49.256162 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb08bf0-ce27-43bb-9d67-2d6b22bee9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:49.256594 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb08bf0-ce27-43bb-9d67-2d6b22bee9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:49.257034 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb08bf0-ce27-43bb-9d67-2d6b22bee9e7 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:49.258478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb08bf0-ce27-43bb-9d67-2d6b22bee9e7 None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:49.260695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb08bf0-ce27-43bb-9d67-2d6b22bee9e7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:49.262600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 170/356] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:49 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:49.263585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb08bf0-ce27-43bb-9d67-2d6b22bee9e7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:49.342806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af680ec2-63dd-413a-a968-5cd0ac502da4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:49.370575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb08bf0-ce27-43bb-9d67-2d6b22bee9e7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:49.376822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1dee2-0913-43e7-90db-b7fe94a2003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:49.377688 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1dee2-0913-43e7-90db-b7fe94a2003b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:49.377968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1dee2-0913-43e7-90db-b7fe94a2003b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:49.378239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1dee2-0913-43e7-90db-b7fe94a2003b None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:49.379722 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1dee2-0913-43e7-90db-b7fe94a2003b None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:49.380897 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1dee2-0913-43e7-90db-b7fe94a2003b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:49.382612 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 187/357] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:49 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:49.383388 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1dee2-0913-43e7-90db-b7fe94a2003b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:49.413932 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ebc04-a874-4447-b188-fa44aa3bab45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:49.415140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ebc04-a874-4447-b188-fa44aa3bab45 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:49.415612 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ebc04-a874-4447-b188-fa44aa3bab45 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:49.415890 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ebc04-a874-4447-b188-fa44aa3bab45 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:49.417157 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ebc04-a874-4447-b188-fa44aa3bab45 None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:49.418616 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ebc04-a874-4447-b188-fa44aa3bab45 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:49.420518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 171/358] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:49 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:49.421558 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b036c19-376f-4aaf-bcad-4c282fd9cf24 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:49.421844 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b036c19-376f-4aaf-bcad-4c282fd9cf24 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:49.422121 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b036c19-376f-4aaf-bcad-4c282fd9cf24 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:49.424042 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 172/359] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:49.424155 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b036c19-376f-4aaf-bcad-4c282fd9cf24 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:49.511740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1dee2-0913-43e7-90db-b7fe94a2003b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:49.556212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ac6bf-43a7-414f-8b90-475618b18b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:49.558673 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ac6bf-43a7-414f-8b90-475618b18b6d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:49.558955 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ac6bf-43a7-414f-8b90-475618b18b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:49.559280 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ac6bf-43a7-414f-8b90-475618b18b6d None admin] PATH_INFO: `/v3/groups/f1be240704f8403b9566dd73f52039b7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:49.559739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b036c19-376f-4aaf-bcad-4c282fd9cf24 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:49.569444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ac6bf-43a7-414f-8b90-475618b18b6d None admin] RBAC: Authorizing `identity:get_group(group_id=f1be240704f8403b9566dd73f52039b7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:49.571343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ac6bf-43a7-414f-8b90-475618b18b6d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:49.577174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 188/360] 10.222.0.24 () {56 vars in 1180 bytes} [Tue May 17 21:49:49 2022] GET /identity/v3/groups/f1be240704f8403b9566dd73f52039b7 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:49.578805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ac6bf-43a7-414f-8b90-475618b18b6d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:49.610506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849bbd5-6bcd-490a-bfe0-c43aa7900626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:49.611789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849bbd5-6bcd-490a-bfe0-c43aa7900626 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:49.612072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849bbd5-6bcd-490a-bfe0-c43aa7900626 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:49.612348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849bbd5-6bcd-490a-bfe0-c43aa7900626 None admin] PATH_INFO: `/v3/groups/f1be240704f8403b9566dd73f52039b7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:49.613555 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849bbd5-6bcd-490a-bfe0-c43aa7900626 None admin] RBAC: Authorizing `identity:get_group(group_id=f1be240704f8403b9566dd73f52039b7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:49.614982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849bbd5-6bcd-490a-bfe0-c43aa7900626 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:49.616824 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 173/361] 10.222.0.24 () {56 vars in 1180 bytes} [Tue May 17 21:49:49 2022] GET /identity/v3/groups/f1be240704f8403b9566dd73f52039b7 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:49.617943 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd73ca1-7ae2-4ed0-873c-8e86def10637 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:49.618231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd73ca1-7ae2-4ed0-873c-8e86def10637 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:49.618506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd73ca1-7ae2-4ed0-873c-8e86def10637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:49.636488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6bd73ca1-7ae2-4ed0-873c-8e86def10637 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:49.640499 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6bd73ca1-7ae2-4ed0-873c-8e86def10637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:49.718386 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ac6bf-43a7-414f-8b90-475618b18b6d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:49.726201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 174/362] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:49.727725 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd73ca1-7ae2-4ed0-873c-8e86def10637 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:49.763311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a0391-3742-4a57-acfb-55627e688f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:49.764192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a0391-3742-4a57-acfb-55627e688f6f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:49.764477 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a0391-3742-4a57-acfb-55627e688f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:49.765432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a0391-3742-4a57-acfb-55627e688f6f None admin] PATH_INFO: `/v3/groups/f1be240704f8403b9566dd73f52039b7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:49.766897 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a0391-3742-4a57-acfb-55627e688f6f None admin] RBAC: Authorizing `identity:get_group(group_id=f1be240704f8403b9566dd73f52039b7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:49.767678 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a0391-3742-4a57-acfb-55627e688f6f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:49.769470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 189/363] 10.222.0.24 () {56 vars in 1180 bytes} [Tue May 17 21:49:49 2022] GET /identity/v3/groups/f1be240704f8403b9566dd73f52039b7 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:49.770060 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a0391-3742-4a57-acfb-55627e688f6f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:49.839568 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd73ca1-7ae2-4ed0-873c-8e86def10637 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:49.878461 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336582e-2ce4-4bd6-8ab7-aef6bfc30530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:49.878660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336582e-2ce4-4bd6-8ab7-aef6bfc30530 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:49.878920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336582e-2ce4-4bd6-8ab7-aef6bfc30530 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:49.879267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336582e-2ce4-4bd6-8ab7-aef6bfc30530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:49.880106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336582e-2ce4-4bd6-8ab7-aef6bfc30530 None admin] RBAC: Adding query filter params (group.id=f1be240704f8403b9566dd73f52039b7, role.id=e5fee74fe53d429897caab84ecf4e5d9, scope.project.id=2be755a8e5a94fffa1b804fb26b77a19) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:49.880417 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336582e-2ce4-4bd6-8ab7-aef6bfc30530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:49.881850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336582e-2ce4-4bd6-8ab7-aef6bfc30530 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:49.888436 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a0391-3742-4a57-acfb-55627e688f6f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:49.888613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 175/364] 10.222.0.24 () {56 vars in 1376 bytes} [Tue May 17 21:49:49 2022] GET /identity/v3/role_assignments?group.id=f1be240704f8403b9566dd73f52039b7&scope.project.id=2be755a8e5a94fffa1b804fb26b77a19&role.id=e5fee74fe53d429897caab84ecf4e5d9 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:49.889446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336582e-2ce4-4bd6-8ab7-aef6bfc30530 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:49.941986 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea58c7b-b227-49c4-8258-d04cca154224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:49.942711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea58c7b-b227-49c4-8258-d04cca154224 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:49.942996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea58c7b-b227-49c4-8258-d04cca154224 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:49.943323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea58c7b-b227-49c4-8258-d04cca154224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:49.944164 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea58c7b-b227-49c4-8258-d04cca154224 None admin] RBAC: Adding query filter params (group.id=f1be240704f8403b9566dd73f52039b7, role.id=5c8cdbb338e0490b90a50b0b915f9000, scope.project.id=2be755a8e5a94fffa1b804fb26b77a19) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:49.944470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea58c7b-b227-49c4-8258-d04cca154224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:49.945927 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea58c7b-b227-49c4-8258-d04cca154224 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:49.953541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 190/365] 10.222.0.24 () {56 vars in 1376 bytes} [Tue May 17 21:49:49 2022] GET /identity/v3/role_assignments?group.id=f1be240704f8403b9566dd73f52039b7&scope.project.id=2be755a8e5a94fffa1b804fb26b77a19&role.id=5c8cdbb338e0490b90a50b0b915f9000 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:49.953976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aeb38-06f6-4604-aaa4-1d2891cf47f2 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:49.954232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aeb38-06f6-4604-aaa4-1d2891cf47f2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:49.955984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aeb38-06f6-4604-aaa4-1d2891cf47f2 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:49.960446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 191/366] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:49.961577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aeb38-06f6-4604-aaa4-1d2891cf47f2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:50.032998 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336582e-2ce4-4bd6-8ab7-aef6bfc30530 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:50.075000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5703c-0420-4cd2-9487-45f87e3f2580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:50.075873 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5703c-0420-4cd2-9487-45f87e3f2580 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:50.076154 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5703c-0420-4cd2-9487-45f87e3f2580 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:50.076425 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5703c-0420-4cd2-9487-45f87e3f2580 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:50.089034 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5703c-0420-4cd2-9487-45f87e3f2580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:50.089885 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aeb38-06f6-4604-aaa4-1d2891cf47f2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-78c5703c-0420-4cd2-9487-45f87e3f2580 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:50.098642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:50.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:50.100433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:50.100433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:50.100433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:50.100433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:50.100433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:50.100433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:50.100433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:50.100433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:50.100433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:50.100433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:50.100433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:50.100433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:50.100433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 176/367] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:49:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:50.101589 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a6e7c-f923-40a8-b47c-99c7ab3a8f29 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:50.101589 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a6e7c-f923-40a8-b47c-99c7ab3a8f29 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:50.101865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a6e7c-f923-40a8-b47c-99c7ab3a8f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:50.121067 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0a8a6e7c-f923-40a8-b47c-99c7ab3a8f29 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:50.122276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0a8a6e7c-f923-40a8-b47c-99c7ab3a8f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:50.136428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97726a0a-d7c6-45a6-a2cc-f4fe1a99bb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:50.137114 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97726a0a-d7c6-45a6-a2cc-f4fe1a99bb96 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:50.137399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97726a0a-d7c6-45a6-a2cc-f4fe1a99bb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:50.137679 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97726a0a-d7c6-45a6-a2cc-f4fe1a99bb96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:50.138534 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97726a0a-d7c6-45a6-a2cc-f4fe1a99bb96 None admin] RBAC: Adding query filter params (group.id=f1be240704f8403b9566dd73f52039b7, role.id=5c8cdbb338e0490b90a50b0b915f9000, scope.project.id=9a832f072c654c648482fe86fd6b1ca1) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:50.138853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97726a0a-d7c6-45a6-a2cc-f4fe1a99bb96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:50.140382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97726a0a-d7c6-45a6-a2cc-f4fe1a99bb96 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:50.147440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 192/368] 10.222.0.24 () {56 vars in 1376 bytes} [Tue May 17 21:49:49 2022] GET /identity/v3/role_assignments?group.id=f1be240704f8403b9566dd73f52039b7&scope.project.id=9a832f072c654c648482fe86fd6b1ca1&role.id=5c8cdbb338e0490b90a50b0b915f9000 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:50.151145 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97726a0a-d7c6-45a6-a2cc-f4fe1a99bb96 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:50.218611 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 177/369] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:50.244072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a6e7c-f923-40a8-b47c-99c7ab3a8f29 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:50.262096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97726a0a-d7c6-45a6-a2cc-f4fe1a99bb96 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:50.298202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc3ff5-46a2-4ace-bc72-0748c258cb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:50.298877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc3ff5-46a2-4ace-bc72-0748c258cb0c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:50.299186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc3ff5-46a2-4ace-bc72-0748c258cb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:50.299470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc3ff5-46a2-4ace-bc72-0748c258cb0c None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:50.300226 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc3ff5-46a2-4ace-bc72-0748c258cb0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:50.300533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc3ff5-46a2-4ace-bc72-0748c258cb0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:50.302215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc3ff5-46a2-4ace-bc72-0748c258cb0c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:50.311814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 193/370] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:49:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:50.317356 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc3ff5-46a2-4ace-bc72-0748c258cb0c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:50.356963 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a6e7c-f923-40a8-b47c-99c7ab3a8f29 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:50.394216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460e55a-51c6-42df-8ca8-7af64cc5fa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:50.395413 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460e55a-51c6-42df-8ca8-7af64cc5fa73 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:50.395868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460e55a-51c6-42df-8ca8-7af64cc5fa73 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:50.396310 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460e55a-51c6-42df-8ca8-7af64cc5fa73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:50.420228 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460e55a-51c6-42df-8ca8-7af64cc5fa73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:50.424733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc3ff5-46a2-4ace-bc72-0748c258cb0c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2460e55a-51c6-42df-8ca8-7af64cc5fa73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:50.429263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:50.430202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:50.430980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:50.430980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:50.430980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:50.430980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:50.430980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:50.430980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:50.430980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:50.430980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:50.430980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:50.430980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:50.430980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:50.430980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:50.437475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 178/371] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:49:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:49:50.443539 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460e55a-51c6-42df-8ca8-7af64cc5fa73 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:50.462512 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b275add-b178-496d-99f2-f57aead27acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:50.463764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b275add-b178-496d-99f2-f57aead27acf None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:50.464657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b275add-b178-496d-99f2-f57aead27acf None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:50.464657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b275add-b178-496d-99f2-f57aead27acf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:50.535856 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b275add-b178-496d-99f2-f57aead27acf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:50.537334 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b275add-b178-496d-99f2-f57aead27acf None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:50.594414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460e55a-51c6-42df-8ca8-7af64cc5fa73 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:50.645953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 194/372] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:50.649894 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334f8c8-64f7-4008-ad54-e980cba20b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:50.650932 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334f8c8-64f7-4008-ad54-e980cba20b52 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:50.651314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334f8c8-64f7-4008-ad54-e980cba20b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:50.651597 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334f8c8-64f7-4008-ad54-e980cba20b52 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:50.652022 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b275add-b178-496d-99f2-f57aead27acf None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:50.652363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334f8c8-64f7-4008-ad54-e980cba20b52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:50.652670 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334f8c8-64f7-4008-ad54-e980cba20b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:50.654068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334f8c8-64f7-4008-ad54-e980cba20b52 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:50.671845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 179/373] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:50.677433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334f8c8-64f7-4008-ad54-e980cba20b52 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:50.754376 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b275add-b178-496d-99f2-f57aead27acf None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:50.790619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712ca40-dbab-417f-8baa-480582a315b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:50.792086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712ca40-dbab-417f-8baa-480582a315b9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:50.792402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712ca40-dbab-417f-8baa-480582a315b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:50.792679 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712ca40-dbab-417f-8baa-480582a315b9 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:50.793912 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712ca40-dbab-417f-8baa-480582a315b9 None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:50.795386 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712ca40-dbab-417f-8baa-480582a315b9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:50.797398 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 195/374] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:50 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:50.803229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712ca40-dbab-417f-8baa-480582a315b9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:50.908015 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712ca40-dbab-417f-8baa-480582a315b9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:50.921237 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334f8c8-64f7-4008-ad54-e980cba20b52 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:50.952641 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e741b71-7898-49b7-b43c-9b6e4f7cf3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:50.953852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741b71-7898-49b7-b43c-9b6e4f7cf3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:50.955241 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741b71-7898-49b7-b43c-9b6e4f7cf3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:50.957176 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741b71-7898-49b7-b43c-9b6e4f7cf3c7 None admin] PATH_INFO: `/v3/groups/f1be240704f8403b9566dd73f52039b7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:50.959568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e741b71-7898-49b7-b43c-9b6e4f7cf3c7 None admin] RBAC: Authorizing `identity:get_group(group_id=f1be240704f8403b9566dd73f52039b7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:50.961253 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e741b71-7898-49b7-b43c-9b6e4f7cf3c7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:50.966972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 196/375] 10.222.0.24 () {56 vars in 1180 bytes} [Tue May 17 21:49:50 2022] GET /identity/v3/groups/f1be240704f8403b9566dd73f52039b7 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:50.972581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e741b71-7898-49b7-b43c-9b6e4f7cf3c7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:50.996929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f9c61-3861-44e9-85f6-6b89ed7ba556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:50.997950 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f9c61-3861-44e9-85f6-6b89ed7ba556 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:51.000061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f9c61-3861-44e9-85f6-6b89ed7ba556 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:51.000544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f9c61-3861-44e9-85f6-6b89ed7ba556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:51.134819 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f9c61-3861-44e9-85f6-6b89ed7ba556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:51.137433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f9c61-3861-44e9-85f6-6b89ed7ba556 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:51.153725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e741b71-7898-49b7-b43c-9b6e4f7cf3c7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:51.195025 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b6c2e-a00b-482c-9277-7a6e3f154105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:51.195866 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6c2e-a00b-482c-9277-7a6e3f154105 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:51.196240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6c2e-a00b-482c-9277-7a6e3f154105 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:51.196664 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6c2e-a00b-482c-9277-7a6e3f154105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:51.198189 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b6c2e-a00b-482c-9277-7a6e3f154105 None admin] RBAC: Adding query filter params (group.id=f1be240704f8403b9566dd73f52039b7, role.id=e5fee74fe53d429897caab84ecf4e5d9, scope.project.id=9a832f072c654c648482fe86fd6b1ca1) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:51.198662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b6c2e-a00b-482c-9277-7a6e3f154105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:51.200258 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b6c2e-a00b-482c-9277-7a6e3f154105 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:51.206793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 197/376] 10.222.0.24 () {56 vars in 1376 bytes} [Tue May 17 21:49:50 2022] GET /identity/v3/role_assignments?group.id=f1be240704f8403b9566dd73f52039b7&scope.project.id=9a832f072c654c648482fe86fd6b1ca1&role.id=e5fee74fe53d429897caab84ecf4e5d9 => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:51.265998 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 180/377] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 21:49:51.271959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b6c2e-a00b-482c-9277-7a6e3f154105 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:51.403222 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b6c2e-a00b-482c-9277-7a6e3f154105 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:51.439872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3782825-ccca-4294-8ed6-dc6c1bbaf84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:51.440647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3782825-ccca-4294-8ed6-dc6c1bbaf84d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:51.440925 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3782825-ccca-4294-8ed6-dc6c1bbaf84d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:51.441193 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3782825-ccca-4294-8ed6-dc6c1bbaf84d None admin] PATH_INFO: `/v3/projects/52a8a72ae1784555b539c1867c54411c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:51.445625 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3782825-ccca-4294-8ed6-dc6c1bbaf84d None admin] RBAC: Authorizing `identity:get_project(project_id=52a8a72ae1784555b539c1867c54411c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:51.447078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3782825-ccca-4294-8ed6-dc6c1bbaf84d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:51.450228 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 198/378] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:51 2022] GET /identity/v3/projects/52a8a72ae1784555b539c1867c54411c => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:51.457873 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f9c61-3861-44e9-85f6-6b89ed7ba556 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:51.592678 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f9c61-3861-44e9-85f6-6b89ed7ba556 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:51.628199 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81a4ac-8d89-48be-b011-9391741424cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:51.629115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81a4ac-8d89-48be-b011-9391741424cd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:51.629398 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81a4ac-8d89-48be-b011-9391741424cd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:51.629712 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81a4ac-8d89-48be-b011-9391741424cd None admin] PATH_INFO: `/v3/groups/2cc2ef94e0a8476dacc05f0828d7fe8e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:51.636103 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81a4ac-8d89-48be-b011-9391741424cd None admin] RBAC: Authorizing `identity:get_group(group_id=2cc2ef94e0a8476dacc05f0828d7fe8e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:51.637538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81a4ac-8d89-48be-b011-9391741424cd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:51.639521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 181/379] 10.222.0.24 () {56 vars in 1180 bytes} [Tue May 17 21:49:51 2022] GET /identity/v3/groups/2cc2ef94e0a8476dacc05f0828d7fe8e => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:51.646059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3782825-ccca-4294-8ed6-dc6c1bbaf84d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:51.756144 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3782825-ccca-4294-8ed6-dc6c1bbaf84d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:51.794474 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87758b15-e9df-4bd7-bd80-d04b2372e992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:51.795214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87758b15-e9df-4bd7-bd80-d04b2372e992 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:51.795495 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87758b15-e9df-4bd7-bd80-d04b2372e992 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:51.795808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87758b15-e9df-4bd7-bd80-d04b2372e992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:51.796632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87758b15-e9df-4bd7-bd80-d04b2372e992 None admin] RBAC: Adding query filter params (group.id=2cc2ef94e0a8476dacc05f0828d7fe8e, role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=52a8a72ae1784555b539c1867c54411c) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:51.796940 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87758b15-e9df-4bd7-bd80-d04b2372e992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:51.798367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87758b15-e9df-4bd7-bd80-d04b2372e992 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:51.804772 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 199/380] 10.222.0.24 () {56 vars in 1376 bytes} [Tue May 17 21:49:51 2022] GET /identity/v3/role_assignments?group.id=2cc2ef94e0a8476dacc05f0828d7fe8e&scope.project.id=52a8a72ae1784555b539c1867c54411c&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:52.836323 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646c65c-4066-448e-885a-d72c67b30656 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:52.837063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646c65c-4066-448e-885a-d72c67b30656 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:52.837063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646c65c-4066-448e-885a-d72c67b30656 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:52.839356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 182/381] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:52.845863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57501878-b40b-4786-8832-897044032b7d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:52.846800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57501878-b40b-4786-8832-897044032b7d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:52.847355 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57501878-b40b-4786-8832-897044032b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:52.876327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-57501878-b40b-4786-8832-897044032b7d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:52.877935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-57501878-b40b-4786-8832-897044032b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:52.971136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 200/382] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:53.004998 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646c65c-4066-448e-885a-d72c67b30656 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:53.090576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cf504-3ab6-43e4-98f6-ceb1a96cc472 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:53.090884 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cf504-3ab6-43e4-98f6-ceb1a96cc472 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:53.091073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cf504-3ab6-43e4-98f6-ceb1a96cc472 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:53.092627 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 201/383] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:53.099319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9fbf3-726b-4ed9-bdf9-71978b72773a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:53.100654 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9fbf3-726b-4ed9-bdf9-71978b72773a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:53.101145 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9fbf3-726b-4ed9-bdf9-71978b72773a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:53.124207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d8c9fbf3-726b-4ed9-bdf9-71978b72773a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:53.126686 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d8c9fbf3-726b-4ed9-bdf9-71978b72773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:53.142791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646c65c-4066-448e-885a-d72c67b30656 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:53.218490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ca8c6-655c-4293-9fd8-6e9e3340aa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:53.220046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ca8c6-655c-4293-9fd8-6e9e3340aa69 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:53.220539 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ca8c6-655c-4293-9fd8-6e9e3340aa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:53.221014 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ca8c6-655c-4293-9fd8-6e9e3340aa69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:53.241513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ca8c6-655c-4293-9fd8-6e9e3340aa69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6c8ca8c6-655c-4293-9fd8-6e9e3340aa69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:53.251776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:53.252653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:53.253523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:53.253523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:53.253523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:53.253523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:53.253523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:53.253523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:53.253523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:53.253523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:53.253523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:53.253523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:53.253523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:53.253523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:53.266096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 183/384] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:49:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:53.268968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ca8c6-655c-4293-9fd8-6e9e3340aa69 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:53.270843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 202/385] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:53.383727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7089dd0-2284-4df6-aba5-af272c06950c None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:53.384329 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7089dd0-2284-4df6-aba5-af272c06950c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:53.384865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7089dd0-2284-4df6-aba5-af272c06950c None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:53.387441 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 203/386] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:49:53.388599 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7089dd0-2284-4df6-aba5-af272c06950c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:53.405077 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ca8c6-655c-4293-9fd8-6e9e3340aa69 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:53.450416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9624dd2-4eec-4d4d-a3c8-2f3219ebaf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:53.451262 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9624dd2-4eec-4d4d-a3c8-2f3219ebaf70 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:53.451544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9624dd2-4eec-4d4d-a3c8-2f3219ebaf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:53.451816 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9624dd2-4eec-4d4d-a3c8-2f3219ebaf70 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:53.452565 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9624dd2-4eec-4d4d-a3c8-2f3219ebaf70 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:53.452869 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9624dd2-4eec-4d4d-a3c8-2f3219ebaf70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:53.454791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9624dd2-4eec-4d4d-a3c8-2f3219ebaf70 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:53.466025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 184/387] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:49:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:53.467701 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f6042-cad6-4af6-9f6e-617bb3284045 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:53.467988 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f6042-cad6-4af6-9f6e-617bb3284045 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:53.468261 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f6042-cad6-4af6-9f6e-617bb3284045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:53.489814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c55f6042-cad6-4af6-9f6e-617bb3284045 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:53.490992 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c55f6042-cad6-4af6-9f6e-617bb3284045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:53.534979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7089dd0-2284-4df6-aba5-af272c06950c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:53.574479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a4768-9947-4ec8-9c80-88f973f47474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:53.575334 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a4768-9947-4ec8-9c80-88f973f47474 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:53.575696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a4768-9947-4ec8-9c80-88f973f47474 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:53.575936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a4768-9947-4ec8-9c80-88f973f47474 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:53.590626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 185/388] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:53.591960 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f6042-cad6-4af6-9f6e-617bb3284045 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:53.595877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a4768-9947-4ec8-9c80-88f973f47474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-cd3a4768-9947-4ec8-9c80-88f973f47474 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:53.604801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:53.605709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:53.606944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:53.606944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:53.606944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:53.606944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:53.606944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:53.606944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:53.606944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:53.606944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:53.606944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:53.606944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:53.606944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:53.606944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:53.606944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 204/389] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:53.612006 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a4768-9947-4ec8-9c80-88f973f47474 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:53.717316 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f6042-cad6-4af6-9f6e-617bb3284045 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:53.733084 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a4768-9947-4ec8-9c80-88f973f47474 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:53.760403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0615d-fb20-47b6-8ff5-596a9160acce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:53.762143 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0615d-fb20-47b6-8ff5-596a9160acce None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:53.762634 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0615d-fb20-47b6-8ff5-596a9160acce None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:53.763270 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0615d-fb20-47b6-8ff5-596a9160acce None admin] PATH_INFO: `/v3/groups/f1be240704f8403b9566dd73f52039b7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:53.764958 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0615d-fb20-47b6-8ff5-596a9160acce None admin] RBAC: Authorizing `identity:get_group(group_id=f1be240704f8403b9566dd73f52039b7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:53.766987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0615d-fb20-47b6-8ff5-596a9160acce None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:53.769673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 186/390] 10.222.0.24 () {56 vars in 1180 bytes} [Tue May 17 21:49:53 2022] GET /identity/v3/groups/f1be240704f8403b9566dd73f52039b7 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:53.770669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0615d-fb20-47b6-8ff5-596a9160acce None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:53.772291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de964140-ce79-48fd-afe2-d8712e448a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:53.773059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de964140-ce79-48fd-afe2-d8712e448a3e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:53.773433 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de964140-ce79-48fd-afe2-d8712e448a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:53.773875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de964140-ce79-48fd-afe2-d8712e448a3e None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:53.775597 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de964140-ce79-48fd-afe2-d8712e448a3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:53.775597 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de964140-ce79-48fd-afe2-d8712e448a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:53.776713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de964140-ce79-48fd-afe2-d8712e448a3e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:53.785522 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 205/391] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:53.792479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de964140-ce79-48fd-afe2-d8712e448a3e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:53.894401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0615d-fb20-47b6-8ff5-596a9160acce None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:53.921905 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de964140-ce79-48fd-afe2-d8712e448a3e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:53.938282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce70b8-1e22-4a5e-97f5-5c3cd7d5001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:53.939282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce70b8-1e22-4a5e-97f5-5c3cd7d5001f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:53.939727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce70b8-1e22-4a5e-97f5-5c3cd7d5001f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:53.940086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce70b8-1e22-4a5e-97f5-5c3cd7d5001f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:53.961584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce70b8-1e22-4a5e-97f5-5c3cd7d5001f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:53.965377 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893ddc2-299e-4876-af23-b05165a7ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:53.966407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893ddc2-299e-4876-af23-b05165a7ca99 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:53.966859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893ddc2-299e-4876-af23-b05165a7ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:53.967370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893ddc2-299e-4876-af23-b05165a7ca99 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:53.968710 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893ddc2-299e-4876-af23-b05165a7ca99 None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:53.970296 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893ddc2-299e-4876-af23-b05165a7ca99 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-76ce70b8-1e22-4a5e-97f5-5c3cd7d5001f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:53.971000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:53.971946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:53.972737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:53.972737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:53.972737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:53.972737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:53.972737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:53.972737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:53.972737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:53.972737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:53.972737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:53.972737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:53.972737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:53.972737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:53.972737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 187/392] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:53.973384 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce70b8-1e22-4a5e-97f5-5c3cd7d5001f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:53.975700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 206/393] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:53 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:53.980999 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893ddc2-299e-4876-af23-b05165a7ca99 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:54.085433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce70b8-1e22-4a5e-97f5-5c3cd7d5001f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:54.092886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893ddc2-299e-4876-af23-b05165a7ca99 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:54.132533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bd177-4791-4d9e-ab51-1cffe880c958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:54.133419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bd177-4791-4d9e-ab51-1cffe880c958 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:54.133700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bd177-4791-4d9e-ab51-1cffe880c958 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:54.133971 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bd177-4791-4d9e-ab51-1cffe880c958 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19/groups/f1be240704f8403b9566dd73f52039b7/roles/e5fee74fe53d429897caab84ecf4e5d9` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:54.137059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30bd177-4791-4d9e-ab51-1cffe880c958 None admin] RBAC: Authorizing `identity:create_grant(project_id=2be755a8e5a94fffa1b804fb26b77a19, group_id=f1be240704f8403b9566dd73f52039b7, role_id=e5fee74fe53d429897caab84ecf4e5d9)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:54.138428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c24ff1-83d0-403a-ad93-8442fe5ad618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:54.139223 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30bd177-4791-4d9e-ab51-1cffe880c958 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:54.139885 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c24ff1-83d0-403a-ad93-8442fe5ad618 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:54.140397 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c24ff1-83d0-403a-ad93-8442fe5ad618 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:54.140860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c24ff1-83d0-403a-ad93-8442fe5ad618 None admin] PATH_INFO: `/v3/groups/f1be240704f8403b9566dd73f52039b7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:54.142196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c24ff1-83d0-403a-ad93-8442fe5ad618 None admin] RBAC: Authorizing `identity:get_group(group_id=f1be240704f8403b9566dd73f52039b7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:54.146284 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c24ff1-83d0-403a-ad93-8442fe5ad618 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:54.146976 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 188/394] 10.222.0.24 () {56 vars in 1180 bytes} [Tue May 17 21:49:53 2022] GET /identity/v3/groups/f1be240704f8403b9566dd73f52039b7 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:54.151287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c24ff1-83d0-403a-ad93-8442fe5ad618 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:54.232214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 207/395] 10.222.0.24 () {58 vars in 1442 bytes} [Tue May 17 21:49:53 2022] PUT /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19/groups/f1be240704f8403b9566dd73f52039b7/roles/e5fee74fe53d429897caab84ecf4e5d9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:49:54.233944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5851d0-2e0c-4cf0-a5e9-a90d0f6cb186 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:54.234428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5851d0-2e0c-4cf0-a5e9-a90d0f6cb186 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:54.234915 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5851d0-2e0c-4cf0-a5e9-a90d0f6cb186 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:54.236662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 208/396] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:54.237649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5851d0-2e0c-4cf0-a5e9-a90d0f6cb186 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:54.277128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c24ff1-83d0-403a-ad93-8442fe5ad618 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:54.325068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b36a1-cde3-4396-9807-13b940f8e239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:54.326154 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b36a1-cde3-4396-9807-13b940f8e239 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:54.326632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b36a1-cde3-4396-9807-13b940f8e239 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:54.327327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b36a1-cde3-4396-9807-13b940f8e239 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:54.328921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b36a1-cde3-4396-9807-13b940f8e239 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:54.329674 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b36a1-cde3-4396-9807-13b940f8e239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:54.331600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b36a1-cde3-4396-9807-13b940f8e239 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:54.344556 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 189/397] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:54.346307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f94fc-aee3-4f27-988c-22b97bb42bcd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:54.346818 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f94fc-aee3-4f27-988c-22b97bb42bcd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:54.351668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f94fc-aee3-4f27-988c-22b97bb42bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:54.370296 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-049f94fc-aee3-4f27-988c-22b97bb42bcd None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:54.371895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-049f94fc-aee3-4f27-988c-22b97bb42bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:54.373775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5851d0-2e0c-4cf0-a5e9-a90d0f6cb186 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:54.411751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472b7e3-65fe-467d-8713-688c102bb8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:54.412680 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472b7e3-65fe-467d-8713-688c102bb8ca None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:54.412958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472b7e3-65fe-467d-8713-688c102bb8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:54.413232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472b7e3-65fe-467d-8713-688c102bb8ca None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:54.415654 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472b7e3-65fe-467d-8713-688c102bb8ca None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:54.417663 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472b7e3-65fe-467d-8713-688c102bb8ca None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:54.419502 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 209/398] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:54 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:54.420323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472b7e3-65fe-467d-8713-688c102bb8ca None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:54.453475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 190/399] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:54.454665 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f94fc-aee3-4f27-988c-22b97bb42bcd None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:54.554082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472b7e3-65fe-467d-8713-688c102bb8ca None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:54.588247 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f94fc-aee3-4f27-988c-22b97bb42bcd None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:54.591654 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b3108-9a77-43fd-a9e0-1b67513d4f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:54.592515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b3108-9a77-43fd-a9e0-1b67513d4f67 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:54.592798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b3108-9a77-43fd-a9e0-1b67513d4f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:54.593074 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b3108-9a77-43fd-a9e0-1b67513d4f67 None admin] PATH_INFO: `/v3/groups/f1be240704f8403b9566dd73f52039b7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:54.594278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b3108-9a77-43fd-a9e0-1b67513d4f67 None admin] RBAC: Authorizing `identity:get_group(group_id=f1be240704f8403b9566dd73f52039b7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:54.595761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b3108-9a77-43fd-a9e0-1b67513d4f67 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:54.597387 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 210/400] 10.222.0.24 () {56 vars in 1180 bytes} [Tue May 17 21:49:54 2022] GET /identity/v3/groups/f1be240704f8403b9566dd73f52039b7 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:54.598147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b3108-9a77-43fd-a9e0-1b67513d4f67 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:54.628314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc8ba6-beab-4055-b122-99b0219a5fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:54.629767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc8ba6-beab-4055-b122-99b0219a5fc8 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:54.630049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc8ba6-beab-4055-b122-99b0219a5fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:54.630326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc8ba6-beab-4055-b122-99b0219a5fc8 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19/groups/f1be240704f8403b9566dd73f52039b7/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:54.633066 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc8ba6-beab-4055-b122-99b0219a5fc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2be755a8e5a94fffa1b804fb26b77a19, group_id=f1be240704f8403b9566dd73f52039b7, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:54.634575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc8ba6-beab-4055-b122-99b0219a5fc8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:54.700960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b3108-9a77-43fd-a9e0-1b67513d4f67 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:54.712557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 191/401] 10.222.0.24 () {58 vars in 1442 bytes} [Tue May 17 21:49:54 2022] PUT /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19/groups/f1be240704f8403b9566dd73f52039b7/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:49:54.713369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc8ba6-beab-4055-b122-99b0219a5fc8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:54.758787 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af15dc-1c17-4c10-8706-6d226d4a60f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:54.761034 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af15dc-1c17-4c10-8706-6d226d4a60f6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:54.761317 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af15dc-1c17-4c10-8706-6d226d4a60f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:54.761719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af15dc-1c17-4c10-8706-6d226d4a60f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:54.777274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af15dc-1c17-4c10-8706-6d226d4a60f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-52af15dc-1c17-4c10-8706-6d226d4a60f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:54.788968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:54.789939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:54.790714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:54.790714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:54.790714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:54.790714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:54.790714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:54.790714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:54.790714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:54.790714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:54.790714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:54.790714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:54.790714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:54.790714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:54.790714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 211/402] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:49:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:54.792517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6687159-ff55-485a-8682-71bdac994c90 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:54.794952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6687159-ff55-485a-8682-71bdac994c90 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:54.794952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6687159-ff55-485a-8682-71bdac994c90 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:54.794952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 212/403] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:54.797762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6687159-ff55-485a-8682-71bdac994c90 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:54.832319 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc8ba6-beab-4055-b122-99b0219a5fc8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:54.873767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd513c-60f1-431f-a846-9aea34a63330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:54.874660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd513c-60f1-431f-a846-9aea34a63330 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:54.874944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd513c-60f1-431f-a846-9aea34a63330 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:54.875261 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd513c-60f1-431f-a846-9aea34a63330 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:54.876550 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd513c-60f1-431f-a846-9aea34a63330 None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:54.878023 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd513c-60f1-431f-a846-9aea34a63330 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:54.884878 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 192/404] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:54 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:54.886459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e042ce0-198f-4467-ba68-5be15dc277d2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:54.886689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e042ce0-198f-4467-ba68-5be15dc277d2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:54.886972 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e042ce0-198f-4467-ba68-5be15dc277d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:54.905507 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8e042ce0-198f-4467-ba68-5be15dc277d2 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:54.906685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e042ce0-198f-4467-ba68-5be15dc277d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:54.926495 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6687159-ff55-485a-8682-71bdac994c90 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:54.973869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6e3e9-8c63-4797-85e0-f75980004026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:54.974598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6e3e9-8c63-4797-85e0-f75980004026 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:54.974880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6e3e9-8c63-4797-85e0-f75980004026 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:54.975200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6e3e9-8c63-4797-85e0-f75980004026 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:54.976226 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6e3e9-8c63-4797-85e0-f75980004026 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:54.976596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6e3e9-8c63-4797-85e0-f75980004026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:54.977989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6e3e9-8c63-4797-85e0-f75980004026 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:54.993110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 213/405] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:49:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:54.993110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6e3e9-8c63-4797-85e0-f75980004026 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:54.998374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 193/406] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:54.999514 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e042ce0-198f-4467-ba68-5be15dc277d2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:55.115179 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e042ce0-198f-4467-ba68-5be15dc277d2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:55.130271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6e3e9-8c63-4797-85e0-f75980004026 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:55.149376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966ee20-6877-4ecd-9a01-8c63f8b07377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:55.150273 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966ee20-6877-4ecd-9a01-8c63f8b07377 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:55.150715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966ee20-6877-4ecd-9a01-8c63f8b07377 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:55.151077 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966ee20-6877-4ecd-9a01-8c63f8b07377 None admin] PATH_INFO: `/v3/groups/f1be240704f8403b9566dd73f52039b7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:55.152250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966ee20-6877-4ecd-9a01-8c63f8b07377 None admin] RBAC: Authorizing `identity:get_group(group_id=f1be240704f8403b9566dd73f52039b7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:55.153756 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966ee20-6877-4ecd-9a01-8c63f8b07377 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:55.160170 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 194/407] 10.222.0.24 () {56 vars in 1180 bytes} [Tue May 17 21:49:54 2022] GET /identity/v3/groups/f1be240704f8403b9566dd73f52039b7 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:55.160170 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966ee20-6877-4ecd-9a01-8c63f8b07377 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:55.175407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c610d5-a652-4155-86bf-0c9b6b5fdba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:55.176542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c610d5-a652-4155-86bf-0c9b6b5fdba3 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:55.176820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c610d5-a652-4155-86bf-0c9b6b5fdba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:55.177092 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c610d5-a652-4155-86bf-0c9b6b5fdba3 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1/groups/f1be240704f8403b9566dd73f52039b7/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:55.179249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c610d5-a652-4155-86bf-0c9b6b5fdba3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a832f072c654c648482fe86fd6b1ca1, group_id=f1be240704f8403b9566dd73f52039b7, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:55.180675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c610d5-a652-4155-86bf-0c9b6b5fdba3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:55.259410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 214/408] 10.222.0.24 () {58 vars in 1442 bytes} [Tue May 17 21:49:54 2022] PUT /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1/groups/f1be240704f8403b9566dd73f52039b7/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:49:55.260917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c610d5-a652-4155-86bf-0c9b6b5fdba3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:55.294031 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966ee20-6877-4ecd-9a01-8c63f8b07377 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:55.385373 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ab942-e502-47bd-b7f5-68eeb7c7df39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:55.386261 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ab942-e502-47bd-b7f5-68eeb7c7df39 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:55.386546 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ab942-e502-47bd-b7f5-68eeb7c7df39 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:55.386818 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ab942-e502-47bd-b7f5-68eeb7c7df39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:55.406691 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c610d5-a652-4155-86bf-0c9b6b5fdba3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:55.412405 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ab942-e502-47bd-b7f5-68eeb7c7df39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ef2ab942-e502-47bd-b7f5-68eeb7c7df39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:55.420851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:55.421717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:55.422511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:55.422511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:55.422511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:55.422511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:55.422511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:55.422511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:55.422511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:55.422511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:55.422511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:55.422511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:55.422511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:55.422511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:55.427325 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 195/409] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:49:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:55.428741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ab942-e502-47bd-b7f5-68eeb7c7df39 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:55.466863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac6ae6-a484-4a5d-bb34-6201456a605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:55.467769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac6ae6-a484-4a5d-bb34-6201456a605d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:55.468049 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac6ae6-a484-4a5d-bb34-6201456a605d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:55.468321 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac6ae6-a484-4a5d-bb34-6201456a605d None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:55.470523 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac6ae6-a484-4a5d-bb34-6201456a605d None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:55.476339 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac6ae6-a484-4a5d-bb34-6201456a605d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:55.476339 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 215/410] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:55 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:55.482213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac6ae6-a484-4a5d-bb34-6201456a605d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:55.593233 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ab942-e502-47bd-b7f5-68eeb7c7df39 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:55.622486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac6ae6-a484-4a5d-bb34-6201456a605d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:55.633543 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3edacc-03ca-4939-9f71-e439067593aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:55.634212 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3edacc-03ca-4939-9f71-e439067593aa None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:55.634497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3edacc-03ca-4939-9f71-e439067593aa None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:55.634873 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3edacc-03ca-4939-9f71-e439067593aa None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:55.636134 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3edacc-03ca-4939-9f71-e439067593aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:55.636385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3edacc-03ca-4939-9f71-e439067593aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:55.638444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3edacc-03ca-4939-9f71-e439067593aa None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:55.648936 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 196/411] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:55.655455 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3edacc-03ca-4939-9f71-e439067593aa None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:55.683426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49174f-5306-4a2f-aa1d-3283a226568f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:55.685836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49174f-5306-4a2f-aa1d-3283a226568f None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:55.687222 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49174f-5306-4a2f-aa1d-3283a226568f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:55.689247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49174f-5306-4a2f-aa1d-3283a226568f None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1/groups/f1be240704f8403b9566dd73f52039b7/roles/e5fee74fe53d429897caab84ecf4e5d9` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:55.692784 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49174f-5306-4a2f-aa1d-3283a226568f None admin] RBAC: Authorizing `identity:create_grant(project_id=9a832f072c654c648482fe86fd6b1ca1, group_id=f1be240704f8403b9566dd73f52039b7, role_id=e5fee74fe53d429897caab84ecf4e5d9)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:55.697644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49174f-5306-4a2f-aa1d-3283a226568f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:55.779816 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3edacc-03ca-4939-9f71-e439067593aa None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:55.798288 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 216/412] 10.222.0.24 () {58 vars in 1442 bytes} [Tue May 17 21:49:55 2022] PUT /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1/groups/f1be240704f8403b9566dd73f52039b7/roles/e5fee74fe53d429897caab84ecf4e5d9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 21:49:55.828032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a54b30-347b-4ec8-88d2-abb2790e16ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:55.829266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a54b30-347b-4ec8-88d2-abb2790e16ad None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:55.829787 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a54b30-347b-4ec8-88d2-abb2790e16ad None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:55.830330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a54b30-347b-4ec8-88d2-abb2790e16ad None admin] PATH_INFO: `/v3/groups/2cc2ef94e0a8476dacc05f0828d7fe8e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:55.831889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a54b30-347b-4ec8-88d2-abb2790e16ad None admin] RBAC: Authorizing `identity:get_group(group_id=2cc2ef94e0a8476dacc05f0828d7fe8e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:55.833610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a54b30-347b-4ec8-88d2-abb2790e16ad None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:55.835904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 197/413] 10.222.0.24 () {56 vars in 1180 bytes} [Tue May 17 21:49:55 2022] GET /identity/v3/groups/2cc2ef94e0a8476dacc05f0828d7fe8e => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:55.841867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49174f-5306-4a2f-aa1d-3283a226568f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:55.979066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49174f-5306-4a2f-aa1d-3283a226568f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:56.015906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d94984-a7bc-452b-bc86-d8ff92e510fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:56.016784 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d94984-a7bc-452b-bc86-d8ff92e510fd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:56.017062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d94984-a7bc-452b-bc86-d8ff92e510fd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:56.017330 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d94984-a7bc-452b-bc86-d8ff92e510fd None admin] PATH_INFO: `/v3/projects/52a8a72ae1784555b539c1867c54411c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:56.018554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d94984-a7bc-452b-bc86-d8ff92e510fd None admin] RBAC: Authorizing `identity:get_project(project_id=52a8a72ae1784555b539c1867c54411c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:56.020029 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d94984-a7bc-452b-bc86-d8ff92e510fd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:56.022064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 217/414] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:55 2022] GET /identity/v3/projects/52a8a72ae1784555b539c1867c54411c => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:56.028312 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a54b30-347b-4ec8-88d2-abb2790e16ad None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:56.141299 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a54b30-347b-4ec8-88d2-abb2790e16ad None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:56.176560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6127e-a7dd-4f78-9328-1cdc98d4f7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:56.177674 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6127e-a7dd-4f78-9328-1cdc98d4f7da None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:56.178104 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6127e-a7dd-4f78-9328-1cdc98d4f7da None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:56.178543 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6127e-a7dd-4f78-9328-1cdc98d4f7da None admin] PATH_INFO: `/v3/projects/52a8a72ae1784555b539c1867c54411c/groups/2cc2ef94e0a8476dacc05f0828d7fe8e/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:56.180691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6127e-a7dd-4f78-9328-1cdc98d4f7da None admin] RBAC: Authorizing `identity:create_grant(project_id=52a8a72ae1784555b539c1867c54411c, group_id=2cc2ef94e0a8476dacc05f0828d7fe8e, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:56.182834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6127e-a7dd-4f78-9328-1cdc98d4f7da None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:56.254865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 198/415] 10.222.0.24 () {58 vars in 1442 bytes} [Tue May 17 21:49:56 2022] PUT /identity/v3/projects/52a8a72ae1784555b539c1867c54411c/groups/2cc2ef94e0a8476dacc05f0828d7fe8e/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:49:56.946373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6db8e-155a-40be-b685-54f48f96f197 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:56.946656 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6db8e-155a-40be-b685-54f48f96f197 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:56.946964 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6db8e-155a-40be-b685-54f48f96f197 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:56.949332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 218/416] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:56.955496 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69105d2-2fe4-42a3-93ac-94dfe6071777 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:56.956092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69105d2-2fe4-42a3-93ac-94dfe6071777 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:56.956640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69105d2-2fe4-42a3-93ac-94dfe6071777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:56.983919 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f69105d2-2fe4-42a3-93ac-94dfe6071777 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:56.985996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f69105d2-2fe4-42a3-93ac-94dfe6071777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:57.080874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 199/417] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:57.131551 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6db8e-155a-40be-b685-54f48f96f197 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:57.272053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6db8e-155a-40be-b685-54f48f96f197 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:57.311076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f106ef-104e-4883-8bd2-e38a84f55dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:57.311905 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f106ef-104e-4883-8bd2-e38a84f55dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:57.312183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f106ef-104e-4883-8bd2-e38a84f55dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:57.312455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f106ef-104e-4883-8bd2-e38a84f55dd2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:57.328105 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f106ef-104e-4883-8bd2-e38a84f55dd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e3f106ef-104e-4883-8bd2-e38a84f55dd2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:57.336354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:57.337300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:57.338948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:57.338948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:57.338948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:57.338948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:57.338948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:57.338948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:57.338948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:57.338948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:57.338948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:57.338948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:57.338948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:57.338948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:57.338948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 219/418] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:49:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:49:57.344841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69105d2-2fe4-42a3-93ac-94dfe6071777 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:57.477721 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69105d2-2fe4-42a3-93ac-94dfe6071777 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:57.514139 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb65b68-693f-4b0f-b4a0-eefd79c11f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:57.515209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb65b68-693f-4b0f-b4a0-eefd79c11f24 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:57.515717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb65b68-693f-4b0f-b4a0-eefd79c11f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:57.516196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb65b68-693f-4b0f-b4a0-eefd79c11f24 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:57.517152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb65b68-693f-4b0f-b4a0-eefd79c11f24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:57.517689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb65b68-693f-4b0f-b4a0-eefd79c11f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:57.519294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb65b68-693f-4b0f-b4a0-eefd79c11f24 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:57.529234 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 200/419] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:49:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:57.537400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f106ef-104e-4883-8bd2-e38a84f55dd2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:57.537954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cfc61-64ba-49f3-b1d7-26de78ff2e15 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:57.538251 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cfc61-64ba-49f3-b1d7-26de78ff2e15 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:57.538536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cfc61-64ba-49f3-b1d7-26de78ff2e15 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:57.540170 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 201/420] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:49:57.546480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247b810-676d-44cf-ba01-d3d3d18f229f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:57.546914 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247b810-676d-44cf-ba01-d3d3d18f229f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:57.547377 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247b810-676d-44cf-ba01-d3d3d18f229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:57.567806 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b247b810-676d-44cf-ba01-d3d3d18f229f None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:57.569058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b247b810-676d-44cf-ba01-d3d3d18f229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:57.642728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 202/421] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:49:57.667294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247b810-676d-44cf-ba01-d3d3d18f229f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:57.731165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f106ef-104e-4883-8bd2-e38a84f55dd2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:57.768776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247b810-676d-44cf-ba01-d3d3d18f229f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:57.784176 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed124d-499d-4521-a0ba-54f9f3bca45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:57.785114 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed124d-499d-4521-a0ba-54f9f3bca45f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:57.785600 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed124d-499d-4521-a0ba-54f9f3bca45f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:57.786103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed124d-499d-4521-a0ba-54f9f3bca45f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:57.805122 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb473d-2cb2-4d4a-a376-6c20cab8442d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:57.805977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb473d-2cb2-4d4a-a376-6c20cab8442d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:57.806951 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb473d-2cb2-4d4a-a376-6c20cab8442d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:57.807258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb473d-2cb2-4d4a-a376-6c20cab8442d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:57.818376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb473d-2cb2-4d4a-a376-6c20cab8442d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-bbeb473d-2cb2-4d4a-a376-6c20cab8442d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:57.827267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:57.828383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:57.829383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:57.829383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:57.829383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:57.829383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:57.829383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:57.829383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:57.829383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:57.829383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:57.829383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:57.829383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:57.829383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:57.829383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:57.830606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 203/422] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:49:57.836167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb473d-2cb2-4d4a-a376-6c20cab8442d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:57.867880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed124d-499d-4521-a0ba-54f9f3bca45f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:57.870158 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed124d-499d-4521-a0ba-54f9f3bca45f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:57.951546 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb473d-2cb2-4d4a-a376-6c20cab8442d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:57.980949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 220/423] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:57.988466 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed124d-499d-4521-a0ba-54f9f3bca45f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:57.990788 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f79d5-216e-4abb-9105-e557e0d3afd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:57.991626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f79d5-216e-4abb-9105-e557e0d3afd8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:57.991977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f79d5-216e-4abb-9105-e557e0d3afd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:57.992323 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f79d5-216e-4abb-9105-e557e0d3afd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:57.993896 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f79d5-216e-4abb-9105-e557e0d3afd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:57.993896 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f79d5-216e-4abb-9105-e557e0d3afd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:57.995053 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f79d5-216e-4abb-9105-e557e0d3afd8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:58.005029 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 204/424] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:58.010961 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f79d5-216e-4abb-9105-e557e0d3afd8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:58.115812 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f79d5-216e-4abb-9105-e557e0d3afd8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:58.150942 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011548c3-121f-4edc-ba40-3eb737b1c67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:58.151212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed124d-499d-4521-a0ba-54f9f3bca45f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:58.151921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011548c3-121f-4edc-ba40-3eb737b1c67f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:58.152302 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011548c3-121f-4edc-ba40-3eb737b1c67f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:58.152705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011548c3-121f-4edc-ba40-3eb737b1c67f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:58.201196 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a19c15-3f7e-4ba7-b4e7-1b1237ac5cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:58.202054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a19c15-3f7e-4ba7-b4e7-1b1237ac5cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:58.202329 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a19c15-3f7e-4ba7-b4e7-1b1237ac5cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:58.202596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a19c15-3f7e-4ba7-b4e7-1b1237ac5cf4 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:58.203786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a19c15-3f7e-4ba7-b4e7-1b1237ac5cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:58.205213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a19c15-3f7e-4ba7-b4e7-1b1237ac5cf4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:58.207183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 221/425] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:57 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:58.208361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51934736-0cbf-4160-b243-cf6437ed097f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:58.208641 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51934736-0cbf-4160-b243-cf6437ed097f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:58.208913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51934736-0cbf-4160-b243-cf6437ed097f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:58.210367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 222/426] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:58.217035 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81441a2e-d717-4323-a035-abff6261548e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:58.217322 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81441a2e-d717-4323-a035-abff6261548e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:58.217602 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81441a2e-d717-4323-a035-abff6261548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:58.223789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011548c3-121f-4edc-ba40-3eb737b1c67f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:58.225251 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011548c3-121f-4edc-ba40-3eb737b1c67f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:58.234504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-81441a2e-d717-4323-a035-abff6261548e None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:58.235721 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-81441a2e-d717-4323-a035-abff6261548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:58.309971 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 223/427] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:58.310857 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81441a2e-d717-4323-a035-abff6261548e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:58.338865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 205/428] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 21:49:58.348094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011548c3-121f-4edc-ba40-3eb737b1c67f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:58.425603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81441a2e-d717-4323-a035-abff6261548e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:58.451466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011548c3-121f-4edc-ba40-3eb737b1c67f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:58.459649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2a0f5-1948-4c13-8fdd-e6889c6e3b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:58.460506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2a0f5-1948-4c13-8fdd-e6889c6e3b9c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:58.460784 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2a0f5-1948-4c13-8fdd-e6889c6e3b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:58.461054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2a0f5-1948-4c13-8fdd-e6889c6e3b9c None admin] PATH_INFO: `/v3/groups/f1be240704f8403b9566dd73f52039b7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:58.462261 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2a0f5-1948-4c13-8fdd-e6889c6e3b9c None admin] RBAC: Authorizing `identity:get_group(group_id=f1be240704f8403b9566dd73f52039b7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:58.464282 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2a0f5-1948-4c13-8fdd-e6889c6e3b9c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:58.470663 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 224/429] 10.222.0.24 () {56 vars in 1180 bytes} [Tue May 17 21:49:58 2022] GET /identity/v3/groups/f1be240704f8403b9566dd73f52039b7 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:58.471501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2a0f5-1948-4c13-8fdd-e6889c6e3b9c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:58.487868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c8f37-fe79-4641-896c-93a92e01abca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:58.488723 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c8f37-fe79-4641-896c-93a92e01abca None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:58.489006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c8f37-fe79-4641-896c-93a92e01abca None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:58.489337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c8f37-fe79-4641-896c-93a92e01abca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:58.500164 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c8f37-fe79-4641-896c-93a92e01abca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-df8c8f37-fe79-4641-896c-93a92e01abca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:58.508201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:58.510483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:58.512500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:58.512500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:58.512500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:58.512500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:58.512500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:58.512500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:58.512500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:58.512500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:58.512500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:58.512500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:58.512500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 21:49:58.512500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:58.512500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 206/430] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:58.512500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c8f37-fe79-4641-896c-93a92e01abca None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:58.576415 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2a0f5-1948-4c13-8fdd-e6889c6e3b9c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:58.615063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fabc3-0b52-406a-aa32-06bae87aae79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:58.615429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c8f37-fe79-4641-896c-93a92e01abca None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:58.615955 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fabc3-0b52-406a-aa32-06bae87aae79 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:58.616236 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fabc3-0b52-406a-aa32-06bae87aae79 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:58.616510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fabc3-0b52-406a-aa32-06bae87aae79 None admin] PATH_INFO: `/v3/projects/2be755a8e5a94fffa1b804fb26b77a19` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:58.617704 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fabc3-0b52-406a-aa32-06bae87aae79 None admin] RBAC: Authorizing `identity:get_project(project_id=2be755a8e5a94fffa1b804fb26b77a19)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:58.619919 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fabc3-0b52-406a-aa32-06bae87aae79 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:58.626394 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 225/431] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:58 2022] GET /identity/v3/projects/2be755a8e5a94fffa1b804fb26b77a19 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:58.627451 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fabc3-0b52-406a-aa32-06bae87aae79 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:58.658413 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9d261-b437-4ca2-9d50-7d2edae39efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:58.659215 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9d261-b437-4ca2-9d50-7d2edae39efd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:58.659505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9d261-b437-4ca2-9d50-7d2edae39efd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:58.659784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9d261-b437-4ca2-9d50-7d2edae39efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:58.660629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9d261-b437-4ca2-9d50-7d2edae39efd None admin] RBAC: Adding query filter params (group.id=f1be240704f8403b9566dd73f52039b7, role.id=e5fee74fe53d429897caab84ecf4e5d9, scope.project.id=2be755a8e5a94fffa1b804fb26b77a19) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:58.660939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9d261-b437-4ca2-9d50-7d2edae39efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:58.662453 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9d261-b437-4ca2-9d50-7d2edae39efd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:58.669819 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 207/432] 10.222.0.24 () {56 vars in 1376 bytes} [Tue May 17 21:49:58 2022] GET /identity/v3/role_assignments?group.id=f1be240704f8403b9566dd73f52039b7&scope.project.id=2be755a8e5a94fffa1b804fb26b77a19&role.id=e5fee74fe53d429897caab84ecf4e5d9 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:58.670659 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9d261-b437-4ca2-9d50-7d2edae39efd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:58.780218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9d261-b437-4ca2-9d50-7d2edae39efd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:58.784056 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fabc3-0b52-406a-aa32-06bae87aae79 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:58.816373 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade3af4-5072-4b25-8142-794b91f7a7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:58.817249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade3af4-5072-4b25-8142-794b91f7a7ed None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:58.817596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade3af4-5072-4b25-8142-794b91f7a7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:58.817807 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade3af4-5072-4b25-8142-794b91f7a7ed None admin] PATH_INFO: `/v3/groups/f1be240704f8403b9566dd73f52039b7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:58.819095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade3af4-5072-4b25-8142-794b91f7a7ed None admin] RBAC: Authorizing `identity:get_group(group_id=f1be240704f8403b9566dd73f52039b7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:58.820671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade3af4-5072-4b25-8142-794b91f7a7ed None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:58.832072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 208/433] 10.222.0.24 () {56 vars in 1180 bytes} [Tue May 17 21:49:58 2022] GET /identity/v3/groups/f1be240704f8403b9566dd73f52039b7 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:58.832072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade3af4-5072-4b25-8142-794b91f7a7ed None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:58.838405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6b7ad-ce77-4e45-8856-062a3539270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:58.839097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6b7ad-ce77-4e45-8856-062a3539270c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:58.839430 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6b7ad-ce77-4e45-8856-062a3539270c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:58.839707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6b7ad-ce77-4e45-8856-062a3539270c None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:58.840471 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6b7ad-ce77-4e45-8856-062a3539270c None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:58.840779 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6b7ad-ce77-4e45-8856-062a3539270c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:58.842220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6b7ad-ce77-4e45-8856-062a3539270c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:58.851351 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 226/434] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:49:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:58.856711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462620b2-b617-42d6-bd8c-cb5302b2c1ec None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:58.857007 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462620b2-b617-42d6-bd8c-cb5302b2c1ec None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:58.857260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462620b2-b617-42d6-bd8c-cb5302b2c1ec None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:58.858834 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 227/435] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:58.864183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462620b2-b617-42d6-bd8c-cb5302b2c1ec None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:58.970286 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade3af4-5072-4b25-8142-794b91f7a7ed None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:59.003144 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462620b2-b617-42d6-bd8c-cb5302b2c1ec None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:59.016255 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58422718-2b2a-492b-a5a7-739760473bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:59.016926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58422718-2b2a-492b-a5a7-739760473bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:59.017213 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58422718-2b2a-492b-a5a7-739760473bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:59.017493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58422718-2b2a-492b-a5a7-739760473bd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:59.018326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58422718-2b2a-492b-a5a7-739760473bd8 None admin] RBAC: Adding query filter params (group.id=f1be240704f8403b9566dd73f52039b7, role.id=5c8cdbb338e0490b90a50b0b915f9000, scope.project.id=2be755a8e5a94fffa1b804fb26b77a19) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:59.018639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58422718-2b2a-492b-a5a7-739760473bd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:59.020105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58422718-2b2a-492b-a5a7-739760473bd8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:59.027652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 209/436] 10.222.0.24 () {56 vars in 1376 bytes} [Tue May 17 21:49:58 2022] GET /identity/v3/role_assignments?group.id=f1be240704f8403b9566dd73f52039b7&scope.project.id=2be755a8e5a94fffa1b804fb26b77a19&role.id=5c8cdbb338e0490b90a50b0b915f9000 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:59.028443 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea140-0d75-4772-85c2-77efa5f2aba7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:59.028757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea140-0d75-4772-85c2-77efa5f2aba7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:59.029069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea140-0d75-4772-85c2-77efa5f2aba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:59.045329 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c048be-587b-4481-9d66-f794a4d98e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:59.046519 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c048be-587b-4481-9d66-f794a4d98e3b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:59.046814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6b2ea140-0d75-4772-85c2-77efa5f2aba7 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:59.047236 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c048be-587b-4481-9d66-f794a4d98e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:59.047727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c048be-587b-4481-9d66-f794a4d98e3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:59.048098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6b2ea140-0d75-4772-85c2-77efa5f2aba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:59.131876 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 210/437] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:59.141152 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c048be-587b-4481-9d66-f794a4d98e3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:59.142965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c048be-587b-4481-9d66-f794a4d98e3b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:59.156832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ea140-0d75-4772-85c2-77efa5f2aba7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:59.268164 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 228/438] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:59.269507 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06ceab-8bbd-441a-a17d-242a0c9a5614 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:59.269797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06ceab-8bbd-441a-a17d-242a0c9a5614 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:59.270072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06ceab-8bbd-441a-a17d-242a0c9a5614 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:59.271553 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 229/439] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:49:59.274200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06ceab-8bbd-441a-a17d-242a0c9a5614 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:59.292761 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ea140-0d75-4772-85c2-77efa5f2aba7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:59.340619 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77c43-5be5-411c-a520-e9cd49349117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:59.341402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77c43-5be5-411c-a520-e9cd49349117 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:59.341690 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77c43-5be5-411c-a520-e9cd49349117 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:59.341985 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77c43-5be5-411c-a520-e9cd49349117 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:59.352418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a77c43-5be5-411c-a520-e9cd49349117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-46a77c43-5be5-411c-a520-e9cd49349117 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:59.361947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:59.362947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:59.368429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:59.368429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:59.368429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:59.368429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:59.368429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:59.368429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:59.368429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:59.368429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:59.368429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:59.368429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:59.368429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:49:59.368429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:49:59.368429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 211/440] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:49:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:59.368429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04e22b-d242-4c3c-93a8-8a6c8cfbcd7c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:59.369341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04e22b-d242-4c3c-93a8-8a6c8cfbcd7c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:59.369341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04e22b-d242-4c3c-93a8-8a6c8cfbcd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:59.383428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2d04e22b-d242-4c3c-93a8-8a6c8cfbcd7c None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:49:59.385731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2d04e22b-d242-4c3c-93a8-8a6c8cfbcd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:49:59.395817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06ceab-8bbd-441a-a17d-242a0c9a5614 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:59.438045 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885a024-1aa9-4988-82d1-eb7463c23b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:59.438917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885a024-1aa9-4988-82d1-eb7463c23b58 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:59.439229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885a024-1aa9-4988-82d1-eb7463c23b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:59.439504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885a024-1aa9-4988-82d1-eb7463c23b58 None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:59.440693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885a024-1aa9-4988-82d1-eb7463c23b58 None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:59.443052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885a024-1aa9-4988-82d1-eb7463c23b58 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:59.443998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 230/441] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:59 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:49:59.444592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885a024-1aa9-4988-82d1-eb7463c23b58 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:59.464578 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 212/442] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:49:59.465738 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04e22b-d242-4c3c-93a8-8a6c8cfbcd7c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:59.562408 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885a024-1aa9-4988-82d1-eb7463c23b58 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:59.599272 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04e22b-d242-4c3c-93a8-8a6c8cfbcd7c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:59.609171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95fc8f-2558-4a0d-b2ca-aaa2344ccddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:59.609880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95fc8f-2558-4a0d-b2ca-aaa2344ccddb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:59.610168 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95fc8f-2558-4a0d-b2ca-aaa2344ccddb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:59.610442 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95fc8f-2558-4a0d-b2ca-aaa2344ccddb None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:59.611222 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95fc8f-2558-4a0d-b2ca-aaa2344ccddb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:59.611534 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95fc8f-2558-4a0d-b2ca-aaa2344ccddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:59.613443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95fc8f-2558-4a0d-b2ca-aaa2344ccddb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:59.623972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 231/443] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:49:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:59.624809 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95fc8f-2558-4a0d-b2ca-aaa2344ccddb None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:59.644036 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c6e1c-a369-4fe6-b351-0596022d19ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:59.644893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c6e1c-a369-4fe6-b351-0596022d19ad None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:59.645172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c6e1c-a369-4fe6-b351-0596022d19ad None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:59.645442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c6e1c-a369-4fe6-b351-0596022d19ad None admin] PATH_INFO: `/v3/groups/f1be240704f8403b9566dd73f52039b7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:59.646605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c6e1c-a369-4fe6-b351-0596022d19ad None admin] RBAC: Authorizing `identity:get_group(group_id=f1be240704f8403b9566dd73f52039b7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:59.648078 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c6e1c-a369-4fe6-b351-0596022d19ad None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:59.649695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 213/444] 10.222.0.24 () {56 vars in 1180 bytes} [Tue May 17 21:49:59 2022] GET /identity/v3/groups/f1be240704f8403b9566dd73f52039b7 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:59.651152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c6e1c-a369-4fe6-b351-0596022d19ad None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:59.721699 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95fc8f-2558-4a0d-b2ca-aaa2344ccddb None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:59.744070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c6e1c-a369-4fe6-b351-0596022d19ad None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:59.753284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850532b-c7b8-42dc-a155-607e8ad4cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:59.754053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850532b-c7b8-42dc-a155-607e8ad4cd29 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:59.754327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850532b-c7b8-42dc-a155-607e8ad4cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:59.754592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850532b-c7b8-42dc-a155-607e8ad4cd29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:59.764710 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850532b-c7b8-42dc-a155-607e8ad4cd29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-9850532b-c7b8-42dc-a155-607e8ad4cd29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:49:59.772259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:49:59.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:49:59.773924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:49:59.773924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:49:59.773924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:49:59.773924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:49:59.773924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:49:59.773924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:49:59.773924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:49:59.773924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:49:59.773924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:49:59.773924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:49:59.773924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:49:59.773924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:49:59.773924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 232/445] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:49:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:49:59.775278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850532b-c7b8-42dc-a155-607e8ad4cd29 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:59.778079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34f3a8-35ab-4283-bc16-fc3bc4f80161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:59.778990 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34f3a8-35ab-4283-bc16-fc3bc4f80161 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:59.779289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34f3a8-35ab-4283-bc16-fc3bc4f80161 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:59.779564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34f3a8-35ab-4283-bc16-fc3bc4f80161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:59.844522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34f3a8-35ab-4283-bc16-fc3bc4f80161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:59.845973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34f3a8-35ab-4283-bc16-fc3bc4f80161 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:59.869890 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850532b-c7b8-42dc-a155-607e8ad4cd29 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:49:59.903370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dda0e1-f6a6-4567-a398-6a8662968ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:49:59.904020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dda0e1-f6a6-4567-a398-6a8662968ffb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:49:59.904308 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dda0e1-f6a6-4567-a398-6a8662968ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:49:59.904579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dda0e1-f6a6-4567-a398-6a8662968ffb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:49:59.905400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dda0e1-f6a6-4567-a398-6a8662968ffb None admin] RBAC: Adding query filter params (group.id=f1be240704f8403b9566dd73f52039b7, role.id=5c8cdbb338e0490b90a50b0b915f9000, scope.project.id=9a832f072c654c648482fe86fd6b1ca1) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:49:59.905708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dda0e1-f6a6-4567-a398-6a8662968ffb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:49:59.907191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dda0e1-f6a6-4567-a398-6a8662968ffb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:49:59.912880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 233/446] 10.222.0.24 () {56 vars in 1376 bytes} [Tue May 17 21:49:59 2022] GET /identity/v3/role_assignments?group.id=f1be240704f8403b9566dd73f52039b7&scope.project.id=9a832f072c654c648482fe86fd6b1ca1&role.id=5c8cdbb338e0490b90a50b0b915f9000 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:49:59.913671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dda0e1-f6a6-4567-a398-6a8662968ffb None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:49:59.950353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 214/447] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:49:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:49:59.956163 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34f3a8-35ab-4283-bc16-fc3bc4f80161 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:00.027452 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dda0e1-f6a6-4567-a398-6a8662968ffb None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:00.059642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34f3a8-35ab-4283-bc16-fc3bc4f80161 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:00.062368 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa49481-2cf9-4c93-9f5d-2e44456a1eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:00.063046 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa49481-2cf9-4c93-9f5d-2e44456a1eea None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:00.063357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa49481-2cf9-4c93-9f5d-2e44456a1eea None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:00.063635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa49481-2cf9-4c93-9f5d-2e44456a1eea None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:00.064394 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa49481-2cf9-4c93-9f5d-2e44456a1eea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:00.064697 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa49481-2cf9-4c93-9f5d-2e44456a1eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:00.066112 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa49481-2cf9-4c93-9f5d-2e44456a1eea None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:00.080099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 234/448] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:49:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:00.081304 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa49481-2cf9-4c93-9f5d-2e44456a1eea None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:00.101399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ececc29-6b2d-49c5-bbce-2c65efe6f9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:00.102432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ececc29-6b2d-49c5-bbce-2c65efe6f9be None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:00.102555 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ececc29-6b2d-49c5-bbce-2c65efe6f9be None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:00.102790 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ececc29-6b2d-49c5-bbce-2c65efe6f9be None admin] PATH_INFO: `/v3/projects/9a832f072c654c648482fe86fd6b1ca1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:00.104069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ececc29-6b2d-49c5-bbce-2c65efe6f9be None admin] RBAC: Authorizing `identity:get_project(project_id=9a832f072c654c648482fe86fd6b1ca1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:00.105832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ececc29-6b2d-49c5-bbce-2c65efe6f9be None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:00.107243 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 215/449] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:49:59 2022] GET /identity/v3/projects/9a832f072c654c648482fe86fd6b1ca1 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:00.112507 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ececc29-6b2d-49c5-bbce-2c65efe6f9be None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:00.185217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa49481-2cf9-4c93-9f5d-2e44456a1eea None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:00.220914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a12ca-b371-4fd5-9fb5-47845ae6f89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:00.223571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a12ca-b371-4fd5-9fb5-47845ae6f89c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:00.223571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a12ca-b371-4fd5-9fb5-47845ae6f89c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:00.223571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a12ca-b371-4fd5-9fb5-47845ae6f89c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:00.228751 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ececc29-6b2d-49c5-bbce-2c65efe6f9be None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:00.270307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db138eee-2b48-4ffd-b91d-94bfdf5b4e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:00.271210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db138eee-2b48-4ffd-b91d-94bfdf5b4e36 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:00.271493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db138eee-2b48-4ffd-b91d-94bfdf5b4e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:00.271764 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db138eee-2b48-4ffd-b91d-94bfdf5b4e36 None admin] PATH_INFO: `/v3/groups/f1be240704f8403b9566dd73f52039b7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:00.273005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db138eee-2b48-4ffd-b91d-94bfdf5b4e36 None admin] RBAC: Authorizing `identity:get_group(group_id=f1be240704f8403b9566dd73f52039b7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:00.274440 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db138eee-2b48-4ffd-b91d-94bfdf5b4e36 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:00.276405 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 216/450] 10.222.0.24 () {56 vars in 1180 bytes} [Tue May 17 21:50:00 2022] GET /identity/v3/groups/f1be240704f8403b9566dd73f52039b7 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:00.282215 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db138eee-2b48-4ffd-b91d-94bfdf5b4e36 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:00.299432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a12ca-b371-4fd5-9fb5-47845ae6f89c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:00.301150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a12ca-b371-4fd5-9fb5-47845ae6f89c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:00.379335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db138eee-2b48-4ffd-b91d-94bfdf5b4e36 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:00.393382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 235/451] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:50:00.398922 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a12ca-b371-4fd5-9fb5-47845ae6f89c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:00.412228 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147130a-ac02-4108-bba0-dd1f3acc65bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:00.412873 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147130a-ac02-4108-bba0-dd1f3acc65bd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:00.413151 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147130a-ac02-4108-bba0-dd1f3acc65bd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:00.413425 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147130a-ac02-4108-bba0-dd1f3acc65bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:00.414255 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147130a-ac02-4108-bba0-dd1f3acc65bd None admin] RBAC: Adding query filter params (group.id=f1be240704f8403b9566dd73f52039b7, role.id=e5fee74fe53d429897caab84ecf4e5d9, scope.project.id=9a832f072c654c648482fe86fd6b1ca1) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:00.414561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147130a-ac02-4108-bba0-dd1f3acc65bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:00.416044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147130a-ac02-4108-bba0-dd1f3acc65bd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:00.421661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 217/452] 10.222.0.24 () {56 vars in 1376 bytes} [Tue May 17 21:50:00 2022] GET /identity/v3/role_assignments?group.id=f1be240704f8403b9566dd73f52039b7&scope.project.id=9a832f072c654c648482fe86fd6b1ca1&role.id=e5fee74fe53d429897caab84ecf4e5d9 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:00.499910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a12ca-b371-4fd5-9fb5-47845ae6f89c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:00.535504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070daf3f-c60c-4350-8c3b-b89c5de10800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:00.536372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070daf3f-c60c-4350-8c3b-b89c5de10800 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:00.536649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070daf3f-c60c-4350-8c3b-b89c5de10800 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:00.536919 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070daf3f-c60c-4350-8c3b-b89c5de10800 None admin] PATH_INFO: `/v3/projects/52a8a72ae1784555b539c1867c54411c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:00.538106 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070daf3f-c60c-4350-8c3b-b89c5de10800 None admin] RBAC: Authorizing `identity:get_project(project_id=52a8a72ae1784555b539c1867c54411c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:00.539596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070daf3f-c60c-4350-8c3b-b89c5de10800 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:00.541685 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 236/453] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:50:00 2022] GET /identity/v3/projects/52a8a72ae1784555b539c1867c54411c => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:00.547279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147130a-ac02-4108-bba0-dd1f3acc65bd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:00.648689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147130a-ac02-4108-bba0-dd1f3acc65bd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:00.682419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0f51c-200f-4709-981a-f0d379cf9c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:00.683269 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0f51c-200f-4709-981a-f0d379cf9c03 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:00.683547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0f51c-200f-4709-981a-f0d379cf9c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:00.683816 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0f51c-200f-4709-981a-f0d379cf9c03 None admin] PATH_INFO: `/v3/groups/2cc2ef94e0a8476dacc05f0828d7fe8e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:00.684979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0f51c-200f-4709-981a-f0d379cf9c03 None admin] RBAC: Authorizing `identity:get_group(group_id=2cc2ef94e0a8476dacc05f0828d7fe8e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:00.686407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0f51c-200f-4709-981a-f0d379cf9c03 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:00.688025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 218/454] 10.222.0.24 () {56 vars in 1180 bytes} [Tue May 17 21:50:00 2022] GET /identity/v3/groups/2cc2ef94e0a8476dacc05f0828d7fe8e => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:00.693897 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070daf3f-c60c-4350-8c3b-b89c5de10800 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:00.794676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070daf3f-c60c-4350-8c3b-b89c5de10800 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:00.827731 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb36a1f-bb1b-4d4f-a629-665aac48f1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:00.828379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb36a1f-bb1b-4d4f-a629-665aac48f1ef None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:00.828655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb36a1f-bb1b-4d4f-a629-665aac48f1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:00.828926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb36a1f-bb1b-4d4f-a629-665aac48f1ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:00.829743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb36a1f-bb1b-4d4f-a629-665aac48f1ef None admin] RBAC: Adding query filter params (group.id=2cc2ef94e0a8476dacc05f0828d7fe8e, role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=52a8a72ae1784555b539c1867c54411c) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:00.830050 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb36a1f-bb1b-4d4f-a629-665aac48f1ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:00.831506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb36a1f-bb1b-4d4f-a629-665aac48f1ef None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:00.837096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 237/455] 10.222.0.24 () {56 vars in 1376 bytes} [Tue May 17 21:50:00 2022] GET /identity/v3/role_assignments?group.id=2cc2ef94e0a8476dacc05f0828d7fe8e&scope.project.id=52a8a72ae1784555b539c1867c54411c&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:03.698178 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787375aa-bc9f-4df3-b30c-f8121aef5c2d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:03.698178 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787375aa-bc9f-4df3-b30c-f8121aef5c2d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:03.698178 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787375aa-bc9f-4df3-b30c-f8121aef5c2d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:03.699256 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 219/456] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:03.705104 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd92b7-646f-4dd9-99a4-9638e96e1d95 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:03.705104 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd92b7-646f-4dd9-99a4-9638e96e1d95 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:03.705104 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd92b7-646f-4dd9-99a4-9638e96e1d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:03.722491 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a7cd92b7-646f-4dd9-99a4-9638e96e1d95 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:03.724088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a7cd92b7-646f-4dd9-99a4-9638e96e1d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:03.817572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 238/457] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:03.865868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787375aa-bc9f-4df3-b30c-f8121aef5c2d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:03.923086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006747d7-de22-4561-9bcd-9d2de6580266 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:03.923413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006747d7-de22-4561-9bcd-9d2de6580266 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:03.923657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006747d7-de22-4561-9bcd-9d2de6580266 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:03.925145 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 239/458] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:50:03.930312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f6714-9c3d-4b45-bae8-a42db658084c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:03.930607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f6714-9c3d-4b45-bae8-a42db658084c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:03.930891 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f6714-9c3d-4b45-bae8-a42db658084c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:03.964267 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f75f6714-9c3d-4b45-bae8-a42db658084c None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:03.965383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f75f6714-9c3d-4b45-bae8-a42db658084c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:03.991784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787375aa-bc9f-4df3-b30c-f8121aef5c2d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:04.038127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5759af2-ef80-444e-95a9-0980969ddf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:04.038923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5759af2-ef80-444e-95a9-0980969ddf59 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:04.039229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5759af2-ef80-444e-95a9-0980969ddf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:04.039502 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5759af2-ef80-444e-95a9-0980969ddf59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:04.053560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5759af2-ef80-444e-95a9-0980969ddf59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:04.054832 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 240/459] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:04.055477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5759af2-ef80-444e-95a9-0980969ddf59 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:04.056327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b15c99-f6bd-4401-8091-f67dfd2c37ac None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:04.056834 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b15c99-f6bd-4401-8091-f67dfd2c37ac None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:04.057258 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b15c99-f6bd-4401-8091-f67dfd2c37ac None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:04.063130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 241/460] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:04.065047 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8b0dc-1bcd-4c08-b001-bb845dfdc0c3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:04.065486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8b0dc-1bcd-4c08-b001-bb845dfdc0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:04.065941 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8b0dc-1bcd-4c08-b001-bb845dfdc0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:04.085585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f5759af2-ef80-444e-95a9-0980969ddf59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:04.085585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:04.085585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:04.085585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:04.085585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:04.085585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:04.085585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:04.085585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:04.085585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:04.085585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:04.085585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:04.085585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:04.085585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:04.085585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:04.085585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:04.086505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:04.087483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:04.087483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:04.087483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:04.087483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:04.091236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 220/461] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:04.092471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5759af2-ef80-444e-95a9-0980969ddf59 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:04.098876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-89c8b0dc-1bcd-4c08-b001-bb845dfdc0c3 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:04.100115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-89c8b0dc-1bcd-4c08-b001-bb845dfdc0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:04.170325 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 242/462] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:04.171345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8b0dc-1bcd-4c08-b001-bb845dfdc0c3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:04.195533 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5759af2-ef80-444e-95a9-0980969ddf59 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:04.230798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11365b4-78b4-4d05-9800-511dfa9e44b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:04.231849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11365b4-78b4-4d05-9800-511dfa9e44b6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:04.232267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11365b4-78b4-4d05-9800-511dfa9e44b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:04.232676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11365b4-78b4-4d05-9800-511dfa9e44b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:04.243324 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11365b4-78b4-4d05-9800-511dfa9e44b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:04.245189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11365b4-78b4-4d05-9800-511dfa9e44b6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:04.264040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a11365b4-78b4-4d05-9800-511dfa9e44b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:04.264040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:04.264040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:04.264040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:04.264040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:04.264040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:04.264040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:04.264040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:04.264040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:04.264040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:04.264040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:04.264040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:04.264040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:04.264040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:04.264040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:04.265093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:04.266014 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:04.266014 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:04.266014 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:04.266014 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:04.267801 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 221/463] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:04.268695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11365b4-78b4-4d05-9800-511dfa9e44b6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:04.281238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8b0dc-1bcd-4c08-b001-bb845dfdc0c3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:04.318296 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70a3f6-5426-416b-890c-c999829238d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:04.318960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70a3f6-5426-416b-890c-c999829238d4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:04.319584 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70a3f6-5426-416b-890c-c999829238d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:04.319584 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70a3f6-5426-416b-890c-c999829238d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:04.320256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70a3f6-5426-416b-890c-c999829238d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:04.320562 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70a3f6-5426-416b-890c-c999829238d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:04.321994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70a3f6-5426-416b-890c-c999829238d4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:04.333285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 243/464] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:04.333905 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70a3f6-5426-416b-890c-c999829238d4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:04.380955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11365b4-78b4-4d05-9800-511dfa9e44b6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:04.413850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92d748-a55b-4135-995d-8b9725ed8948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:04.414874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d748-a55b-4135-995d-8b9725ed8948 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:04.415252 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d748-a55b-4135-995d-8b9725ed8948 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:04.416106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d748-a55b-4135-995d-8b9725ed8948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:04.426165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92d748-a55b-4135-995d-8b9725ed8948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:04.427643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92d748-a55b-4135-995d-8b9725ed8948 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:04.439513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70a3f6-5426-416b-890c-c999829238d4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:04.445743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8c92d748-a55b-4135-995d-8b9725ed8948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:04.445743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:04.445743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:04.445743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:04.445743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:04.445743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:04.445743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:04.445743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:04.445743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:04.445743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:04.445743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:04.445743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:04.445743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:04.445743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:04.445743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:04.446547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:04.447902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:04.447902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:04.447902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:04.447902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:04.447902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 222/465] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:04.448160 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d128ae4-e91b-40e1-bc5f-02b33cabbc74 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:04.448428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d128ae4-e91b-40e1-bc5f-02b33cabbc74 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:04.448955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d128ae4-e91b-40e1-bc5f-02b33cabbc74 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:04.454006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 223/466] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:04.454006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d128ae4-e91b-40e1-bc5f-02b33cabbc74 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:04.483883 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a60d4b-c416-4153-ad28-d975029921de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:04.484654 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a60d4b-c416-4153-ad28-d975029921de None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:04.484931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a60d4b-c416-4153-ad28-d975029921de None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:04.485202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a60d4b-c416-4153-ad28-d975029921de None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:04.485913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a60d4b-c416-4153-ad28-d975029921de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:04.486214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a60d4b-c416-4153-ad28-d975029921de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:04.487624 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a60d4b-c416-4153-ad28-d975029921de None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:04.499456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 244/467] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:04.500267 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a60d4b-c416-4153-ad28-d975029921de None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:04.558161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d128ae4-e91b-40e1-bc5f-02b33cabbc74 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:04.590931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34cbc8-60ac-4e2e-9359-f468b0a5b1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:04.591625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34cbc8-60ac-4e2e-9359-f468b0a5b1e3 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:04.591908 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34cbc8-60ac-4e2e-9359-f468b0a5b1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:04.592179 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34cbc8-60ac-4e2e-9359-f468b0a5b1e3 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:04.592876 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34cbc8-60ac-4e2e-9359-f468b0a5b1e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:04.594298 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34cbc8-60ac-4e2e-9359-f468b0a5b1e3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:04.601918 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a60d4b-c416-4153-ad28-d975029921de None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:04.634871 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058c3c2-77b1-4261-b1f7-4c0f6edd096e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:04.635562 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058c3c2-77b1-4261-b1f7-4c0f6edd096e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:04.635839 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058c3c2-77b1-4261-b1f7-4c0f6edd096e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:04.636119 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058c3c2-77b1-4261-b1f7-4c0f6edd096e None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:04.636830 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058c3c2-77b1-4261-b1f7-4c0f6edd096e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:04.637135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058c3c2-77b1-4261-b1f7-4c0f6edd096e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:04.638517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058c3c2-77b1-4261-b1f7-4c0f6edd096e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:04.654327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 245/468] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:04.654327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976913a-e0ae-4444-afca-316a7d5261ce None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:04.654327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976913a-e0ae-4444-afca-316a7d5261ce None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:04.654327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976913a-e0ae-4444-afca-316a7d5261ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:04.669814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 224/469] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:50:04 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:50:04.669975 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9976913a-e0ae-4444-afca-316a7d5261ce None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:04.670969 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9976913a-e0ae-4444-afca-316a7d5261ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:04.676918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34cbc8-60ac-4e2e-9359-f468b0a5b1e3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:04.751547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 246/470] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:04.753146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976913a-e0ae-4444-afca-316a7d5261ce None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:04.796851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34cbc8-60ac-4e2e-9359-f468b0a5b1e3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:04.836069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbcfb9-bf0a-4f8e-b321-2703204a4328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:04.836767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbcfb9-bf0a-4f8e-b321-2703204a4328 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:04.837087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbcfb9-bf0a-4f8e-b321-2703204a4328 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:04.837417 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbcfb9-bf0a-4f8e-b321-2703204a4328 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:04.838139 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbcfb9-bf0a-4f8e-b321-2703204a4328 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:04.839670 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbcfb9-bf0a-4f8e-b321-2703204a4328 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:04.866667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976913a-e0ae-4444-afca-316a7d5261ce None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:04.903998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5086b99-3901-4d85-8186-6ba52da392fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:04.904227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5086b99-3901-4d85-8186-6ba52da392fc None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:04.904499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5086b99-3901-4d85-8186-6ba52da392fc None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:04.904773 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5086b99-3901-4d85-8186-6ba52da392fc None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:04.905479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5086b99-3901-4d85-8186-6ba52da392fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:04.906913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5086b99-3901-4d85-8186-6ba52da392fc None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:04.918869 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 225/471] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:50:04 2022] POST /identity/v3/users => generated 246 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:50:04.919774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbcfb9-bf0a-4f8e-b321-2703204a4328 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:05.015935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 247/472] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:50:04 2022] POST /identity/v3/users => generated 248 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:50:05.037405 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbcfb9-bf0a-4f8e-b321-2703204a4328 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:05.080472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cb543-4d62-4d63-bee8-f3f4ce7133a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:05.081365 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cb543-4d62-4d63-bee8-f3f4ce7133a3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:05.081728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cb543-4d62-4d63-bee8-f3f4ce7133a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:05.082008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cb543-4d62-4d63-bee8-f3f4ce7133a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:05.095861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cb543-4d62-4d63-bee8-f3f4ce7133a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:05.097516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cb543-4d62-4d63-bee8-f3f4ce7133a3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:05.118385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-986cb543-4d62-4d63-bee8-f3f4ce7133a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:05.118385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:05.118385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:05.118385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:05.118385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:05.118385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:05.118385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:05.118385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:05.118385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:05.118385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:05.118385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:05.118385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:05.118385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:05.118385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:05.118385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:05.119888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:05.121552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:05.121552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:05.121552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:05.121552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:05.121552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 226/473] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:05.126230 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5086b99-3901-4d85-8186-6ba52da392fc None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:05.253504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5086b99-3901-4d85-8186-6ba52da392fc None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:05.288471 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3ddd5-1dda-499e-b582-041689f74a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:05.289146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3ddd5-1dda-499e-b582-041689f74a28 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:05.289426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3ddd5-1dda-499e-b582-041689f74a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:05.289703 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3ddd5-1dda-499e-b582-041689f74a28 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:05.290478 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3ddd5-1dda-499e-b582-041689f74a28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:05.291371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3ddd5-1dda-499e-b582-041689f74a28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:05.292773 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3ddd5-1dda-499e-b582-041689f74a28 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:05.305766 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 248/474] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:05.311538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cb543-4d62-4d63-bee8-f3f4ce7133a3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:05.329066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e55a52-b244-491a-a295-0ee5fdd93ce9 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:05.329346 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e55a52-b244-491a-a295-0ee5fdd93ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:05.329626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e55a52-b244-491a-a295-0ee5fdd93ce9 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:05.331260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 249/475] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:50:05.338047 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a8f53-e254-4092-9f91-457b1efa69e4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:05.338363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a8f53-e254-4092-9f91-457b1efa69e4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:05.338619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a8f53-e254-4092-9f91-457b1efa69e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:05.360028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-217a8f53-e254-4092-9f91-457b1efa69e4 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:05.361213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-217a8f53-e254-4092-9f91-457b1efa69e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:05.446221 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 250/476] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:50:05.451153 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cb543-4d62-4d63-bee8-f3f4ce7133a3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:05.481734 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a8f53-e254-4092-9f91-457b1efa69e4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:05.493944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bf86c-985e-4019-8846-87532e661ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:05.495522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bf86c-985e-4019-8846-87532e661ecb None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:05.496039 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bf86c-985e-4019-8846-87532e661ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:05.496541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bf86c-985e-4019-8846-87532e661ecb None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:05.497997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bf86c-985e-4019-8846-87532e661ecb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:05.499949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bf86c-985e-4019-8846-87532e661ecb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:05.591171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a8f53-e254-4092-9f91-457b1efa69e4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:05.620441 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 227/477] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:50:05 2022] POST /identity/v3/users => generated 249 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:50:05.625913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691be854-3c4d-453d-ac61-014e33e79024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:05.626674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691be854-3c4d-453d-ac61-014e33e79024 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:05.626960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691be854-3c4d-453d-ac61-014e33e79024 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:05.627271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691be854-3c4d-453d-ac61-014e33e79024 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:05.628166 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691be854-3c4d-453d-ac61-014e33e79024 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:05.629736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691be854-3c4d-453d-ac61-014e33e79024 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:05.694829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.sql.core [None req-691be854-3c4d-453d-ac61-014e33e79024 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 21:50:05.694829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 17 21:50:05.694829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [parameters: {'id': '29265dd59c394fdc88b393dc64a32c3f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 17 21:50:05.694829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80134) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 21:50:05.712277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-691be854-3c4d-453d-ac61-014e33e79024 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 17 21:50:05.712277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:05.712277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 21:50:05.712277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 21:50:05.712277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 21:50:05.712277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 21:50:05.712277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 21:50:05.712277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application result = self._query(query) May 17 21:50:05.712277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 21:50:05.712277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application conn.query(q) May 17 21:50:05.712277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 21:50:05.712277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 21:50:05.712277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 21:50:05.712277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application result.read() May 17 21:50:05.712277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return ref.to_dict() May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 21:50:05.713249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application next(self.gen) May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application yield resource May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application next(self.gen) May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self.session.rollback() May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self.force_reraise() May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise self.value May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application session.commit() May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 21:50:05.714642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._prepare_impl() May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self.session.flush() May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._flush(objects) May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application compat.raise_( May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application flush_context.execute() May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rec.execute(self) May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 21:50:05.715700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application c = connection._execute_20( May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 21:50:05.716529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application result = self._query(query) May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application conn.query(q) May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application result.read() May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 21:50:05.718740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [parameters: {'id': '29265dd59c394fdc88b393dc64a32c3f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:05.719805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 17 21:50:05.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:05.721814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 251/478] 10.222.0.24 () {60 vars in 1131 bytes} [Tue May 17 21:50:05 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:05.721885 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bf86c-985e-4019-8846-87532e661ecb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:05.867322 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bf86c-985e-4019-8846-87532e661ecb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:05.902726 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f54c1-090b-4072-b79b-dddaa8909dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:05.903573 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f54c1-090b-4072-b79b-dddaa8909dbe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:05.903863 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f54c1-090b-4072-b79b-dddaa8909dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:05.904145 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f54c1-090b-4072-b79b-dddaa8909dbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:05.914979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f54c1-090b-4072-b79b-dddaa8909dbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-664f54c1-090b-4072-b79b-dddaa8909dbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:05.923355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:05.925423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:05.927506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:05.927506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:05.927506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:05.927506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:05.927506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:05.927506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:05.927506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:05.927506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:05.927506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:05.927506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:05.927506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 21:50:05.927506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:05.927506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 228/479] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:50:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:05.931644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691be854-3c4d-453d-ac61-014e33e79024 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:06.035088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691be854-3c4d-453d-ac61-014e33e79024 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:06.070017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbec342-c86a-4985-9497-9e9a50ccf75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:06.070693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbec342-c86a-4985-9497-9e9a50ccf75d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:06.070976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbec342-c86a-4985-9497-9e9a50ccf75d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:06.071286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbec342-c86a-4985-9497-9e9a50ccf75d None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:06.072180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbec342-c86a-4985-9497-9e9a50ccf75d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:06.072482 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbec342-c86a-4985-9497-9e9a50ccf75d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:06.073853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbec342-c86a-4985-9497-9e9a50ccf75d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:06.082830 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 252/480] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:07.435401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694184c-5c4b-4b1a-a8f2-f4ffa3d2c042 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:07.435921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694184c-5c4b-4b1a-a8f2-f4ffa3d2c042 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:07.435921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694184c-5c4b-4b1a-a8f2-f4ffa3d2c042 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:07.437520 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 229/481] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:07.442904 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082120c-2a36-478e-8754-7fc27bf0e9cf None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:07.443328 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082120c-2a36-478e-8754-7fc27bf0e9cf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:07.443490 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082120c-2a36-478e-8754-7fc27bf0e9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:07.460832 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3082120c-2a36-478e-8754-7fc27bf0e9cf None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:07.461992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3082120c-2a36-478e-8754-7fc27bf0e9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:07.550066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 253/482] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:50:07.586196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694184c-5c4b-4b1a-a8f2-f4ffa3d2c042 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:07.732896 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694184c-5c4b-4b1a-a8f2-f4ffa3d2c042 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:07.761355 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637fb18-3b44-42e8-a035-43352d61e7d5 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:07.761688 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637fb18-3b44-42e8-a035-43352d61e7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:07.761903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637fb18-3b44-42e8-a035-43352d61e7d5 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:07.763550 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 254/483] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:07.769647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477a789-3917-4256-8d8f-42a43ff7fdb8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:07.769928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477a789-3917-4256-8d8f-42a43ff7fdb8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:07.770202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477a789-3917-4256-8d8f-42a43ff7fdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:07.785158 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fb61f-563c-4a8e-bb47-c00957f547e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:07.785962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fb61f-563c-4a8e-bb47-c00957f547e1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:07.786252 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fb61f-563c-4a8e-bb47-c00957f547e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:07.786531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fb61f-563c-4a8e-bb47-c00957f547e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:07.794240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8477a789-3917-4256-8d8f-42a43ff7fdb8 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:07.795449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8477a789-3917-4256-8d8f-42a43ff7fdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:07.800246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fb61f-563c-4a8e-bb47-c00957f547e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-612fb61f-563c-4a8e-bb47-c00957f547e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:07.808949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:07.809862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:07.810879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:07.810879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:07.810879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:07.810879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:07.810879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:07.810879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:07.810879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:07.810879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:07.810879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:07.810879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:07.810879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:07.810879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:07.810879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 230/484] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:07.816260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fb61f-563c-4a8e-bb47-c00957f547e1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:07.922211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 255/485] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:50:07.962133 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477a789-3917-4256-8d8f-42a43ff7fdb8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:08.030818 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fb61f-563c-4a8e-bb47-c00957f547e1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:08.063870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477a789-3917-4256-8d8f-42a43ff7fdb8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:08.087633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75de869-1e9b-4d01-8d7a-828c1d6e9f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:08.088307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75de869-1e9b-4d01-8d7a-828c1d6e9f16 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:08.088651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75de869-1e9b-4d01-8d7a-828c1d6e9f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:08.088862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75de869-1e9b-4d01-8d7a-828c1d6e9f16 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:08.089611 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75de869-1e9b-4d01-8d7a-828c1d6e9f16 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:08.090131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75de869-1e9b-4d01-8d7a-828c1d6e9f16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:08.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75de869-1e9b-4d01-8d7a-828c1d6e9f16 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:08.099978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 231/486] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:08.101431 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5392fe8-b06f-4fdb-8d7a-974e0bd8c8c0 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:08.101640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997f218-594d-42d4-a9df-b12a8594fd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:08.101769 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5392fe8-b06f-4fdb-8d7a-974e0bd8c8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:08.101988 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5392fe8-b06f-4fdb-8d7a-974e0bd8c8c0 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:08.102975 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997f218-594d-42d4-a9df-b12a8594fd93 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:08.103536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 232/487] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:08.103638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997f218-594d-42d4-a9df-b12a8594fd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:08.104170 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997f218-594d-42d4-a9df-b12a8594fd93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:08.105050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5392fe8-b06f-4fdb-8d7a-974e0bd8c8c0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:08.115816 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997f218-594d-42d4-a9df-b12a8594fd93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-2997f218-594d-42d4-a9df-b12a8594fd93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:08.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:08.125289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:08.126070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:08.126070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:08.126070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:08.126070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:08.126070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:08.126070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:08.126070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:08.126070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:08.126070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:08.126070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:08.126070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:08.126070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:08.128745 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 256/488] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:08.130199 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e8c8a-894b-4dd6-8753-0d0ee5538503 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:08.130687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e8c8a-894b-4dd6-8753-0d0ee5538503 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:08.131196 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e8c8a-894b-4dd6-8753-0d0ee5538503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:08.148093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8f8e8c8a-894b-4dd6-8753-0d0ee5538503 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:08.149563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8f8e8c8a-894b-4dd6-8753-0d0ee5538503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:08.219921 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 257/489] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:08.221197 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e8c8a-894b-4dd6-8753-0d0ee5538503 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:08.239662 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5392fe8-b06f-4fdb-8d7a-974e0bd8c8c0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:08.283188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66c90e-d46d-438d-a782-ea6e8c9ff980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:08.283932 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66c90e-d46d-438d-a782-ea6e8c9ff980 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:08.284483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66c90e-d46d-438d-a782-ea6e8c9ff980 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:08.284763 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66c90e-d46d-438d-a782-ea6e8c9ff980 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:08.297951 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66c90e-d46d-438d-a782-ea6e8c9ff980 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:08.300076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66c90e-d46d-438d-a782-ea6e8c9ff980 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:08.327141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ad66c90e-d46d-438d-a782-ea6e8c9ff980 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:08.327141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:08.327141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:08.327141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:08.327141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:08.327141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:08.327141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:08.327141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:08.327141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:08.327141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:08.327141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:08.327141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:08.327141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:08.327141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:08.327141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:08.328108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:08.329538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:08.329538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:08.329538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:08.329538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:08.329538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 233/490] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:08.329538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66c90e-d46d-438d-a782-ea6e8c9ff980 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:08.356012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e8c8a-894b-4dd6-8753-0d0ee5538503 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:08.403666 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792587c-ebf9-4ede-86ed-9bbbae104621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:08.404364 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792587c-ebf9-4ede-86ed-9bbbae104621 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:08.404625 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792587c-ebf9-4ede-86ed-9bbbae104621 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:08.404909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792587c-ebf9-4ede-86ed-9bbbae104621 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:08.405713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792587c-ebf9-4ede-86ed-9bbbae104621 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:08.406020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792587c-ebf9-4ede-86ed-9bbbae104621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:08.407735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792587c-ebf9-4ede-86ed-9bbbae104621 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:08.423189 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 258/491] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:08.424467 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792587c-ebf9-4ede-86ed-9bbbae104621 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:08.455337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66c90e-d46d-438d-a782-ea6e8c9ff980 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:08.489859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07030633-1cce-4793-95ba-bc76e7f3921f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:08.490597 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07030633-1cce-4793-95ba-bc76e7f3921f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:08.490881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07030633-1cce-4793-95ba-bc76e7f3921f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:08.491181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07030633-1cce-4793-95ba-bc76e7f3921f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:08.502620 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07030633-1cce-4793-95ba-bc76e7f3921f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-07030633-1cce-4793-95ba-bc76e7f3921f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:08.511240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:08.512142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:08.512923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:08.512923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:08.512923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:08.512923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:08.512923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:08.512923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:08.512923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:08.512923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:08.512923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:08.512923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:08.512923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:08.512923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:08.512923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 234/492] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:08.514078 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07030633-1cce-4793-95ba-bc76e7f3921f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:08.534374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792587c-ebf9-4ede-86ed-9bbbae104621 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:08.568857 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52510f2c-07ce-4b8d-9b5c-9f61bbae32f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:08.569517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52510f2c-07ce-4b8d-9b5c-9f61bbae32f4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:08.569794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52510f2c-07ce-4b8d-9b5c-9f61bbae32f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:08.570060 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52510f2c-07ce-4b8d-9b5c-9f61bbae32f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:08.570770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52510f2c-07ce-4b8d-9b5c-9f61bbae32f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:08.571068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52510f2c-07ce-4b8d-9b5c-9f61bbae32f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:08.572985 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52510f2c-07ce-4b8d-9b5c-9f61bbae32f4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:08.584417 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 259/493] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:08.586363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52510f2c-07ce-4b8d-9b5c-9f61bbae32f4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:08.614972 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07030633-1cce-4793-95ba-bc76e7f3921f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:08.648553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2596c-6b48-4100-8b5d-49bf70c1d6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:08.649336 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2596c-6b48-4100-8b5d-49bf70c1d6ed None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:08.649621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2596c-6b48-4100-8b5d-49bf70c1d6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:08.649929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2596c-6b48-4100-8b5d-49bf70c1d6ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:08.660064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2596c-6b48-4100-8b5d-49bf70c1d6ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:08.661550 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2596c-6b48-4100-8b5d-49bf70c1d6ed None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:08.678731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d6a2596c-6b48-4100-8b5d-49bf70c1d6ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:08.678731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:08.678731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:08.678731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:08.678731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:08.678731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:08.678731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:08.678731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:08.678731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:08.678731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:08.678731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:08.678731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:08.678731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:08.678731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:08.678731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:08.679660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:08.680497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:08.680497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:08.680497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:08.680497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:08.680497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 235/494] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:08.681754 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c72f3c-9a96-458d-acdf-0ff85ec6e08b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:08.681971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c72f3c-9a96-458d-acdf-0ff85ec6e08b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:08.682245 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c72f3c-9a96-458d-acdf-0ff85ec6e08b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:08.683517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 236/495] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:08.684199 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c72f3c-9a96-458d-acdf-0ff85ec6e08b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:08.702876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52510f2c-07ce-4b8d-9b5c-9f61bbae32f4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:08.738995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8041648-817f-4188-a05f-89035fabcd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:08.739704 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8041648-817f-4188-a05f-89035fabcd6f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:08.739987 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8041648-817f-4188-a05f-89035fabcd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:08.740259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8041648-817f-4188-a05f-89035fabcd6f None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:08.741014 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8041648-817f-4188-a05f-89035fabcd6f None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:08.741315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8041648-817f-4188-a05f-89035fabcd6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:08.742751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8041648-817f-4188-a05f-89035fabcd6f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:08.756618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 260/496] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:08.756618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8041648-817f-4188-a05f-89035fabcd6f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:08.790194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c72f3c-9a96-458d-acdf-0ff85ec6e08b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:08.824895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dfa6b-9c82-460b-ba7d-7d0981246b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:08.829066 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dfa6b-9c82-460b-ba7d-7d0981246b02 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:08.829066 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dfa6b-9c82-460b-ba7d-7d0981246b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:08.829066 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dfa6b-9c82-460b-ba7d-7d0981246b02 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:08.834056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dfa6b-9c82-460b-ba7d-7d0981246b02 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:08.835735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dfa6b-9c82-460b-ba7d-7d0981246b02 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-518dfa6b-9c82-460b-ba7d-7d0981246b02 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:08.852040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:08.853181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:08.854267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:08.854267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:08.854267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:08.854267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:08.854267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:08.854267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:08.854267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:08.854267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:08.854267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 21:50:08.854267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:08.856411 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 237/497] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:50:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:08.857919 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6783ed5-58b6-4cda-b2e6-3330b298a16d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:08.858208 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6783ed5-58b6-4cda-b2e6-3330b298a16d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:08.858486 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6783ed5-58b6-4cda-b2e6-3330b298a16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:08.863071 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8041648-817f-4188-a05f-89035fabcd6f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:08.877905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a6783ed5-58b6-4cda-b2e6-3330b298a16d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:08.879089 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a6783ed5-58b6-4cda-b2e6-3330b298a16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:08.901111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f583d-705a-4176-9528-e256a56bab47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:08.901777 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f583d-705a-4176-9528-e256a56bab47 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:08.902056 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f583d-705a-4176-9528-e256a56bab47 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:08.902318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f583d-705a-4176-9528-e256a56bab47 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:08.903036 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f583d-705a-4176-9528-e256a56bab47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:08.903381 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f583d-705a-4176-9528-e256a56bab47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:08.904820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f583d-705a-4176-9528-e256a56bab47 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:08.917203 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 261/498] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:08.918001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f583d-705a-4176-9528-e256a56bab47 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:08.950891 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 238/499] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:08.951764 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6783ed5-58b6-4cda-b2e6-3330b298a16d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:09.027564 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f583d-705a-4176-9528-e256a56bab47 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:09.045781 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6783ed5-58b6-4cda-b2e6-3330b298a16d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:09.060321 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ac0d1-3ef1-40d3-a090-b8ef48a30092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:09.061101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ac0d1-3ef1-40d3-a090-b8ef48a30092 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:09.061383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ac0d1-3ef1-40d3-a090-b8ef48a30092 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:09.061657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ac0d1-3ef1-40d3-a090-b8ef48a30092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:09.071911 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ac0d1-3ef1-40d3-a090-b8ef48a30092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:09.073353 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ac0d1-3ef1-40d3-a090-b8ef48a30092 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:09.077660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0c694-017a-4613-8f18-241f49895495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:09.078323 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0c694-017a-4613-8f18-241f49895495 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:09.078608 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0c694-017a-4613-8f18-241f49895495 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:09.078885 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0c694-017a-4613-8f18-241f49895495 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:09.079773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0c694-017a-4613-8f18-241f49895495 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:09.080079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0c694-017a-4613-8f18-241f49895495 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:09.081502 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0c694-017a-4613-8f18-241f49895495 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:09.090449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e79ac0d1-3ef1-40d3-a090-b8ef48a30092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:09.090449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:09.090449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:09.090449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:09.090449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:09.090449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:09.090449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:09.090449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:09.090449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:09.090449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:09.090449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:09.090449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:09.090449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:09.090449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:09.090449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:09.091302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:09.092159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:09.092159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:09.092159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:09.092159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:09.092159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 262/500] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:09.092827 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea7ad7-e264-43f0-8cb7-877c3d0dca17 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:09.093111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea7ad7-e264-43f0-8cb7-877c3d0dca17 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:09.093387 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea7ad7-e264-43f0-8cb7-877c3d0dca17 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:09.094626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 263/501] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:09.095338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea7ad7-e264-43f0-8cb7-877c3d0dca17 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:09.122952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 239/502] 10.222.0.24 () {56 vars in 1137 bytes} [Tue May 17 21:50:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:09.123995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0c694-017a-4613-8f18-241f49895495 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:09.193213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea7ad7-e264-43f0-8cb7-877c3d0dca17 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:09.217316 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0c694-017a-4613-8f18-241f49895495 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:09.225767 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088c1ff-6626-4e14-8287-f5912ea83718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:09.226547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088c1ff-6626-4e14-8287-f5912ea83718 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:09.226830 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088c1ff-6626-4e14-8287-f5912ea83718 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:09.227139 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088c1ff-6626-4e14-8287-f5912ea83718 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:09.234598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088c1ff-6626-4e14-8287-f5912ea83718 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:09.236077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088c1ff-6626-4e14-8287-f5912ea83718 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:09.249858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93003c2-8684-4f94-85f8-51a4ab6891d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:09.250644 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93003c2-8684-4f94-85f8-51a4ab6891d0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:09.250926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93003c2-8684-4f94-85f8-51a4ab6891d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:09.251224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93003c2-8684-4f94-85f8-51a4ab6891d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3088c1ff-6626-4e14-8287-f5912ea83718 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:09.252271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:09.253215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:09.254082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:09.254082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:09.254082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:09.254082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:09.254082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:09.254082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:09.254082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:09.254082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:09.254082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 21:50:09.254082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:09.254082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 264/503] 10.222.0.24 () {56 vars in 1093 bytes} [Tue May 17 21:50:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:09.254620 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088c1ff-6626-4e14-8287-f5912ea83718 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:09.263422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93003c2-8684-4f94-85f8-51a4ab6891d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a93003c2-8684-4f94-85f8-51a4ab6891d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:09.271057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:09.272148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:09.273115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:09.273115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:09.273115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:09.273115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:09.273115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:09.273115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:09.273115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:09.273115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:09.273115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:09.273115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:09.273115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:09.273115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:09.273115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 240/504] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:09.273943 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf87bcc-2bbd-4d73-8e2d-61f4d04ed9af None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:09.273943 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf87bcc-2bbd-4d73-8e2d-61f4d04ed9af None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:09.274080 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf87bcc-2bbd-4d73-8e2d-61f4d04ed9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:09.289759 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-abf87bcc-2bbd-4d73-8e2d-61f4d04ed9af None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:09.291609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-abf87bcc-2bbd-4d73-8e2d-61f4d04ed9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:09.351375 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088c1ff-6626-4e14-8287-f5912ea83718 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:09.354659 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 241/505] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:09.355514 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf87bcc-2bbd-4d73-8e2d-61f4d04ed9af None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:09.394554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bdae5-ab66-4d0c-9575-11e462e9afdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:09.395256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bdae5-ab66-4d0c-9575-11e462e9afdb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:09.395538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bdae5-ab66-4d0c-9575-11e462e9afdb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:09.395812 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bdae5-ab66-4d0c-9575-11e462e9afdb None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:09.396525 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bdae5-ab66-4d0c-9575-11e462e9afdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:09.396828 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bdae5-ab66-4d0c-9575-11e462e9afdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:09.398204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bdae5-ab66-4d0c-9575-11e462e9afdb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:09.410194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 265/506] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:09.410822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bdae5-ab66-4d0c-9575-11e462e9afdb None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:09.457223 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf87bcc-2bbd-4d73-8e2d-61f4d04ed9af None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:09.489775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5afd2-0d35-49fa-8be0-8d929022c4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:09.490415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5afd2-0d35-49fa-8be0-8d929022c4dc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:09.490700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5afd2-0d35-49fa-8be0-8d929022c4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:09.490984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5afd2-0d35-49fa-8be0-8d929022c4dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:09.507281 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bdae5-ab66-4d0c-9575-11e462e9afdb None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:09.539264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb885e-2b2d-4774-a4fb-355d25ecc5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:09.539926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb885e-2b2d-4774-a4fb-355d25ecc5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:09.540755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb885e-2b2d-4774-a4fb-355d25ecc5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:09.541039 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb885e-2b2d-4774-a4fb-355d25ecc5b3 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:09.541869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb885e-2b2d-4774-a4fb-355d25ecc5b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:09.542176 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb885e-2b2d-4774-a4fb-355d25ecc5b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:09.543657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb885e-2b2d-4774-a4fb-355d25ecc5b3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:09.555721 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5afd2-0d35-49fa-8be0-8d929022c4dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:09.557372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5afd2-0d35-49fa-8be0-8d929022c4dc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:09.580543 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 266/507] 10.222.0.24 () {56 vars in 1133 bytes} [Tue May 17 21:50:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:09.581193 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb885e-2b2d-4774-a4fb-355d25ecc5b3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:09.653786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 242/508] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:50:09.654443 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5afd2-0d35-49fa-8be0-8d929022c4dc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:09.676479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb885e-2b2d-4774-a4fb-355d25ecc5b3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:09.709827 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a3875-c0ef-4858-acbc-574bb4eef911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:09.710489 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a3875-c0ef-4858-acbc-574bb4eef911 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:09.710769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a3875-c0ef-4858-acbc-574bb4eef911 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:09.711047 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a3875-c0ef-4858-acbc-574bb4eef911 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:09.711824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a3875-c0ef-4858-acbc-574bb4eef911 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:09.712853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a3875-c0ef-4858-acbc-574bb4eef911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:09.714419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a3875-c0ef-4858-acbc-574bb4eef911 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:09.722276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 267/509] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:09.723062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a3875-c0ef-4858-acbc-574bb4eef911 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:09.758795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5afd2-0d35-49fa-8be0-8d929022c4dc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:09.792059 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c06503-ffe2-4604-ae2e-a1e15d75955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:09.792833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c06503-ffe2-4604-ae2e-a1e15d75955f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:09.793118 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c06503-ffe2-4604-ae2e-a1e15d75955f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:09.793395 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c06503-ffe2-4604-ae2e-a1e15d75955f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:09.803265 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c06503-ffe2-4604-ae2e-a1e15d75955f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:09.804699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c06503-ffe2-4604-ae2e-a1e15d75955f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:09.817285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a3875-c0ef-4858-acbc-574bb4eef911 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:09.821786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d6c06503-ffe2-4604-ae2e-a1e15d75955f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:09.821786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:09.821786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:09.821786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:09.821786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:09.821786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:09.821786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:09.821786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:09.821786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:09.821786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:09.821786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:09.821786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:09.821786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:09.821786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:09.821786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:09.828730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:09.829684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:09.829684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:09.829684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:09.829684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:09.829684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 243/510] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:09.829684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c06503-ffe2-4604-ae2e-a1e15d75955f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:09.851049 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cfc6c-763d-4af1-b826-ef903f0718ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:09.851858 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cfc6c-763d-4af1-b826-ef903f0718ba None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:09.852137 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cfc6c-763d-4af1-b826-ef903f0718ba None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:09.852446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cfc6c-763d-4af1-b826-ef903f0718ba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:09.860322 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cfc6c-763d-4af1-b826-ef903f0718ba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:09.861755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cfc6c-763d-4af1-b826-ef903f0718ba None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ff4cfc6c-763d-4af1-b826-ef903f0718ba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:09.876109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:09.876990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:09.877859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:09.877859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:09.877859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:09.877859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:09.877859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:09.877859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:09.877859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:09.877859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:09.877859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 21:50:09.877859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:09.877859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 268/511] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:50:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:09.878451 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cfc6c-763d-4af1-b826-ef903f0718ba None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:09.932245 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c06503-ffe2-4604-ae2e-a1e15d75955f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:09.965008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47412974-9d4b-4d21-989a-d0cd949b9dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:09.965649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47412974-9d4b-4d21-989a-d0cd949b9dfa None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:09.965927 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47412974-9d4b-4d21-989a-d0cd949b9dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:09.966196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47412974-9d4b-4d21-989a-d0cd949b9dfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:09.976475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cfc6c-763d-4af1-b826-ef903f0718ba None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:10.011842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57303fdb-8a31-49a3-b263-e0f90b188530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:10.012629 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57303fdb-8a31-49a3-b263-e0f90b188530 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:10.012911 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57303fdb-8a31-49a3-b263-e0f90b188530 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:10.013187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57303fdb-8a31-49a3-b263-e0f90b188530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:10.023471 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57303fdb-8a31-49a3-b263-e0f90b188530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:10.025531 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57303fdb-8a31-49a3-b263-e0f90b188530 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:10.032219 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47412974-9d4b-4d21-989a-d0cd949b9dfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:10.033652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47412974-9d4b-4d21-989a-d0cd949b9dfa None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:10.042188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-57303fdb-8a31-49a3-b263-e0f90b188530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:10.042188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:10.042188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:10.042188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:10.042188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:10.042188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:10.042188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:10.042188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:10.042188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:10.042188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:10.042188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:10.042188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:10.042188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:10.042188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:10.042188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:10.043209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:10.044116 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:10.044116 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:10.044116 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:10.044116 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:10.044116 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 269/512] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:10.044591 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57303fdb-8a31-49a3-b263-e0f90b188530 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:10.125427 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 244/513] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:50:10.126245 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47412974-9d4b-4d21-989a-d0cd949b9dfa None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:10.138913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57303fdb-8a31-49a3-b263-e0f90b188530 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:10.171432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d18e8-e033-4ed9-b1ea-3cc270dfe2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:10.172212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d18e8-e033-4ed9-b1ea-3cc270dfe2da None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:10.172490 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d18e8-e033-4ed9-b1ea-3cc270dfe2da None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:10.172761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d18e8-e033-4ed9-b1ea-3cc270dfe2da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:10.183441 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d18e8-e033-4ed9-b1ea-3cc270dfe2da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:10.184839 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d18e8-e033-4ed9-b1ea-3cc270dfe2da None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:10.202711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ef9d18e8-e033-4ed9-b1ea-3cc270dfe2da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:10.202711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:10.202711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:10.202711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:10.202711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:10.202711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:10.202711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:10.202711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:10.202711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:10.202711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:10.202711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:10.202711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:10.202711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:10.202711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:10.202711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:10.203579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:10.209077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:10.209077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:10.209077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:10.209077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:10.209077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 270/514] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:10.209077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d18e8-e033-4ed9-b1ea-3cc270dfe2da None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:10.220673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47412974-9d4b-4d21-989a-d0cd949b9dfa None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:10.253328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4bd20-f79f-4f03-9c1e-d2de58cfe3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:10.253976 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4bd20-f79f-4f03-9c1e-d2de58cfe3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:10.254283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4bd20-f79f-4f03-9c1e-d2de58cfe3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:10.254548 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4bd20-f79f-4f03-9c1e-d2de58cfe3f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:10.255286 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4bd20-f79f-4f03-9c1e-d2de58cfe3f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:10.255587 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4bd20-f79f-4f03-9c1e-d2de58cfe3f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:10.256941 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4bd20-f79f-4f03-9c1e-d2de58cfe3f2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:10.268490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 245/515] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:10.269253 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4bd20-f79f-4f03-9c1e-d2de58cfe3f2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:10.300589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d18e8-e033-4ed9-b1ea-3cc270dfe2da None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:10.333014 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3ea0f-2921-4c51-98d6-a1c64415e9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:10.333666 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3ea0f-2921-4c51-98d6-a1c64415e9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:10.333942 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3ea0f-2921-4c51-98d6-a1c64415e9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:10.334209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3ea0f-2921-4c51-98d6-a1c64415e9c2 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:10.335026 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3ea0f-2921-4c51-98d6-a1c64415e9c2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:10.335363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3ea0f-2921-4c51-98d6-a1c64415e9c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:10.336799 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3ea0f-2921-4c51-98d6-a1c64415e9c2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:10.353849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 271/516] 10.222.0.24 () {56 vars in 1137 bytes} [Tue May 17 21:50:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:10.354629 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3ea0f-2921-4c51-98d6-a1c64415e9c2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:10.365926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4bd20-f79f-4f03-9c1e-d2de58cfe3f2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:10.398563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ceee0e-dd82-4b71-8649-e654e53bb7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:10.399242 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ceee0e-dd82-4b71-8649-e654e53bb7de None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:10.399525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ceee0e-dd82-4b71-8649-e654e53bb7de None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:10.399864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ceee0e-dd82-4b71-8649-e654e53bb7de None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:10.400695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ceee0e-dd82-4b71-8649-e654e53bb7de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:10.401003 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ceee0e-dd82-4b71-8649-e654e53bb7de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:10.402368 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ceee0e-dd82-4b71-8649-e654e53bb7de None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:10.413605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 246/517] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:10.414375 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ceee0e-dd82-4b71-8649-e654e53bb7de None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:10.452321 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3ea0f-2921-4c51-98d6-a1c64415e9c2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:10.483802 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323892b-194c-4534-9e69-3ed7a918472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:10.484576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323892b-194c-4534-9e69-3ed7a918472c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:10.484856 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323892b-194c-4534-9e69-3ed7a918472c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:10.485129 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323892b-194c-4534-9e69-3ed7a918472c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:10.495415 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323892b-194c-4534-9e69-3ed7a918472c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:10.496847 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323892b-194c-4534-9e69-3ed7a918472c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:10.507861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ceee0e-dd82-4b71-8649-e654e53bb7de None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:10.513963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-c323892b-194c-4534-9e69-3ed7a918472c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:10.513963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:10.513963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:10.513963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:10.513963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:10.513963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:10.513963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:10.513963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:10.513963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:10.513963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:10.513963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:10.513963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:10.513963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:10.513963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:10.513963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:10.514917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:10.520435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:10.520435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:10.520435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:10.520435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:10.520435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 272/518] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:10.520435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323892b-194c-4534-9e69-3ed7a918472c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:10.540029 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f162e-c77e-4b5f-b427-a00069e1ba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:10.540786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f162e-c77e-4b5f-b427-a00069e1ba50 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:10.541114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f162e-c77e-4b5f-b427-a00069e1ba50 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:10.541386 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f162e-c77e-4b5f-b427-a00069e1ba50 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:10.542125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f162e-c77e-4b5f-b427-a00069e1ba50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:10.542425 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f162e-c77e-4b5f-b427-a00069e1ba50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:10.543801 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f162e-c77e-4b5f-b427-a00069e1ba50 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:10.554767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 247/519] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:10.555559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f162e-c77e-4b5f-b427-a00069e1ba50 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:10.613561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323892b-194c-4534-9e69-3ed7a918472c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:10.644839 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b25c9-3a6b-4d06-8f24-8ff625b616b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:10.645505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b25c9-3a6b-4d06-8f24-8ff625b616b1 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:10.645785 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b25c9-3a6b-4d06-8f24-8ff625b616b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:10.646056 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b25c9-3a6b-4d06-8f24-8ff625b616b1 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:10.646748 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b25c9-3a6b-4d06-8f24-8ff625b616b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:10.648209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b25c9-3a6b-4d06-8f24-8ff625b616b1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:10.648654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f162e-c77e-4b5f-b427-a00069e1ba50 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:10.681691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156157b-0805-4c30-ae92-880c685e68a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:10.682333 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156157b-0805-4c30-ae92-880c685e68a0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:10.682615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156157b-0805-4c30-ae92-880c685e68a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:10.682891 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156157b-0805-4c30-ae92-880c685e68a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:10.744994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 273/520] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:50:10 2022] POST /identity/v3/users => generated 247 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:50:10.745725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b25c9-3a6b-4d06-8f24-8ff625b616b1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:10.746117 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156157b-0805-4c30-ae92-880c685e68a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:10.747610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156157b-0805-4c30-ae92-880c685e68a0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:10.854294 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b25c9-3a6b-4d06-8f24-8ff625b616b1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:10.861953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 248/521] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:50:10.862807 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156157b-0805-4c30-ae92-880c685e68a0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:10.902838 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0cb7c-2b25-4a71-9af0-7a3ed81aef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:10.903769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0cb7c-2b25-4a71-9af0-7a3ed81aef59 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:10.904205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0cb7c-2b25-4a71-9af0-7a3ed81aef59 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:10.904580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0cb7c-2b25-4a71-9af0-7a3ed81aef59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:10.912329 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0cb7c-2b25-4a71-9af0-7a3ed81aef59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:10.913913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0cb7c-2b25-4a71-9af0-7a3ed81aef59 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:10.930051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-64f0cb7c-2b25-4a71-9af0-7a3ed81aef59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:10.930051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:10.930051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:10.930051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:10.930051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:10.930051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:10.930051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:10.930051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:10.930051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:10.930051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:10.930051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:10.930051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:10.930051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:10.930051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:10.930051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:10.931260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:10.932187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:10.932187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:10.932187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:10.932187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:10.932187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:10.932187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:10.932187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:10.932187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:10.932187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 274/522] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:10.932721 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0cb7c-2b25-4a71-9af0-7a3ed81aef59 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:10.968079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156157b-0805-4c30-ae92-880c685e68a0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:11.006148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274d1c9-9f8d-4574-b725-14cbff63a723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:11.006743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274d1c9-9f8d-4574-b725-14cbff63a723 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:11.007027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274d1c9-9f8d-4574-b725-14cbff63a723 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:11.007380 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274d1c9-9f8d-4574-b725-14cbff63a723 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:11.008100 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274d1c9-9f8d-4574-b725-14cbff63a723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:11.008696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274d1c9-9f8d-4574-b725-14cbff63a723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:11.010405 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274d1c9-9f8d-4574-b725-14cbff63a723 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:11.023430 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 249/523] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:11.024274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274d1c9-9f8d-4574-b725-14cbff63a723 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:11.047546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0cb7c-2b25-4a71-9af0-7a3ed81aef59 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:11.080925 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5584397-9625-47d2-a0e8-9ed2d21f8b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:11.081719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5584397-9625-47d2-a0e8-9ed2d21f8b54 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:11.082002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5584397-9625-47d2-a0e8-9ed2d21f8b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:11.082274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5584397-9625-47d2-a0e8-9ed2d21f8b54 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:11.090385 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5584397-9625-47d2-a0e8-9ed2d21f8b54 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:11.091871 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5584397-9625-47d2-a0e8-9ed2d21f8b54 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-f5584397-9625-47d2-a0e8-9ed2d21f8b54 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:11.106393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:11.107332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:11.112931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:11.112931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:11.112931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:11.112931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:11.112931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:11.112931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:11.112931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:11.112931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:11.112931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 21:50:11.112931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:11.112931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 275/524] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:11.112931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5584397-9625-47d2-a0e8-9ed2d21f8b54 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:11.126225 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274d1c9-9f8d-4574-b725-14cbff63a723 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:11.159564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a8a8d-5415-4512-aa42-dce7a5b5886b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:11.160359 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a8a8d-5415-4512-aa42-dce7a5b5886b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:11.160641 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a8a8d-5415-4512-aa42-dce7a5b5886b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:11.160919 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a8a8d-5415-4512-aa42-dce7a5b5886b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:11.171245 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a8a8d-5415-4512-aa42-dce7a5b5886b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:11.172671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a8a8d-5415-4512-aa42-dce7a5b5886b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:11.190301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-608a8a8d-5415-4512-aa42-dce7a5b5886b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:11.190301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:11.190301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:11.190301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:11.190301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:11.190301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:11.190301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:11.190301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:11.190301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:11.190301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:11.190301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:11.190301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:11.190301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:11.190301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:11.190301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:11.191231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:11.192102 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:11.192102 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:11.192102 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:11.192102 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:11.192102 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 250/525] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:11.192622 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a8a8d-5415-4512-aa42-dce7a5b5886b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:11.216928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5584397-9625-47d2-a0e8-9ed2d21f8b54 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:11.250984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ef02c-ee81-43cf-8709-38bb4ce4d804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:11.251918 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ef02c-ee81-43cf-8709-38bb4ce4d804 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:11.252338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ef02c-ee81-43cf-8709-38bb4ce4d804 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:11.252750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ef02c-ee81-43cf-8709-38bb4ce4d804 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:11.253666 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ef02c-ee81-43cf-8709-38bb4ce4d804 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:11.254123 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ef02c-ee81-43cf-8709-38bb4ce4d804 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:11.255790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ef02c-ee81-43cf-8709-38bb4ce4d804 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:11.273960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 276/526] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:11.274991 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ef02c-ee81-43cf-8709-38bb4ce4d804 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:11.289981 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a8a8d-5415-4512-aa42-dce7a5b5886b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:11.324379 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432370c-f98d-46f5-936f-9c6b62609fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:11.325171 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432370c-f98d-46f5-936f-9c6b62609fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:11.325468 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432370c-f98d-46f5-936f-9c6b62609fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:11.325725 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432370c-f98d-46f5-936f-9c6b62609fc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:11.332256 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432370c-f98d-46f5-936f-9c6b62609fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:11.333700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432370c-f98d-46f5-936f-9c6b62609fc7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:11.348640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c432370c-f98d-46f5-936f-9c6b62609fc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:11.348640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:11.348640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:11.348640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:11.348640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:11.348640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:11.348640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:11.348640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:11.348640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:11.348640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:11.348640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:11.348640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:11.348640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:11.348640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:11.348640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:11.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:11.350315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:11.350315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:11.350315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:11.350315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:11.350315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:11.350315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:11.350315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:11.350315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:11.350315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 251/527] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:11.350774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432370c-f98d-46f5-936f-9c6b62609fc7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:11.385787 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ef02c-ee81-43cf-8709-38bb4ce4d804 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:11.422344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac960ec9-766c-45a2-892f-4c99ac41f680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:11.423019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac960ec9-766c-45a2-892f-4c99ac41f680 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:11.423316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac960ec9-766c-45a2-892f-4c99ac41f680 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:11.423607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac960ec9-766c-45a2-892f-4c99ac41f680 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:11.424505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac960ec9-766c-45a2-892f-4c99ac41f680 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:11.424707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac960ec9-766c-45a2-892f-4c99ac41f680 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:11.426399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac960ec9-766c-45a2-892f-4c99ac41f680 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:11.449331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 277/528] 10.222.0.24 () {56 vars in 1139 bytes} [Tue May 17 21:50:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:11.449331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac960ec9-766c-45a2-892f-4c99ac41f680 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:11.457209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432370c-f98d-46f5-936f-9c6b62609fc7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:11.490372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dffc7-751a-4937-a53b-ee21a6d493a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:11.491029 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dffc7-751a-4937-a53b-ee21a6d493a7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:11.491353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dffc7-751a-4937-a53b-ee21a6d493a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:11.491628 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dffc7-751a-4937-a53b-ee21a6d493a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:11.492338 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dffc7-751a-4937-a53b-ee21a6d493a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:11.492645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dffc7-751a-4937-a53b-ee21a6d493a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:11.494932 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dffc7-751a-4937-a53b-ee21a6d493a7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:11.505885 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 252/529] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:11.511467 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dffc7-751a-4937-a53b-ee21a6d493a7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:11.545561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac960ec9-766c-45a2-892f-4c99ac41f680 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:11.579566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63044867-5e94-46aa-9452-beb898e7ef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:11.580196 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63044867-5e94-46aa-9452-beb898e7ef6d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:11.580474 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63044867-5e94-46aa-9452-beb898e7ef6d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:11.580744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63044867-5e94-46aa-9452-beb898e7ef6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:11.581576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63044867-5e94-46aa-9452-beb898e7ef6d None admin] RBAC: Adding query filter params (role.id=17cc20a61bbf4f5ea7ae111203cfda47, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=68748827b9f14eb7958d5b202c5d6877) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:11.581868 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63044867-5e94-46aa-9452-beb898e7ef6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:11.583320 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63044867-5e94-46aa-9452-beb898e7ef6d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:11.589304 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 278/530] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:11 2022] GET /identity/v3/role_assignments?user.id=68748827b9f14eb7958d5b202c5d6877&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=17cc20a61bbf4f5ea7ae111203cfda47 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:11.590222 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63044867-5e94-46aa-9452-beb898e7ef6d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:11.614062 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dffc7-751a-4937-a53b-ee21a6d493a7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:11.652098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d87a0a-32ec-4551-be6b-f8bdad2986c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:11.653031 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d87a0a-32ec-4551-be6b-f8bdad2986c9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:11.653475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d87a0a-32ec-4551-be6b-f8bdad2986c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:11.653886 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d87a0a-32ec-4551-be6b-f8bdad2986c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:11.654836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d87a0a-32ec-4551-be6b-f8bdad2986c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:11.655352 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d87a0a-32ec-4551-be6b-f8bdad2986c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:11.656994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d87a0a-32ec-4551-be6b-f8bdad2986c9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:11.676981 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 253/531] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:11.678135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d87a0a-32ec-4551-be6b-f8bdad2986c9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:11.713376 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63044867-5e94-46aa-9452-beb898e7ef6d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:11.750408 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f8243-421f-41f4-8754-774f35873d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:11.751146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f8243-421f-41f4-8754-774f35873d64 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:11.751490 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f8243-421f-41f4-8754-774f35873d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:11.751690 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f8243-421f-41f4-8754-774f35873d64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:11.785129 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d87a0a-32ec-4551-be6b-f8bdad2986c9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:11.831231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb98a59-bacd-415c-ab82-5160cddb7c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:11.831231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98a59-bacd-415c-ab82-5160cddb7c85 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:11.831231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98a59-bacd-415c-ab82-5160cddb7c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:11.831231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98a59-bacd-415c-ab82-5160cddb7c85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:11.831667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f8243-421f-41f4-8754-774f35873d64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:11.831667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f8243-421f-41f4-8754-774f35873d64 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:11.831814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb98a59-bacd-415c-ab82-5160cddb7c85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:11.832980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb98a59-bacd-415c-ab82-5160cddb7c85 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:11.847617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ebb98a59-bacd-415c-ab82-5160cddb7c85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:11.847617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:11.847617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:11.847617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:11.847617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:11.847617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:11.847617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:11.847617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:11.847617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:11.847617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:11.847617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:11.847617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:11.847617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:11.847617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:11.847617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:11.848728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:11.849735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:11.849735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:11.849735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:11.849735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:11.849735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:11.849735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:11.849735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:11.849735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:11.851737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 254/532] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:11.852748 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb98a59-bacd-415c-ab82-5160cddb7c85 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:11.938059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 279/533] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:50:11.939220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f8243-421f-41f4-8754-774f35873d64 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:11.957144 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb98a59-bacd-415c-ab82-5160cddb7c85 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:11.991502 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38194596-a599-4729-9c60-52f3a1b41ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:11.992521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38194596-a599-4729-9c60-52f3a1b41ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:11.992997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38194596-a599-4729-9c60-52f3a1b41ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:11.994009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38194596-a599-4729-9c60-52f3a1b41ac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:11.995028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38194596-a599-4729-9c60-52f3a1b41ac6 None admin] RBAC: Adding query filter params (role.id=17cc20a61bbf4f5ea7ae111203cfda47, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=8d06113649924eae83d04bc22337bd6d) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:11.995571 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38194596-a599-4729-9c60-52f3a1b41ac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:11.997211 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38194596-a599-4729-9c60-52f3a1b41ac6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:12.003431 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 255/534] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:11 2022] GET /identity/v3/role_assignments?user.id=8d06113649924eae83d04bc22337bd6d&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=17cc20a61bbf4f5ea7ae111203cfda47 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:12.004700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38194596-a599-4729-9c60-52f3a1b41ac6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:12.043144 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f8243-421f-41f4-8754-774f35873d64 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:12.080821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100d639-de7c-4296-8f8b-e13f97bf9777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:12.082236 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100d639-de7c-4296-8f8b-e13f97bf9777 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:12.082236 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100d639-de7c-4296-8f8b-e13f97bf9777 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:12.082236 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100d639-de7c-4296-8f8b-e13f97bf9777 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:12.082782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100d639-de7c-4296-8f8b-e13f97bf9777 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:12.083086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100d639-de7c-4296-8f8b-e13f97bf9777 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:12.084600 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100d639-de7c-4296-8f8b-e13f97bf9777 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:12.097183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 280/535] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:12.102882 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100d639-de7c-4296-8f8b-e13f97bf9777 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:12.114752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38194596-a599-4729-9c60-52f3a1b41ac6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:12.174911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102af85-f3f8-45fb-9369-4c54d92dca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:12.175813 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102af85-f3f8-45fb-9369-4c54d92dca65 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:12.176352 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102af85-f3f8-45fb-9369-4c54d92dca65 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:12.176621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102af85-f3f8-45fb-9369-4c54d92dca65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:12.204152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102af85-f3f8-45fb-9369-4c54d92dca65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:12.205648 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102af85-f3f8-45fb-9369-4c54d92dca65 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:12.237500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1102af85-f3f8-45fb-9369-4c54d92dca65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:12.237500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:12.237500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:12.237500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:12.237500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:12.237500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:12.237500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:12.237500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:12.237500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:12.237500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:12.237500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:12.237500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:12.237500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:12.237500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:12.237500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:12.238418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:12.239277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:12.239277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:12.239277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:12.239277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:12.251516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 256/536] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:12.254912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102af85-f3f8-45fb-9369-4c54d92dca65 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:12.309910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100d639-de7c-4296-8f8b-e13f97bf9777 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:12.357330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102af85-f3f8-45fb-9369-4c54d92dca65 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:12.392385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0afc2-1271-4ea5-9fe3-c233168e8d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:12.393503 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0afc2-1271-4ea5-9fe3-c233168e8d63 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:12.394018 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0afc2-1271-4ea5-9fe3-c233168e8d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:12.394488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0afc2-1271-4ea5-9fe3-c233168e8d63 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:12.395448 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0afc2-1271-4ea5-9fe3-c233168e8d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:12.395829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548fbea-ebc6-4cc8-9e56-5240b1b8d049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:12.396201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0afc2-1271-4ea5-9fe3-c233168e8d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:12.396498 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548fbea-ebc6-4cc8-9e56-5240b1b8d049 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:12.396782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548fbea-ebc6-4cc8-9e56-5240b1b8d049 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:12.397059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548fbea-ebc6-4cc8-9e56-5240b1b8d049 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:12.397895 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548fbea-ebc6-4cc8-9e56-5240b1b8d049 None admin] RBAC: Adding query filter params (role.id=17cc20a61bbf4f5ea7ae111203cfda47, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=f765ee92b36e43478c04db32227a5872) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:12.398212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548fbea-ebc6-4cc8-9e56-5240b1b8d049 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:12.399229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0afc2-1271-4ea5-9fe3-c233168e8d63 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:12.400266 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548fbea-ebc6-4cc8-9e56-5240b1b8d049 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:12.410277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 281/537] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:12 2022] GET /identity/v3/role_assignments?user.id=f765ee92b36e43478c04db32227a5872&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=17cc20a61bbf4f5ea7ae111203cfda47 => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:12.414495 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 257/538] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:12.423163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548fbea-ebc6-4cc8-9e56-5240b1b8d049 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:12.574389 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548fbea-ebc6-4cc8-9e56-5240b1b8d049 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:12.611666 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf02b7f-9801-421d-b026-79b2b30998a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:12.612397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf02b7f-9801-421d-b026-79b2b30998a7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:12.612676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf02b7f-9801-421d-b026-79b2b30998a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:12.612947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf02b7f-9801-421d-b026-79b2b30998a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:12.621169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf02b7f-9801-421d-b026-79b2b30998a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:12.622653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf02b7f-9801-421d-b026-79b2b30998a7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:12.637795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ebf02b7f-9801-421d-b026-79b2b30998a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:12.637795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:12.637795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:12.637795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:12.637795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:12.637795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:12.637795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:12.637795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:12.637795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:12.637795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:12.637795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:12.637795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:12.637795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:12.637795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:12.637795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:12.638674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:12.639536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:12.639536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:12.639536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:12.639536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:12.639536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:12.639536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:12.639536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:12.639536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:12.639536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 282/539] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:12.648385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0afc2-1271-4ea5-9fe3-c233168e8d63 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:12.806474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0afc2-1271-4ea5-9fe3-c233168e8d63 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:12.850636 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e76b3-2cec-405c-adb7-28e1f2c79a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:12.851420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e76b3-2cec-405c-adb7-28e1f2c79a4b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:12.851711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e76b3-2cec-405c-adb7-28e1f2c79a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:12.851980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e76b3-2cec-405c-adb7-28e1f2c79a4b None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:12.853378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e76b3-2cec-405c-adb7-28e1f2c79a4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:12.853829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e76b3-2cec-405c-adb7-28e1f2c79a4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:12.855322 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e76b3-2cec-405c-adb7-28e1f2c79a4b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:12.873887 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 258/540] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:12.884340 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf02b7f-9801-421d-b026-79b2b30998a7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:13.001881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf02b7f-9801-421d-b026-79b2b30998a7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:13.043389 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba02e53-3c3a-43ab-8a7f-95f5bf6978cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:13.044063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba02e53-3c3a-43ab-8a7f-95f5bf6978cb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:13.044346 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba02e53-3c3a-43ab-8a7f-95f5bf6978cb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:13.044623 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba02e53-3c3a-43ab-8a7f-95f5bf6978cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:13.045476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba02e53-3c3a-43ab-8a7f-95f5bf6978cb None admin] RBAC: Adding query filter params (role.id=17cc20a61bbf4f5ea7ae111203cfda47, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=c084b56d682c44119654743809109bc4) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:13.045788 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba02e53-3c3a-43ab-8a7f-95f5bf6978cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:13.047320 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba02e53-3c3a-43ab-8a7f-95f5bf6978cb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:13.056674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 283/541] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:12 2022] GET /identity/v3/role_assignments?user.id=c084b56d682c44119654743809109bc4&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=17cc20a61bbf4f5ea7ae111203cfda47 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:13.353644 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86a0b6-7f4b-49fb-b271-8f21ede163d2 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:13.354043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86a0b6-7f4b-49fb-b271-8f21ede163d2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:13.354222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86a0b6-7f4b-49fb-b271-8f21ede163d2 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:13.355867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 259/542] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:13.362861 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c70bf6-ba9e-42b6-be57-9638de796154 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:13.363185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c70bf6-ba9e-42b6-be57-9638de796154 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:13.363471 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c70bf6-ba9e-42b6-be57-9638de796154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:13.382252 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-66c70bf6-ba9e-42b6-be57-9638de796154 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:13.383453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-66c70bf6-ba9e-42b6-be57-9638de796154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:13.480146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 284/543] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:13.528616 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86a0b6-7f4b-49fb-b271-8f21ede163d2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:13.658879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86a0b6-7f4b-49fb-b271-8f21ede163d2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:13.705843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14696513-42aa-4ee6-a836-a96621530e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:13.707016 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14696513-42aa-4ee6-a836-a96621530e08 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:13.707526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14696513-42aa-4ee6-a836-a96621530e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:13.707993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14696513-42aa-4ee6-a836-a96621530e08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:13.723618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14696513-42aa-4ee6-a836-a96621530e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-14696513-42aa-4ee6-a836-a96621530e08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:13.731821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:13.732703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:13.733501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:13.733501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:13.733501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:13.733501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:13.733501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:13.733501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:13.733501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:13.733501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:13.733501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:13.733501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:13.733501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:13.733501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:13.741397 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 260/544] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:13.748205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c70bf6-ba9e-42b6-be57-9638de796154 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:13.874894 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c70bf6-ba9e-42b6-be57-9638de796154 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:13.910697 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b1478-42a0-4b61-8eff-f7bf6a6c53fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:13.911326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b1478-42a0-4b61-8eff-f7bf6a6c53fe None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:13.911589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b1478-42a0-4b61-8eff-f7bf6a6c53fe None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:13.911937 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b1478-42a0-4b61-8eff-f7bf6a6c53fe None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:13.912733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b1478-42a0-4b61-8eff-f7bf6a6c53fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:13.913033 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b1478-42a0-4b61-8eff-f7bf6a6c53fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:13.914495 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b1478-42a0-4b61-8eff-f7bf6a6c53fe None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:13.924175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 285/545] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:13.929490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14696513-42aa-4ee6-a836-a96621530e08 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:14.089715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14696513-42aa-4ee6-a836-a96621530e08 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:14.143803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4f4da-04c7-402f-ac9d-5602fbc45420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:14.144999 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4f4da-04c7-402f-ac9d-5602fbc45420 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:14.145497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4f4da-04c7-402f-ac9d-5602fbc45420 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:14.145991 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4f4da-04c7-402f-ac9d-5602fbc45420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:14.160335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4f4da-04c7-402f-ac9d-5602fbc45420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:14.162165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4f4da-04c7-402f-ac9d-5602fbc45420 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:14.185833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-54f4f4da-04c7-402f-ac9d-5602fbc45420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:14.185833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:14.185833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:14.185833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:14.185833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:14.185833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:14.185833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:14.185833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:14.185833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:14.185833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:14.185833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:14.185833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:14.185833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:14.185833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:14.185833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:14.186904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:14.187840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:14.187840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:14.187840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:14.187840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:14.190295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 261/546] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:14.196249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b1478-42a0-4b61-8eff-f7bf6a6c53fe None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:14.339404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b1478-42a0-4b61-8eff-f7bf6a6c53fe None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:14.370379 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc151b-f762-43a6-af22-adbaad96da8a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:14.370709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc151b-f762-43a6-af22-adbaad96da8a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:14.370934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc151b-f762-43a6-af22-adbaad96da8a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:14.372579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 262/547] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:14.377720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add97f8-35fe-4c8b-9223-33bee24ebaa4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:14.378007 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add97f8-35fe-4c8b-9223-33bee24ebaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:14.378286 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add97f8-35fe-4c8b-9223-33bee24ebaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:14.383089 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9fd31-4ca2-447c-9502-5a21e535cef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:14.383771 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9fd31-4ca2-447c-9502-5a21e535cef9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:14.384155 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9fd31-4ca2-447c-9502-5a21e535cef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:14.384460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9fd31-4ca2-447c-9502-5a21e535cef9 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:14.385189 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9fd31-4ca2-447c-9502-5a21e535cef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:14.385493 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9fd31-4ca2-447c-9502-5a21e535cef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:14.386876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9fd31-4ca2-447c-9502-5a21e535cef9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:14.395139 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1add97f8-35fe-4c8b-9223-33bee24ebaa4 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:14.396324 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1add97f8-35fe-4c8b-9223-33bee24ebaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:14.409630 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 286/548] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:14.416681 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9fd31-4ca2-447c-9502-5a21e535cef9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:14.470045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 263/549] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:50:14.494880 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add97f8-35fe-4c8b-9223-33bee24ebaa4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:14.594063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add97f8-35fe-4c8b-9223-33bee24ebaa4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:14.627399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9fd31-4ca2-447c-9502-5a21e535cef9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:14.628251 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef1b8e-a516-46ee-9a9f-86154ef54a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:14.629057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef1b8e-a516-46ee-9a9f-86154ef54a23 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:14.629337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef1b8e-a516-46ee-9a9f-86154ef54a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:14.629607 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef1b8e-a516-46ee-9a9f-86154ef54a23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:14.647136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef1b8e-a516-46ee-9a9f-86154ef54a23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9bef1b8e-a516-46ee-9a9f-86154ef54a23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:14.650868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:14.651920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:14.652714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:14.652714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:14.652714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:14.652714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:14.652714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:14.652714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:14.652714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:14.652714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:14.652714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:14.652714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:14.652714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:14.652714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:14.652714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 264/550] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:14.659156 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef1b8e-a516-46ee-9a9f-86154ef54a23 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:14.715591 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e4a19-0d7f-4ec4-bd73-2a62d2e767a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:14.716334 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e4a19-0d7f-4ec4-bd73-2a62d2e767a4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:14.716614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e4a19-0d7f-4ec4-bd73-2a62d2e767a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:14.716884 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e4a19-0d7f-4ec4-bd73-2a62d2e767a4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:14.736380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e4a19-0d7f-4ec4-bd73-2a62d2e767a4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:14.737854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e4a19-0d7f-4ec4-bd73-2a62d2e767a4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:14.771351 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef1b8e-a516-46ee-9a9f-86154ef54a23 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-f47e4a19-0d7f-4ec4-bd73-2a62d2e767a4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:14.772505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:14.773412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:14.774297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:14.774297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:14.774297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:14.774297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:14.774297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:14.774297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:14.774297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:14.774297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:14.774297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 21:50:14.774297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:14.774297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 287/551] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:50:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:14.792200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e4a19-0d7f-4ec4-bd73-2a62d2e767a4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:14.815191 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb34ce-4efc-45a2-b2d5-7ec08dacf4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:14.826027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb34ce-4efc-45a2-b2d5-7ec08dacf4ab None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:14.826027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb34ce-4efc-45a2-b2d5-7ec08dacf4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:14.826027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb34ce-4efc-45a2-b2d5-7ec08dacf4ab None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:14.826027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb34ce-4efc-45a2-b2d5-7ec08dacf4ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:14.826027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb34ce-4efc-45a2-b2d5-7ec08dacf4ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:14.826027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb34ce-4efc-45a2-b2d5-7ec08dacf4ab None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:14.829454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 265/552] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:14.835410 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb34ce-4efc-45a2-b2d5-7ec08dacf4ab None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:14.930669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e4a19-0d7f-4ec4-bd73-2a62d2e767a4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:14.966120 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a044c-9b35-4267-937a-245f34351523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:14.966712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a044c-9b35-4267-937a-245f34351523 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:14.966988 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a044c-9b35-4267-937a-245f34351523 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:14.967291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a044c-9b35-4267-937a-245f34351523 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:14.967860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb34ce-4efc-45a2-b2d5-7ec08dacf4ab None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:14.968140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a044c-9b35-4267-937a-245f34351523 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:14.968440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a044c-9b35-4267-937a-245f34351523 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:14.969900 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a044c-9b35-4267-937a-245f34351523 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:14.991048 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 288/553] 10.222.0.24 () {56 vars in 1135 bytes} [Tue May 17 21:50:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:14.992410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50de10c-8ff2-47a2-99d7-81eb2d6886c8 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:14.992694 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50de10c-8ff2-47a2-99d7-81eb2d6886c8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:14.992967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50de10c-8ff2-47a2-99d7-81eb2d6886c8 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:14.995101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 289/554] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:14.998877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50de10c-8ff2-47a2-99d7-81eb2d6886c8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:15.012180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d03c7-e2f0-447b-aebe-cf695c8d97ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:15.013064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d03c7-e2f0-447b-aebe-cf695c8d97ce None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:15.013351 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d03c7-e2f0-447b-aebe-cf695c8d97ce None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:15.013679 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d03c7-e2f0-447b-aebe-cf695c8d97ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:15.026871 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d03c7-e2f0-447b-aebe-cf695c8d97ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:15.028543 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d03c7-e2f0-447b-aebe-cf695c8d97ce None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:15.047287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-964d03c7-e2f0-447b-aebe-cf695c8d97ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:15.047287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:15.047287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:15.047287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:15.047287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:15.047287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:15.047287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:15.047287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:15.047287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:15.047287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:15.047287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:15.047287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:15.047287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:15.047287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:15.047287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:15.052710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:15.055144 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:15.055144 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:15.055144 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:15.055144 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:15.055144 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 266/555] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:15.056352 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6263c-961c-4ba9-9bd8-418aa5cab166 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:15.056352 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6263c-961c-4ba9-9bd8-418aa5cab166 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:15.056634 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6263c-961c-4ba9-9bd8-418aa5cab166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:15.075390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-50c6263c-961c-4ba9-9bd8-418aa5cab166 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:15.080213 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-50c6263c-961c-4ba9-9bd8-418aa5cab166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:15.103571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50de10c-8ff2-47a2-99d7-81eb2d6886c8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:15.137875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b6bc3-8136-48ba-a998-b8ff9d5f88f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:15.138579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b6bc3-8136-48ba-a998-b8ff9d5f88f1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:15.138955 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b6bc3-8136-48ba-a998-b8ff9d5f88f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:15.139287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b6bc3-8136-48ba-a998-b8ff9d5f88f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:15.148400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 267/556] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:15.150005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6263c-961c-4ba9-9bd8-418aa5cab166 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:15.222347 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b6bc3-8136-48ba-a998-b8ff9d5f88f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:15.225087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b6bc3-8136-48ba-a998-b8ff9d5f88f1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:15.257162 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6263c-961c-4ba9-9bd8-418aa5cab166 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:15.291475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66af075-f9f2-4b4b-a265-836b63af1f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:15.292485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66af075-f9f2-4b4b-a265-836b63af1f79 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:15.292854 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66af075-f9f2-4b4b-a265-836b63af1f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:15.293138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66af075-f9f2-4b4b-a265-836b63af1f79 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:15.293922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66af075-f9f2-4b4b-a265-836b63af1f79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:15.294232 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66af075-f9f2-4b4b-a265-836b63af1f79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:15.295684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66af075-f9f2-4b4b-a265-836b63af1f79 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:15.311575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 268/557] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:15.311575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8792e-7a35-49ea-8c64-9ca462265c85 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:15.311575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8792e-7a35-49ea-8c64-9ca462265c85 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:15.311575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8792e-7a35-49ea-8c64-9ca462265c85 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:15.311575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 269/558] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:15.311575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8792e-7a35-49ea-8c64-9ca462265c85 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:15.333873 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 290/559] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:50:15.334999 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b6bc3-8136-48ba-a998-b8ff9d5f88f1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:15.419630 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8792e-7a35-49ea-8c64-9ca462265c85 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:15.434217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b6bc3-8136-48ba-a998-b8ff9d5f88f1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:15.455941 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3c601-aa4e-49d0-ba67-0829ffd8b5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:15.456732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3c601-aa4e-49d0-ba67-0829ffd8b5be None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:15.457010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3c601-aa4e-49d0-ba67-0829ffd8b5be None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:15.457282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3c601-aa4e-49d0-ba67-0829ffd8b5be None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:15.468099 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3c601-aa4e-49d0-ba67-0829ffd8b5be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:15.469024 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06240992-fac6-4711-8633-102160210e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:15.469810 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06240992-fac6-4711-8633-102160210e31 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:15.470092 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06240992-fac6-4711-8633-102160210e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:15.470363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06240992-fac6-4711-8633-102160210e31 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-bda3c601-aa4e-49d0-ba67-0829ffd8b5be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:15.475841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:15.476700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:15.477464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:15.477464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:15.477464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:15.477464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:15.477464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:15.477464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:15.477464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:15.477464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:15.477464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:15.477464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:15.477464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:15.477464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:15.477464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 270/560] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:15.479407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c15266-2c21-477f-b299-473f6f9fa131 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:15.479666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c15266-2c21-477f-b299-473f6f9fa131 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:15.479938 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c15266-2c21-477f-b299-473f6f9fa131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:15.483387 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06240992-fac6-4711-8633-102160210e31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:15.484896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06240992-fac6-4711-8633-102160210e31 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:15.497587 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-74c15266-2c21-477f-b299-473f6f9fa131 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:15.498752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-74c15266-2c21-477f-b299-473f6f9fa131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-06240992-fac6-4711-8633-102160210e31 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:15.501240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:15.503208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:15.504923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:15.504923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:15.504923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:15.504923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:15.504923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:15.504923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:15.504923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:15.504923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:15.504923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 21:50:15.504923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:15.504923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 291/561] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:50:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:15.504923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06240992-fac6-4711-8633-102160210e31 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:15.575469 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 271/562] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:15.576321 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c15266-2c21-477f-b299-473f6f9fa131 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:15.605150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06240992-fac6-4711-8633-102160210e31 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:15.639199 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c575d5-5e66-440c-a9c4-8ced2972c60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:15.639987 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c575d5-5e66-440c-a9c4-8ced2972c60c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:15.640259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c575d5-5e66-440c-a9c4-8ced2972c60c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:15.640727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c575d5-5e66-440c-a9c4-8ced2972c60c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:15.651326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c575d5-5e66-440c-a9c4-8ced2972c60c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:15.652800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c575d5-5e66-440c-a9c4-8ced2972c60c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:15.670162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-d7c575d5-5e66-440c-a9c4-8ced2972c60c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:15.670162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:15.670162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:15.670162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:15.670162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:15.670162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:15.670162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:15.670162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:15.670162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:15.670162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:15.670162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:15.670162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:15.670162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:15.670162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:15.670162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:15.671083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:15.671963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:15.671963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:15.671963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:15.671963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:15.671963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 292/563] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:15.672239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c575d5-5e66-440c-a9c4-8ced2972c60c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:15.687599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c15266-2c21-477f-b299-473f6f9fa131 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:15.720650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cbecb-f519-4fc1-be77-fd4399f2ea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:15.721315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cbecb-f519-4fc1-be77-fd4399f2ea45 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:15.721597 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cbecb-f519-4fc1-be77-fd4399f2ea45 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:15.721926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cbecb-f519-4fc1-be77-fd4399f2ea45 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:15.722672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cbecb-f519-4fc1-be77-fd4399f2ea45 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:15.723028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cbecb-f519-4fc1-be77-fd4399f2ea45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:15.724424 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cbecb-f519-4fc1-be77-fd4399f2ea45 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:15.733272 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 272/564] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:15.738258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cbecb-f519-4fc1-be77-fd4399f2ea45 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:15.773283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c575d5-5e66-440c-a9c4-8ced2972c60c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:15.808531 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d685942-f170-4158-b8a7-3304185fb477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:15.809184 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d685942-f170-4158-b8a7-3304185fb477 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:15.809461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d685942-f170-4158-b8a7-3304185fb477 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:15.809730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d685942-f170-4158-b8a7-3304185fb477 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:15.810563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d685942-f170-4158-b8a7-3304185fb477 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:15.810860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d685942-f170-4158-b8a7-3304185fb477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:15.812332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d685942-f170-4158-b8a7-3304185fb477 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:15.830026 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 293/565] 10.222.0.24 () {56 vars in 1137 bytes} [Tue May 17 21:50:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:15.832515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d685942-f170-4158-b8a7-3304185fb477 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:15.841542 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cbecb-f519-4fc1-be77-fd4399f2ea45 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:15.873769 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173567b6-0193-4d9d-923a-8a866533a6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:15.874873 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173567b6-0193-4d9d-923a-8a866533a6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:15.875392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173567b6-0193-4d9d-923a-8a866533a6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:15.875732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173567b6-0193-4d9d-923a-8a866533a6f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:15.885813 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173567b6-0193-4d9d-923a-8a866533a6f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-173567b6-0193-4d9d-923a-8a866533a6f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:15.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:15.897161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:15.904268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:15.904268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:15.904268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:15.904268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:15.904268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:15.904268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:15.904268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:15.904268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:15.904268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:15.904268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:15.904268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:15.904268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:15.904268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 273/566] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:15.904268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173567b6-0193-4d9d-923a-8a866533a6f9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:15.941977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d685942-f170-4158-b8a7-3304185fb477 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:15.974681 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d0175-3074-40bb-ab73-7353cc96229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:15.975362 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d0175-3074-40bb-ab73-7353cc96229d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:15.975638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d0175-3074-40bb-ab73-7353cc96229d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:15.975902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d0175-3074-40bb-ab73-7353cc96229d None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:15.976862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d0175-3074-40bb-ab73-7353cc96229d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:15.976987 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d0175-3074-40bb-ab73-7353cc96229d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:15.978989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d0175-3074-40bb-ab73-7353cc96229d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:15.989739 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 294/567] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:15.990443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d0175-3074-40bb-ab73-7353cc96229d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:15.998790 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173567b6-0193-4d9d-923a-8a866533a6f9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:16.030534 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd1b1e-f9b0-4d96-acff-de2e8eb210fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:16.031339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd1b1e-f9b0-4d96-acff-de2e8eb210fc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:16.031615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd1b1e-f9b0-4d96-acff-de2e8eb210fc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:16.031883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd1b1e-f9b0-4d96-acff-de2e8eb210fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:16.042274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd1b1e-f9b0-4d96-acff-de2e8eb210fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:16.043742 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd1b1e-f9b0-4d96-acff-de2e8eb210fc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:16.060610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ecbd1b1e-f9b0-4d96-acff-de2e8eb210fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:16.060610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:16.060610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:16.060610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:16.060610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:16.060610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:16.060610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:16.060610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:16.060610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:16.060610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:16.060610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:16.060610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:16.060610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:16.060610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:16.060610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:16.061625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:16.062523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:16.062523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:16.062523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:16.062523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:16.062523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 274/568] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:16.062931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd1b1e-f9b0-4d96-acff-de2e8eb210fc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:16.087596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d0175-3074-40bb-ab73-7353cc96229d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:16.120305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f528e-0b18-46c6-88a1-3c12fbc06aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:16.121086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f528e-0b18-46c6-88a1-3c12fbc06aed None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:16.121367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f528e-0b18-46c6-88a1-3c12fbc06aed None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:16.121643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f528e-0b18-46c6-88a1-3c12fbc06aed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:16.131779 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f528e-0b18-46c6-88a1-3c12fbc06aed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:16.133232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f528e-0b18-46c6-88a1-3c12fbc06aed None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:16.150360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-4d2f528e-0b18-46c6-88a1-3c12fbc06aed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:16.150360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:16.150360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:16.150360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:16.150360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:16.150360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:16.150360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:16.150360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:16.150360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:16.150360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:16.150360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:16.150360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:16.150360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:16.150360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:16.150360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:16.151318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:16.152143 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:16.152143 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:16.152143 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:16.152143 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:16.152143 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 295/569] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:16.153068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770232dc-96ef-4ccd-9ee9-09b2e30756f5 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:16.153349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770232dc-96ef-4ccd-9ee9-09b2e30756f5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:16.153621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770232dc-96ef-4ccd-9ee9-09b2e30756f5 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:16.154861 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 296/570] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:16.155575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770232dc-96ef-4ccd-9ee9-09b2e30756f5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:16.160832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd1b1e-f9b0-4d96-acff-de2e8eb210fc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:16.192854 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c69ba-dc87-41f3-b97f-96e4e07f1d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:16.193501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c69ba-dc87-41f3-b97f-96e4e07f1d44 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:16.193783 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c69ba-dc87-41f3-b97f-96e4e07f1d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:16.194056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c69ba-dc87-41f3-b97f-96e4e07f1d44 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:16.194786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c69ba-dc87-41f3-b97f-96e4e07f1d44 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:16.195087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c69ba-dc87-41f3-b97f-96e4e07f1d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:16.197095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c69ba-dc87-41f3-b97f-96e4e07f1d44 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:16.204715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 275/571] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:16.205477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c69ba-dc87-41f3-b97f-96e4e07f1d44 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:16.260117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770232dc-96ef-4ccd-9ee9-09b2e30756f5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:16.293530 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b4cbc-f4cb-4b4c-96df-8a3ef8089454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:16.294306 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b4cbc-f4cb-4b4c-96df-8a3ef8089454 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:16.294585 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b4cbc-f4cb-4b4c-96df-8a3ef8089454 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:16.294853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b4cbc-f4cb-4b4c-96df-8a3ef8089454 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:16.300096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c69ba-dc87-41f3-b97f-96e4e07f1d44 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:16.301595 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b4cbc-f4cb-4b4c-96df-8a3ef8089454 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:16.303037 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b4cbc-f4cb-4b4c-96df-8a3ef8089454 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:16.317556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-058b4cbc-f4cb-4b4c-96df-8a3ef8089454 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:16.317556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:16.317556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:16.317556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:16.317556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:16.317556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:16.317556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:16.317556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:16.317556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:16.317556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:16.317556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:16.317556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:16.317556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:16.317556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:16.317556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:16.318592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:16.319548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:16.319548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:16.319548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:16.319548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:16.319548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:16.319548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:16.319548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:16.319548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:16.319548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 297/572] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:16.320147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b4cbc-f4cb-4b4c-96df-8a3ef8089454 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:16.336602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d61ba8-652c-48e7-9fa1-79850d69ad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:16.337861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d61ba8-652c-48e7-9fa1-79850d69ad97 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:16.338138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d61ba8-652c-48e7-9fa1-79850d69ad97 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:16.338408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d61ba8-652c-48e7-9fa1-79850d69ad97 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:16.339133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d61ba8-652c-48e7-9fa1-79850d69ad97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:16.339436 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d61ba8-652c-48e7-9fa1-79850d69ad97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:16.340769 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d61ba8-652c-48e7-9fa1-79850d69ad97 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:16.351874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 276/573] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:16.353139 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2833-9899-4025-ba87-411b44b72f9b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:16.353425 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2833-9899-4025-ba87-411b44b72f9b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:16.353695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2833-9899-4025-ba87-411b44b72f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:16.369698 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0fcd2833-9899-4025-ba87-411b44b72f9b None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:16.370894 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0fcd2833-9899-4025-ba87-411b44b72f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:16.415877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b4cbc-f4cb-4b4c-96df-8a3ef8089454 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:16.434030 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 277/574] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:16.434842 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2833-9899-4025-ba87-411b44b72f9b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:16.447995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a2b77-3e75-49d1-a2b1-d136f389781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:16.448649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a2b77-3e75-49d1-a2b1-d136f389781c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:16.448926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a2b77-3e75-49d1-a2b1-d136f389781c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:16.449199 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a2b77-3e75-49d1-a2b1-d136f389781c None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:16.449911 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a2b77-3e75-49d1-a2b1-d136f389781c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:16.450215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a2b77-3e75-49d1-a2b1-d136f389781c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:16.451621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a2b77-3e75-49d1-a2b1-d136f389781c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:16.463731 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 298/575] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:16.464578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a2b77-3e75-49d1-a2b1-d136f389781c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:16.536870 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2833-9899-4025-ba87-411b44b72f9b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:16.558480 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a2b77-3e75-49d1-a2b1-d136f389781c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:16.570870 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b88c3-b359-4f8c-8b51-ed131f4116d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:16.571923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b88c3-b359-4f8c-8b51-ed131f4116d3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:16.572092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b88c3-b359-4f8c-8b51-ed131f4116d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:16.572357 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b88c3-b359-4f8c-8b51-ed131f4116d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:16.582091 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b88c3-b359-4f8c-8b51-ed131f4116d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:16.583572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b88c3-b359-4f8c-8b51-ed131f4116d3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:16.592694 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3ba74-c8bf-44d2-baf2-349b162b955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:16.593345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3ba74-c8bf-44d2-baf2-349b162b955e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:16.593624 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3ba74-c8bf-44d2-baf2-349b162b955e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:16.593893 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3ba74-c8bf-44d2-baf2-349b162b955e None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:16.594696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3ba74-c8bf-44d2-baf2-349b162b955e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:16.595001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3ba74-c8bf-44d2-baf2-349b162b955e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:16.596461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3ba74-c8bf-44d2-baf2-349b162b955e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:16.601472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1a9b88c3-b359-4f8c-8b51-ed131f4116d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:16.601472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:16.601472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:16.601472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:16.601472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:16.601472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:16.601472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:16.601472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:16.601472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:16.601472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:16.601472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:16.601472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:16.601472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:16.601472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:16.601472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:16.602471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:16.604315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:16.604315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:16.604315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:16.604315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:16.604315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 278/576] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:16.604315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b88c3-b359-4f8c-8b51-ed131f4116d3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:16.608897 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 299/577] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:16.609692 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3ba74-c8bf-44d2-baf2-349b162b955e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:16.702009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b88c3-b359-4f8c-8b51-ed131f4116d3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:16.702542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3ba74-c8bf-44d2-baf2-349b162b955e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:16.734600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220eda20-807d-4e29-9038-7d4a32ce04ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:16.735163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fd678-5a41-42b3-b87b-b5b48e39cf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:16.735404 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eda20-807d-4e29-9038-7d4a32ce04ea None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:16.735674 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eda20-807d-4e29-9038-7d4a32ce04ea None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:16.735944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eda20-807d-4e29-9038-7d4a32ce04ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:16.736044 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fd678-5a41-42b3-b87b-b5b48e39cf5d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:16.736220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fd678-5a41-42b3-b87b-b5b48e39cf5d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:16.736500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fd678-5a41-42b3-b87b-b5b48e39cf5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:16.742677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220eda20-807d-4e29-9038-7d4a32ce04ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:16.744308 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220eda20-807d-4e29-9038-7d4a32ce04ea None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:16.746277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fd678-5a41-42b3-b87b-b5b48e39cf5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-002fd678-5a41-42b3-b87b-b5b48e39cf5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:16.753954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:16.755030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:16.761546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:16.761546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:16.761546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:16.761546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:16.761546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:16.761546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:16.761546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:16.761546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:16.761546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:16.761546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:16.761546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:16.761546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:16.761546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 300/578] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:16.761546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fd678-5a41-42b3-b87b-b5b48e39cf5d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-220eda20-807d-4e29-9038-7d4a32ce04ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:16.762456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:16.763500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:16.764639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:16.764639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:16.764639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:16.764639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:16.764639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:16.764639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:16.764639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:16.764639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:16.764639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 21:50:16.764639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:16.764639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 279/579] 10.222.0.24 () {56 vars in 1093 bytes} [Tue May 17 21:50:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:16.764639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220eda20-807d-4e29-9038-7d4a32ce04ea None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:16.851514 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fd678-5a41-42b3-b87b-b5b48e39cf5d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:16.857963 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220eda20-807d-4e29-9038-7d4a32ce04ea None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:16.888908 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384849bf-0525-4749-aaa0-ba47d312beff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:16.890073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384849bf-0525-4749-aaa0-ba47d312beff None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:16.890493 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384849bf-0525-4749-aaa0-ba47d312beff None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:16.890898 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384849bf-0525-4749-aaa0-ba47d312beff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:16.892805 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc307e2c-fe6e-4324-a59e-ba30e0aa4232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:16.893452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc307e2c-fe6e-4324-a59e-ba30e0aa4232 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:16.893727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc307e2c-fe6e-4324-a59e-ba30e0aa4232 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:16.893996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc307e2c-fe6e-4324-a59e-ba30e0aa4232 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:16.894715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc307e2c-fe6e-4324-a59e-ba30e0aa4232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:16.895012 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc307e2c-fe6e-4324-a59e-ba30e0aa4232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:16.896387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc307e2c-fe6e-4324-a59e-ba30e0aa4232 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:16.901865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384849bf-0525-4749-aaa0-ba47d312beff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:16.904587 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384849bf-0525-4749-aaa0-ba47d312beff None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:16.908841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 280/580] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:16.909691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc307e2c-fe6e-4324-a59e-ba30e0aa4232 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:16.921301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-384849bf-0525-4749-aaa0-ba47d312beff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:16.921301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:16.921301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:16.921301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:16.921301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:16.921301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:16.921301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:16.921301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:16.921301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:16.921301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:16.921301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:16.921301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:16.921301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:16.921301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:16.921301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:16.922399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:16.923402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:16.923402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:16.923402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:16.923402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:16.923402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:16.923402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:16.923402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:16.923402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:16.923402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 301/581] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:16.924021 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384849bf-0525-4749-aaa0-ba47d312beff None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:17.008644 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc307e2c-fe6e-4324-a59e-ba30e0aa4232 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:17.025539 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384849bf-0525-4749-aaa0-ba47d312beff None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:17.040671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2bed-4d63-45b9-b8d7-693e6c19c5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:17.041320 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2bed-4d63-45b9-b8d7-693e6c19c5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:17.041598 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2bed-4d63-45b9-b8d7-693e6c19c5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:17.041869 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2bed-4d63-45b9-b8d7-693e6c19c5d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:17.042681 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec2bed-4d63-45b9-b8d7-693e6c19c5d0 None admin] RBAC: Adding query filter params (role.id=17cc20a61bbf4f5ea7ae111203cfda47, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=957c3decfb19445d80836f767fa23bd7) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:17.042984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec2bed-4d63-45b9-b8d7-693e6c19c5d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:17.044416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec2bed-4d63-45b9-b8d7-693e6c19c5d0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:17.055946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 281/582] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:16 2022] GET /identity/v3/role_assignments?user.id=957c3decfb19445d80836f767fa23bd7&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=17cc20a61bbf4f5ea7ae111203cfda47 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:17.055946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2bed-4d63-45b9-b8d7-693e6c19c5d0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:17.058997 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad7aa2-942d-4ed9-8dac-2e6fa130fd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:17.059718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad7aa2-942d-4ed9-8dac-2e6fa130fd57 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:17.060002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad7aa2-942d-4ed9-8dac-2e6fa130fd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:17.060278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad7aa2-942d-4ed9-8dac-2e6fa130fd57 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:17.061047 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad7aa2-942d-4ed9-8dac-2e6fa130fd57 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:17.061353 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad7aa2-942d-4ed9-8dac-2e6fa130fd57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:17.062773 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad7aa2-942d-4ed9-8dac-2e6fa130fd57 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:17.072183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 302/583] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:17.073053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad7aa2-942d-4ed9-8dac-2e6fa130fd57 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:17.166471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2bed-4d63-45b9-b8d7-693e6c19c5d0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:17.180443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad7aa2-942d-4ed9-8dac-2e6fa130fd57 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:17.207893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c679c-d2f2-41a3-b89d-582966fbb9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:17.208627 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c679c-d2f2-41a3-b89d-582966fbb9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:17.208914 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c679c-d2f2-41a3-b89d-582966fbb9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:17.209195 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c679c-d2f2-41a3-b89d-582966fbb9e2 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:17.210056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c679c-d2f2-41a3-b89d-582966fbb9e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:17.210367 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c679c-d2f2-41a3-b89d-582966fbb9e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:17.212435 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c679c-d2f2-41a3-b89d-582966fbb9e2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:17.218233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d836b1-230c-4c4e-962a-9a673e8b092f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:17.219038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d836b1-230c-4c4e-962a-9a673e8b092f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:17.219345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d836b1-230c-4c4e-962a-9a673e8b092f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:17.219613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d836b1-230c-4c4e-962a-9a673e8b092f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:17.228793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d836b1-230c-4c4e-962a-9a673e8b092f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:17.230302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d836b1-230c-4c4e-962a-9a673e8b092f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:17.239663 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 282/584] 10.222.0.24 () {56 vars in 1133 bytes} [Tue May 17 21:50:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:17.240258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c679c-d2f2-41a3-b89d-582966fbb9e2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e7d836b1-230c-4c4e-962a-9a673e8b092f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:17.245914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:17.246859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:17.247829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:17.247829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:17.247829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:17.247829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:17.247829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:17.247829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:17.247829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:17.247829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:17.247829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 21:50:17.247829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:17.252462 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 303/585] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:50:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:17.252462 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d836b1-230c-4c4e-962a-9a673e8b092f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:17.342767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c679c-d2f2-41a3-b89d-582966fbb9e2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:17.349714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d836b1-230c-4c4e-962a-9a673e8b092f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:17.376054 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052d9ac-e048-4dd6-b7b5-26dff09e810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:17.376947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052d9ac-e048-4dd6-b7b5-26dff09e810c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:17.377233 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052d9ac-e048-4dd6-b7b5-26dff09e810c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:17.377508 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052d9ac-e048-4dd6-b7b5-26dff09e810c None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:17.378290 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052d9ac-e048-4dd6-b7b5-26dff09e810c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:17.378597 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052d9ac-e048-4dd6-b7b5-26dff09e810c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:17.380066 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052d9ac-e048-4dd6-b7b5-26dff09e810c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:17.382718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ef588-6603-4d5d-bb70-8c3f45c92db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:17.383550 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ef588-6603-4d5d-bb70-8c3f45c92db1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:17.384444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ef588-6603-4d5d-bb70-8c3f45c92db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:17.384721 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ef588-6603-4d5d-bb70-8c3f45c92db1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:17.396372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 283/586] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:17.396372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052d9ac-e048-4dd6-b7b5-26dff09e810c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:17.399150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ef588-6603-4d5d-bb70-8c3f45c92db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:17.401332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ef588-6603-4d5d-bb70-8c3f45c92db1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:17.418705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e23ef588-6603-4d5d-bb70-8c3f45c92db1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:17.418705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:17.418705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:17.418705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:17.418705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:17.418705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:17.418705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:17.418705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:17.418705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:17.418705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:17.418705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:17.418705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:17.418705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:17.418705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:17.418705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:17.419819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:17.420711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:17.420711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:17.420711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:17.420711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:17.420711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 304/587] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:17.420711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ef588-6603-4d5d-bb70-8c3f45c92db1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:17.505000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052d9ac-e048-4dd6-b7b5-26dff09e810c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:17.531031 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ef588-6603-4d5d-bb70-8c3f45c92db1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:17.538830 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5aa46-136a-4ad4-9128-73edad682b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:17.539724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5aa46-136a-4ad4-9128-73edad682b69 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:17.540042 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5aa46-136a-4ad4-9128-73edad682b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:17.540311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5aa46-136a-4ad4-9128-73edad682b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:17.550619 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5aa46-136a-4ad4-9128-73edad682b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:17.552369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5aa46-136a-4ad4-9128-73edad682b69 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:17.564497 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa2a6d-f5ad-48ca-8011-37dea6f0588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:17.565157 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa2a6d-f5ad-48ca-8011-37dea6f0588b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:17.565435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa2a6d-f5ad-48ca-8011-37dea6f0588b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:17.565705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa2a6d-f5ad-48ca-8011-37dea6f0588b None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:17.567974 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa2a6d-f5ad-48ca-8011-37dea6f0588b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:17.568425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa2a6d-f5ad-48ca-8011-37dea6f0588b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:17.569959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa2a6d-f5ad-48ca-8011-37dea6f0588b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:17.570049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-afb5aa46-136a-4ad4-9128-73edad682b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:17.570049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:17.570049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:17.570049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:17.570049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:17.570049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:17.570049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:17.570049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:17.570049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:17.570049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:17.570049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:17.570049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:17.570049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:17.570049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:17.570049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:17.570994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:17.572692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:17.572692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:17.572692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:17.572692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:17.574519 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 284/588] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:17.575426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5aa46-136a-4ad4-9128-73edad682b69 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:17.591766 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 305/589] 10.222.0.24 () {56 vars in 1137 bytes} [Tue May 17 21:50:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:17.592711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa2a6d-f5ad-48ca-8011-37dea6f0588b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:17.679972 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5aa46-136a-4ad4-9128-73edad682b69 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:17.689972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa2a6d-f5ad-48ca-8011-37dea6f0588b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:17.712727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c219b3-b6e1-4f32-8707-edcf3475229e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:17.713617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c219b3-b6e1-4f32-8707-edcf3475229e None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:17.713902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c219b3-b6e1-4f32-8707-edcf3475229e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:17.714281 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c219b3-b6e1-4f32-8707-edcf3475229e None admin] PATH_INFO: `/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/68748827b9f14eb7958d5b202c5d6877/roles/17cc20a61bbf4f5ea7ae111203cfda47` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:17.724048 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb0e2e-fbe5-4e51-a2cb-d419797a0535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:17.724789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb0e2e-fbe5-4e51-a2cb-d419797a0535 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:17.725138 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb0e2e-fbe5-4e51-a2cb-d419797a0535 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:17.725477 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb0e2e-fbe5-4e51-a2cb-d419797a0535 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:17.726262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb0e2e-fbe5-4e51-a2cb-d419797a0535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:17.726632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb0e2e-fbe5-4e51-a2cb-d419797a0535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:17.729320 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb0e2e-fbe5-4e51-a2cb-d419797a0535 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:17.729527 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c219b3-b6e1-4f32-8707-edcf3475229e None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e90e91d3094e67b09b2b8137f210f4, user_id=68748827b9f14eb7958d5b202c5d6877, role_id=17cc20a61bbf4f5ea7ae111203cfda47)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:17.731025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c219b3-b6e1-4f32-8707-edcf3475229e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:17.740677 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 306/590] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:17.741551 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb0e2e-fbe5-4e51-a2cb-d419797a0535 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:17.818306 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 285/591] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:50:17 2022] PUT /identity/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/68748827b9f14eb7958d5b202c5d6877/roles/17cc20a61bbf4f5ea7ae111203cfda47 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:50:17.819143 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c219b3-b6e1-4f32-8707-edcf3475229e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:17.844880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb0e2e-fbe5-4e51-a2cb-d419797a0535 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:17.881180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dee88-caf3-4783-a8ed-82a0ed9f90f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:17.881852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dee88-caf3-4783-a8ed-82a0ed9f90f4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:17.882125 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dee88-caf3-4783-a8ed-82a0ed9f90f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:17.882396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dee88-caf3-4783-a8ed-82a0ed9f90f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:17.883140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dee88-caf3-4783-a8ed-82a0ed9f90f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:17.883448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dee88-caf3-4783-a8ed-82a0ed9f90f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:17.885486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dee88-caf3-4783-a8ed-82a0ed9f90f4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:17.898623 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 307/592] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:17.899706 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dee88-caf3-4783-a8ed-82a0ed9f90f4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:17.952345 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c219b3-b6e1-4f32-8707-edcf3475229e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:17.990108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4faa9-10be-4241-895a-1721fdbb8ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:17.991225 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4faa9-10be-4241-895a-1721fdbb8ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:17.991658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4faa9-10be-4241-895a-1721fdbb8ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:17.992081 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4faa9-10be-4241-895a-1721fdbb8ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:18.003932 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4faa9-10be-4241-895a-1721fdbb8ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:18.005886 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4faa9-10be-4241-895a-1721fdbb8ff3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:18.008483 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dee88-caf3-4783-a8ed-82a0ed9f90f4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:18.026236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-bba4faa9-10be-4241-895a-1721fdbb8ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:18.026236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:18.026236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:18.026236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:18.026236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:18.026236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:18.026236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:18.026236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:18.026236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:18.026236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:18.026236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:18.026236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:18.026236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:18.026236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:18.026236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:18.027399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:18.028468 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:18.028468 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:18.028468 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:18.028468 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:18.030407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 286/593] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:18.031457 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4faa9-10be-4241-895a-1721fdbb8ff3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:18.046312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67320607-642c-4003-85ea-e36d6bb9fd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:18.047144 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67320607-642c-4003-85ea-e36d6bb9fd10 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:18.047414 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67320607-642c-4003-85ea-e36d6bb9fd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:18.047682 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67320607-642c-4003-85ea-e36d6bb9fd10 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:18.055391 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67320607-642c-4003-85ea-e36d6bb9fd10 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:18.057858 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67320607-642c-4003-85ea-e36d6bb9fd10 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-67320607-642c-4003-85ea-e36d6bb9fd10 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:18.072994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:18.073946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:18.074849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:18.074849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:18.074849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:18.074849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:18.074849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:18.074849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:18.074849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:18.074849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:18.074849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 21:50:18.074849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:18.074849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 308/594] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:18.079776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67320607-642c-4003-85ea-e36d6bb9fd10 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:18.153067 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4faa9-10be-4241-895a-1721fdbb8ff3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:18.201184 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07151e1-386f-48a3-999e-e0dd4b0dcd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:18.202227 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07151e1-386f-48a3-999e-e0dd4b0dcd16 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:18.202728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07151e1-386f-48a3-999e-e0dd4b0dcd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:18.203170 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07151e1-386f-48a3-999e-e0dd4b0dcd16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:18.207746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67320607-642c-4003-85ea-e36d6bb9fd10 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:18.211046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07151e1-386f-48a3-999e-e0dd4b0dcd16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:18.213928 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07151e1-386f-48a3-999e-e0dd4b0dcd16 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:18.228426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e07151e1-386f-48a3-999e-e0dd4b0dcd16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:18.228426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:18.228426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:18.228426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:18.228426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:18.228426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:18.228426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:18.228426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:18.228426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:18.228426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:18.228426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:18.228426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:18.228426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:18.228426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:18.228426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:18.229474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:18.230442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:18.230442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:18.230442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:18.230442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:18.230442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:18.230442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:18.230442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:18.230442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:18.236767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 287/595] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:18.237849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07151e1-386f-48a3-999e-e0dd4b0dcd16 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:18.245126 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6960b-a3ad-424d-8b4d-44f76a9d512c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:18.245790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6960b-a3ad-424d-8b4d-44f76a9d512c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:18.246068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6960b-a3ad-424d-8b4d-44f76a9d512c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:18.246395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6960b-a3ad-424d-8b4d-44f76a9d512c None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:18.247133 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6960b-a3ad-424d-8b4d-44f76a9d512c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:18.247493 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6960b-a3ad-424d-8b4d-44f76a9d512c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:18.248860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6960b-a3ad-424d-8b4d-44f76a9d512c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:18.266864 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 309/596] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:18.266864 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6960b-a3ad-424d-8b4d-44f76a9d512c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:18.362376 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6960b-a3ad-424d-8b4d-44f76a9d512c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:18.370206 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07151e1-386f-48a3-999e-e0dd4b0dcd16 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:18.395736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef900d4-093f-4f05-a88b-c589b1888794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:18.396471 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef900d4-093f-4f05-a88b-c589b1888794 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:18.396709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef900d4-093f-4f05-a88b-c589b1888794 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:18.396989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef900d4-093f-4f05-a88b-c589b1888794 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:18.397754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef900d4-093f-4f05-a88b-c589b1888794 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:18.398055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef900d4-093f-4f05-a88b-c589b1888794 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:18.399552 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef900d4-093f-4f05-a88b-c589b1888794 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:18.411828 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb674f-178b-428e-86ab-936e592d09ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:18.412016 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 310/597] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:18.412738 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef900d4-093f-4f05-a88b-c589b1888794 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:18.412953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb674f-178b-428e-86ab-936e592d09ee None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:18.413371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb674f-178b-428e-86ab-936e592d09ee None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:18.413808 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb674f-178b-428e-86ab-936e592d09ee None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:18.414794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb674f-178b-428e-86ab-936e592d09ee None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:18.416004 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb674f-178b-428e-86ab-936e592d09ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:18.418470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb674f-178b-428e-86ab-936e592d09ee None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:18.444466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 288/598] 10.222.0.24 () {56 vars in 1139 bytes} [Tue May 17 21:50:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:18.445548 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb674f-178b-428e-86ab-936e592d09ee None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:18.538674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef900d4-093f-4f05-a88b-c589b1888794 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:18.545683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb674f-178b-428e-86ab-936e592d09ee None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:18.579026 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1bbb1-004f-4175-be31-656652f1eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:18.580005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1bbb1-004f-4175-be31-656652f1eefe None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:18.580286 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1bbb1-004f-4175-be31-656652f1eefe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:18.580554 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1bbb1-004f-4175-be31-656652f1eefe None admin] PATH_INFO: `/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/8d06113649924eae83d04bc22337bd6d/roles/17cc20a61bbf4f5ea7ae111203cfda47` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:18.582650 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc617020-69e3-4f53-a8f2-60c93ed8f822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:18.584575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc617020-69e3-4f53-a8f2-60c93ed8f822 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:18.585025 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc617020-69e3-4f53-a8f2-60c93ed8f822 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:18.585438 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc617020-69e3-4f53-a8f2-60c93ed8f822 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:18.594810 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc617020-69e3-4f53-a8f2-60c93ed8f822 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:18.595900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1bbb1-004f-4175-be31-656652f1eefe None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e90e91d3094e67b09b2b8137f210f4, user_id=8d06113649924eae83d04bc22337bd6d, role_id=17cc20a61bbf4f5ea7ae111203cfda47)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:18.596286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc617020-69e3-4f53-a8f2-60c93ed8f822 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:18.597699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1bbb1-004f-4175-be31-656652f1eefe None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:18.611027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-cc617020-69e3-4f53-a8f2-60c93ed8f822 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:18.611027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:18.611027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:18.611027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:18.611027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:18.611027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:18.611027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:18.611027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:18.611027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:18.611027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:18.611027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:18.611027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:18.611027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:18.611027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:18.611027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:18.625238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:18.626107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:18.626107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:18.626107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:18.626107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:18.626107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:18.626107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:18.626107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:18.626107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:18.626107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 311/599] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:18.626107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc617020-69e3-4f53-a8f2-60c93ed8f822 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:18.699361 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 289/600] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:50:18 2022] PUT /identity/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/8d06113649924eae83d04bc22337bd6d/roles/17cc20a61bbf4f5ea7ae111203cfda47 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:50:18.700676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1bbb1-004f-4175-be31-656652f1eefe None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:18.713578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc617020-69e3-4f53-a8f2-60c93ed8f822 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:18.749617 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe734f-9454-4ed9-8fae-aba037bdf6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:18.750743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe734f-9454-4ed9-8fae-aba037bdf6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:18.751194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe734f-9454-4ed9-8fae-aba037bdf6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:18.751635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe734f-9454-4ed9-8fae-aba037bdf6a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:18.763983 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe734f-9454-4ed9-8fae-aba037bdf6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:18.765736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe734f-9454-4ed9-8fae-aba037bdf6a6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:18.784517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-1fbe734f-9454-4ed9-8fae-aba037bdf6a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:18.784517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:18.784517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:18.784517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:18.784517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:18.784517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:18.784517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:18.784517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:18.784517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:18.784517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:18.784517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:18.784517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:18.784517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:18.784517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:18.784517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:18.785496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:18.786555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:18.786555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:18.786555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:18.786555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:18.788436 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 312/601] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:18.800556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe734f-9454-4ed9-8fae-aba037bdf6a6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:18.851365 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1bbb1-004f-4175-be31-656652f1eefe None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:18.940339 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe734f-9454-4ed9-8fae-aba037bdf6a6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:18.971986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b83f5-9a61-4c35-9451-2f02c1b8d1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:18.972568 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b83f5-9a61-4c35-9451-2f02c1b8d1ff None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:18.972856 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b83f5-9a61-4c35-9451-2f02c1b8d1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:18.973135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b83f5-9a61-4c35-9451-2f02c1b8d1ff None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:18.973940 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b83f5-9a61-4c35-9451-2f02c1b8d1ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:18.974249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b83f5-9a61-4c35-9451-2f02c1b8d1ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:18.979135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b83f5-9a61-4c35-9451-2f02c1b8d1ff None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:18.984186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c0fbb-7bfb-4dc0-aff4-94214b7b9b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:18.984867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c0fbb-7bfb-4dc0-aff4-94214b7b9b08 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:18.985154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c0fbb-7bfb-4dc0-aff4-94214b7b9b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:18.985430 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c0fbb-7bfb-4dc0-aff4-94214b7b9b08 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:18.986159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c0fbb-7bfb-4dc0-aff4-94214b7b9b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:18.986464 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c0fbb-7bfb-4dc0-aff4-94214b7b9b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:18.987880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c0fbb-7bfb-4dc0-aff4-94214b7b9b08 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:18.990611 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 290/602] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:18.996308 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b83f5-9a61-4c35-9451-2f02c1b8d1ff None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:19.002483 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 313/603] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:19.008432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c0fbb-7bfb-4dc0-aff4-94214b7b9b08 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:19.122301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b83f5-9a61-4c35-9451-2f02c1b8d1ff None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:19.123391 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c0fbb-7bfb-4dc0-aff4-94214b7b9b08 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:19.161120 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b454815-f6b0-4691-930f-4938bed02f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:19.161919 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b454815-f6b0-4691-930f-4938bed02f27 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:19.162202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b454815-f6b0-4691-930f-4938bed02f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:19.162477 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b454815-f6b0-4691-930f-4938bed02f27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:19.167433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3c441-405d-4cd5-8f28-d5ed44a8e3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:19.168608 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3c441-405d-4cd5-8f28-d5ed44a8e3a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:19.169068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3c441-405d-4cd5-8f28-d5ed44a8e3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:19.169517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3c441-405d-4cd5-8f28-d5ed44a8e3a3 None admin] PATH_INFO: `/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/f765ee92b36e43478c04db32227a5872/roles/17cc20a61bbf4f5ea7ae111203cfda47` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:19.172832 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b454815-f6b0-4691-930f-4938bed02f27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:19.174343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b454815-f6b0-4691-930f-4938bed02f27 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:19.186582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3c441-405d-4cd5-8f28-d5ed44a8e3a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e90e91d3094e67b09b2b8137f210f4, user_id=f765ee92b36e43478c04db32227a5872, role_id=17cc20a61bbf4f5ea7ae111203cfda47)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:19.188275 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3c441-405d-4cd5-8f28-d5ed44a8e3a3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:19.188843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3b454815-f6b0-4691-930f-4938bed02f27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:19.188843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:19.188843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:19.188843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:19.188843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:19.188843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:19.188843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:19.188843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:19.188843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:19.188843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:19.188843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:19.188843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:19.188843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:19.188843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:19.188843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:19.189707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:19.190590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:19.190590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:19.190590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:19.190590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:19.190590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:19.190590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:19.190590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:19.190590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:19.190590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 314/604] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:19.195783 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b454815-f6b0-4691-930f-4938bed02f27 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:19.286113 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 291/605] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:50:18 2022] PUT /identity/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/f765ee92b36e43478c04db32227a5872/roles/17cc20a61bbf4f5ea7ae111203cfda47 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 21:50:19.312131 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b454815-f6b0-4691-930f-4938bed02f27 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:19.349497 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216623b-a53e-4b7e-b040-846c3aa5afe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:19.350170 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216623b-a53e-4b7e-b040-846c3aa5afe6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:19.350454 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216623b-a53e-4b7e-b040-846c3aa5afe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:19.350729 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216623b-a53e-4b7e-b040-846c3aa5afe6 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:19.351616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216623b-a53e-4b7e-b040-846c3aa5afe6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:19.351928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216623b-a53e-4b7e-b040-846c3aa5afe6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:19.353928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216623b-a53e-4b7e-b040-846c3aa5afe6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:19.367836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 315/606] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:19.374290 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3c441-405d-4cd5-8f28-d5ed44a8e3a3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:19.489341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3c441-405d-4cd5-8f28-d5ed44a8e3a3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:19.528566 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68e23b-cc54-4d2a-add5-46f58981b4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:19.529590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68e23b-cc54-4d2a-add5-46f58981b4a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:19.529878 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68e23b-cc54-4d2a-add5-46f58981b4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:19.530154 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68e23b-cc54-4d2a-add5-46f58981b4a9 None admin] PATH_INFO: `/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/c084b56d682c44119654743809109bc4/roles/17cc20a61bbf4f5ea7ae111203cfda47` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:19.547151 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68e23b-cc54-4d2a-add5-46f58981b4a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e90e91d3094e67b09b2b8137f210f4, user_id=c084b56d682c44119654743809109bc4, role_id=17cc20a61bbf4f5ea7ae111203cfda47)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:19.548613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68e23b-cc54-4d2a-add5-46f58981b4a9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:19.576606 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be5ce4-ef0d-435c-8e1b-017a5cda840b None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:19.581634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be5ce4-ef0d-435c-8e1b-017a5cda840b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:19.581634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be5ce4-ef0d-435c-8e1b-017a5cda840b None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:19.581634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 316/607] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:50:19.583737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b3f54-b486-4f2e-a935-706533fd285a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:19.584028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b3f54-b486-4f2e-a935-706533fd285a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:19.584294 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b3f54-b486-4f2e-a935-706533fd285a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:19.603785 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-579b3f54-b486-4f2e-a935-706533fd285a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:19.604953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-579b3f54-b486-4f2e-a935-706533fd285a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:19.662538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 292/608] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:50:19 2022] PUT /identity/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/c084b56d682c44119654743809109bc4/roles/17cc20a61bbf4f5ea7ae111203cfda47 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:50:19.690018 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 317/609] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:50:19.713319 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68e23b-cc54-4d2a-add5-46f58981b4a9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:19.825282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68e23b-cc54-4d2a-add5-46f58981b4a9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:19.862343 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4ce2c-2789-48bb-b5cd-2b33d13a8bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:19.863202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4ce2c-2789-48bb-b5cd-2b33d13a8bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:19.863494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4ce2c-2789-48bb-b5cd-2b33d13a8bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:19.863774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4ce2c-2789-48bb-b5cd-2b33d13a8bd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:19.876200 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4ce2c-2789-48bb-b5cd-2b33d13a8bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-31f4ce2c-2789-48bb-b5cd-2b33d13a8bd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:19.884649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:19.886840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:19.888888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:19.888888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:19.888888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:19.888888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:19.888888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:19.888888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:19.888888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:19.888888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:19.888888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:19.888888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:19.888888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:19.888888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:19.888888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 293/610] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:19.893287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b3f54-b486-4f2e-a935-706533fd285a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:20.003790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b3f54-b486-4f2e-a935-706533fd285a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:20.039692 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d67f1-aa77-4628-9901-007b648129cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:20.040630 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d67f1-aa77-4628-9901-007b648129cb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:20.040923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d67f1-aa77-4628-9901-007b648129cb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:20.041200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d67f1-aa77-4628-9901-007b648129cb None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:20.041960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d67f1-aa77-4628-9901-007b648129cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:20.042266 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d67f1-aa77-4628-9901-007b648129cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:20.043680 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d67f1-aa77-4628-9901-007b648129cb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:20.052970 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 318/611] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:20.058671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4ce2c-2789-48bb-b5cd-2b33d13a8bd0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:20.160969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4ce2c-2789-48bb-b5cd-2b33d13a8bd0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:20.199985 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60210a3a-eb5b-4feb-a448-af9591e66b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:20.200787 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60210a3a-eb5b-4feb-a448-af9591e66b1d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:20.201070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60210a3a-eb5b-4feb-a448-af9591e66b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:20.201344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60210a3a-eb5b-4feb-a448-af9591e66b1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:20.213626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60210a3a-eb5b-4feb-a448-af9591e66b1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:20.215090 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60210a3a-eb5b-4feb-a448-af9591e66b1d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:20.233045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-60210a3a-eb5b-4feb-a448-af9591e66b1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:20.233045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:20.233045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:20.233045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:20.233045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:20.233045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:20.233045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:20.233045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:20.233045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:20.233045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:20.233045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:20.233045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:20.233045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:20.233045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:20.233045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:20.235246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:20.237485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:20.237485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:20.237485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:20.237485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:20.237485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 294/612] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:20.243476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d67f1-aa77-4628-9901-007b648129cb None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:20.360510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f06d6-a3d1-4913-921e-e4ec397ffabf None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:20.360853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f06d6-a3d1-4913-921e-e4ec397ffabf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:20.361080 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f06d6-a3d1-4913-921e-e4ec397ffabf None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:20.363785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 295/613] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:20.372471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293e137-1ff5-480c-bf55-04631612427c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:20.372757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293e137-1ff5-480c-bf55-04631612427c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:20.373038 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293e137-1ff5-480c-bf55-04631612427c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:20.390700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0293e137-1ff5-480c-bf55-04631612427c None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:20.391962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0293e137-1ff5-480c-bf55-04631612427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:20.431360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d67f1-aa77-4628-9901-007b648129cb None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:20.460594 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 296/614] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:20.485675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d4f78-8eb9-4b64-8e86-39753a7586d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:20.486385 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d4f78-8eb9-4b64-8e86-39753a7586d6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:20.486667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d4f78-8eb9-4b64-8e86-39753a7586d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:20.486935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d4f78-8eb9-4b64-8e86-39753a7586d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:20.487718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d4f78-8eb9-4b64-8e86-39753a7586d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:20.488018 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d4f78-8eb9-4b64-8e86-39753a7586d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:20.489416 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d4f78-8eb9-4b64-8e86-39753a7586d6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:20.501859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 319/615] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:20.507299 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293e137-1ff5-480c-bf55-04631612427c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:20.512137 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d4f78-8eb9-4b64-8e86-39753a7586d6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:20.610914 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293e137-1ff5-480c-bf55-04631612427c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:20.645232 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a423f-02df-4757-b4e4-2206468eb303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:20.646026 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a423f-02df-4757-b4e4-2206468eb303 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:20.646306 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a423f-02df-4757-b4e4-2206468eb303 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:20.646577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a423f-02df-4757-b4e4-2206468eb303 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:20.651588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d4f78-8eb9-4b64-8e86-39753a7586d6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:20.657213 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a423f-02df-4757-b4e4-2206468eb303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-281a423f-02df-4757-b4e4-2206468eb303 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:20.665784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:20.666732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:20.668246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:20.668246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:20.668246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:20.668246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:20.668246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:20.668246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:20.668246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:20.668246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:20.668246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:20.668246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:20.668246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:20.668246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:20.668246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 297/616] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:20.683896 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a423f-02df-4757-b4e4-2206468eb303 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:20.702610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532df99-b84c-4d19-8a35-6e0b041416e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:20.703453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532df99-b84c-4d19-8a35-6e0b041416e7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:20.703738 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532df99-b84c-4d19-8a35-6e0b041416e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:20.704012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532df99-b84c-4d19-8a35-6e0b041416e7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:20.720348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532df99-b84c-4d19-8a35-6e0b041416e7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:20.721813 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532df99-b84c-4d19-8a35-6e0b041416e7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3532df99-b84c-4d19-8a35-6e0b041416e7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:20.749712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:20.750672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:20.752598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:20.752598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:20.752598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:20.752598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:20.752598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:20.752598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:20.752598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:20.752598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:20.752598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 21:50:20.752598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:20.759463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 320/617] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:50:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:20.769131 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532df99-b84c-4d19-8a35-6e0b041416e7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:20.793158 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a423f-02df-4757-b4e4-2206468eb303 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:20.828897 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aee3cf-a87f-4435-b2d9-6905339eae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:20.829552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aee3cf-a87f-4435-b2d9-6905339eae61 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:20.829832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aee3cf-a87f-4435-b2d9-6905339eae61 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:20.830107 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aee3cf-a87f-4435-b2d9-6905339eae61 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:20.835126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aee3cf-a87f-4435-b2d9-6905339eae61 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:20.835126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aee3cf-a87f-4435-b2d9-6905339eae61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:20.835126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aee3cf-a87f-4435-b2d9-6905339eae61 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:20.841393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 298/618] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:20.851882 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aee3cf-a87f-4435-b2d9-6905339eae61 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:20.947818 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532df99-b84c-4d19-8a35-6e0b041416e7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:20.987794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda552f-05b3-44c8-8cac-bcb8a2b4fb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:20.988468 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda552f-05b3-44c8-8cac-bcb8a2b4fb76 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:20.988750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda552f-05b3-44c8-8cac-bcb8a2b4fb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:20.989025 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda552f-05b3-44c8-8cac-bcb8a2b4fb76 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:20.989866 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda552f-05b3-44c8-8cac-bcb8a2b4fb76 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:20.990176 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda552f-05b3-44c8-8cac-bcb8a2b4fb76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:20.991662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda552f-05b3-44c8-8cac-bcb8a2b4fb76 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:21.026066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 321/619] 10.222.0.24 () {56 vars in 1135 bytes} [Tue May 17 21:50:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:21.031045 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda552f-05b3-44c8-8cac-bcb8a2b4fb76 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:21.048867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aee3cf-a87f-4435-b2d9-6905339eae61 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:21.115818 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740b314-fbd0-4dfd-ab55-89948f3dbc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:21.116625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740b314-fbd0-4dfd-ab55-89948f3dbc27 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:21.116915 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740b314-fbd0-4dfd-ab55-89948f3dbc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:21.117193 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740b314-fbd0-4dfd-ab55-89948f3dbc27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:21.137544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740b314-fbd0-4dfd-ab55-89948f3dbc27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:21.138923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740b314-fbd0-4dfd-ab55-89948f3dbc27 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:21.154315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda552f-05b3-44c8-8cac-bcb8a2b4fb76 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:21.164685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5740b314-fbd0-4dfd-ab55-89948f3dbc27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:21.164685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:21.164685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:21.164685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:21.164685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:21.164685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:21.164685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:21.164685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:21.164685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:21.164685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:21.164685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:21.164685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:21.164685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:21.164685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:21.164685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:21.165872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:21.166750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:21.166750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:21.166750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:21.166750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:21.170585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 299/620] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:21.176307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740b314-fbd0-4dfd-ab55-89948f3dbc27 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:21.198243 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7a14b-8c87-4a5c-9cda-138405891a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:21.199340 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7a14b-8c87-4a5c-9cda-138405891a35 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:21.199769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7a14b-8c87-4a5c-9cda-138405891a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:21.200187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7a14b-8c87-4a5c-9cda-138405891a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:21.219535 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7a14b-8c87-4a5c-9cda-138405891a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:21.222167 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7a14b-8c87-4a5c-9cda-138405891a35 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:21.242984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-a5a7a14b-8c87-4a5c-9cda-138405891a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:21.242984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:21.242984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:21.242984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:21.242984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:21.242984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:21.242984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:21.242984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:21.242984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:21.242984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:21.242984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:21.242984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:21.242984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:21.242984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:21.242984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:21.244736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:21.245806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:21.245806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:21.245806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:21.245806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:21.247704 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 322/621] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:21.254007 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7a14b-8c87-4a5c-9cda-138405891a35 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:21.385754 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740b314-fbd0-4dfd-ab55-89948f3dbc27 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:21.404191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7a14b-8c87-4a5c-9cda-138405891a35 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:21.443230 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c53aef-7a44-4576-8349-ebe8bb34de7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:21.445192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c53aef-7a44-4576-8349-ebe8bb34de7c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:21.445625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c53aef-7a44-4576-8349-ebe8bb34de7c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:21.446775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c53aef-7a44-4576-8349-ebe8bb34de7c None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:21.447746 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c53aef-7a44-4576-8349-ebe8bb34de7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:21.448791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c53aef-7a44-4576-8349-ebe8bb34de7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:21.450951 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c53aef-7a44-4576-8349-ebe8bb34de7c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:21.461001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d062df4-d851-4cac-8187-cc6b99c1e407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:21.462225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d062df4-d851-4cac-8187-cc6b99c1e407 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:21.462830 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d062df4-d851-4cac-8187-cc6b99c1e407 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:21.463279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d062df4-d851-4cac-8187-cc6b99c1e407 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:21.464158 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d062df4-d851-4cac-8187-cc6b99c1e407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:21.464612 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d062df4-d851-4cac-8187-cc6b99c1e407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:21.466253 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d062df4-d851-4cac-8187-cc6b99c1e407 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:21.478249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 300/622] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:21.485295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c53aef-7a44-4576-8349-ebe8bb34de7c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:21.494242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 323/623] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:21.499553 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d062df4-d851-4cac-8187-cc6b99c1e407 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:21.625410 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c53aef-7a44-4576-8349-ebe8bb34de7c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:21.668788 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a468e-1d83-43b1-b06e-df30714ca6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:21.669993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a468e-1d83-43b1-b06e-df30714ca6ee None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:21.670490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a468e-1d83-43b1-b06e-df30714ca6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:21.670974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a468e-1d83-43b1-b06e-df30714ca6ee None admin] PATH_INFO: `/v3/users/glance` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:21.687098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a468e-1d83-43b1-b06e-df30714ca6ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:21.688878 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a468e-1d83-43b1-b06e-df30714ca6ee None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2d6a468e-1d83-43b1-b06e-df30714ca6ee None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:21.714138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:21.715123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:21.716083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:21.716083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:21.716083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:21.716083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:21.716083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:21.716083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:21.716083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:21.716083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:21.716083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 21:50:21.716083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:21.720147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 301/624] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:50:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:21.724651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d062df4-d851-4cac-8187-cc6b99c1e407 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:21.725773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a468e-1d83-43b1-b06e-df30714ca6ee None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:21.763570 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b3b53-7618-45ee-935a-0087e5c9fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:21.764389 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b3b53-7618-45ee-935a-0087e5c9fefa None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:21.764675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b3b53-7618-45ee-935a-0087e5c9fefa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:21.764949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b3b53-7618-45ee-935a-0087e5c9fefa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:21.783807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b3b53-7618-45ee-935a-0087e5c9fefa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:21.785306 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b3b53-7618-45ee-935a-0087e5c9fefa None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:21.807916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-d48b3b53-7618-45ee-935a-0087e5c9fefa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:21.807916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:21.807916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:21.807916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:21.807916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:21.807916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:21.807916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:21.807916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:21.807916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:21.807916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:21.807916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:21.807916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:21.807916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:21.807916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:21.807916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:21.808877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:21.809770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:21.809770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:21.809770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:21.809770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:21.809770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:21.809770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:21.809770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:21.809770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:21.810200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 324/625] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:21.815385 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b3b53-7618-45ee-935a-0087e5c9fefa None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:21.884418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a468e-1d83-43b1-b06e-df30714ca6ee None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:21.923750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c48e8-c610-4caa-9447-d2788beb47a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:21.924733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c48e8-c610-4caa-9447-d2788beb47a9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:21.925199 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c48e8-c610-4caa-9447-d2788beb47a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:21.925687 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c48e8-c610-4caa-9447-d2788beb47a9 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:21.927079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c48e8-c610-4caa-9447-d2788beb47a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:21.927633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c48e8-c610-4caa-9447-d2788beb47a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:21.929270 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c48e8-c610-4caa-9447-d2788beb47a9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:21.952746 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 302/626] 10.222.0.24 () {56 vars in 1137 bytes} [Tue May 17 21:50:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:21.954428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc42018-8874-47ad-88f2-1feaa2d0c643 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:21.954900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc42018-8874-47ad-88f2-1feaa2d0c643 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:21.955391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc42018-8874-47ad-88f2-1feaa2d0c643 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:21.955602 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b3b53-7618-45ee-935a-0087e5c9fefa None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:21.957306 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 303/627] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:21.958195 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc42018-8874-47ad-88f2-1feaa2d0c643 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:21.991253 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416890e0-e443-44a3-8fd2-5d40096a8e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:21.991835 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416890e0-e443-44a3-8fd2-5d40096a8e8f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:21.992119 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416890e0-e443-44a3-8fd2-5d40096a8e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:21.992400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416890e0-e443-44a3-8fd2-5d40096a8e8f None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:21.993455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416890e0-e443-44a3-8fd2-5d40096a8e8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:21.993771 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416890e0-e443-44a3-8fd2-5d40096a8e8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:21.995254 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416890e0-e443-44a3-8fd2-5d40096a8e8f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:22.011478 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 325/628] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:22.011478 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9dfa0-17ed-42ad-9165-5d6256727f1d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:22.011478 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9dfa0-17ed-42ad-9165-5d6256727f1d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:22.011478 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9dfa0-17ed-42ad-9165-5d6256727f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:22.029658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b2d9dfa0-17ed-42ad-9165-5d6256727f1d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:22.030893 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b2d9dfa0-17ed-42ad-9165-5d6256727f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:22.071910 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc42018-8874-47ad-88f2-1feaa2d0c643 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:22.098712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 326/629] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:22.100269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856fbd8-ac65-4246-a62f-43f8d4e4eaee None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:22.100634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856fbd8-ac65-4246-a62f-43f8d4e4eaee None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:22.100986 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856fbd8-ac65-4246-a62f-43f8d4e4eaee None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:22.103823 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 327/630] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:22.103823 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856fbd8-ac65-4246-a62f-43f8d4e4eaee None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:22.118283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec81f05-2731-478a-9642-6cf19ab0d6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:22.119027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec81f05-2731-478a-9642-6cf19ab0d6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:22.119387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec81f05-2731-478a-9642-6cf19ab0d6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:22.119604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec81f05-2731-478a-9642-6cf19ab0d6e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:22.189562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec81f05-2731-478a-9642-6cf19ab0d6e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:22.191007 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec81f05-2731-478a-9642-6cf19ab0d6e2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:22.207988 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856fbd8-ac65-4246-a62f-43f8d4e4eaee None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:22.243455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7113b-2a7a-4691-bf82-c0f92d3ea748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:22.244164 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7113b-2a7a-4691-bf82-c0f92d3ea748 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:22.244770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7113b-2a7a-4691-bf82-c0f92d3ea748 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:22.244770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7113b-2a7a-4691-bf82-c0f92d3ea748 None admin] PATH_INFO: `/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/957c3decfb19445d80836f767fa23bd7/roles/17cc20a61bbf4f5ea7ae111203cfda47` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:22.265045 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7113b-2a7a-4691-bf82-c0f92d3ea748 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e90e91d3094e67b09b2b8137f210f4, user_id=957c3decfb19445d80836f767fa23bd7, role_id=17cc20a61bbf4f5ea7ae111203cfda47)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:22.267065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7113b-2a7a-4691-bf82-c0f92d3ea748 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:22.291562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 304/631] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:50:22.292844 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139f822-120d-4ec4-9098-6246af5a1e42 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:22.293127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139f822-120d-4ec4-9098-6246af5a1e42 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:22.293399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139f822-120d-4ec4-9098-6246af5a1e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:22.309268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3139f822-120d-4ec4-9098-6246af5a1e42 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:22.310453 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3139f822-120d-4ec4-9098-6246af5a1e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:22.340876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 328/632] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:50:22 2022] PUT /identity/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/957c3decfb19445d80836f767fa23bd7/roles/17cc20a61bbf4f5ea7ae111203cfda47 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:50:22.342121 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7113b-2a7a-4691-bf82-c0f92d3ea748 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:22.400914 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 305/633] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:22.401922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139f822-120d-4ec4-9098-6246af5a1e42 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:22.453044 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7113b-2a7a-4691-bf82-c0f92d3ea748 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:22.490238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b57ad-a190-4e73-9a72-344a18c8e0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:22.491046 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b57ad-a190-4e73-9a72-344a18c8e0ac None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:22.491361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b57ad-a190-4e73-9a72-344a18c8e0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:22.491700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b57ad-a190-4e73-9a72-344a18c8e0ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:22.503564 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b57ad-a190-4e73-9a72-344a18c8e0ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-569b57ad-a190-4e73-9a72-344a18c8e0ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:22.512019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:22.513030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:22.513867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:22.513867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:22.513867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:22.513867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:22.513867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:22.513867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:22.513867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:22.513867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:22.513867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:22.513867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:22.513867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:22.513867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:22.513867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 329/634] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:22.514566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb7de9-0dbb-4db6-95ee-89bc0084c86f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:22.515183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb7de9-0dbb-4db6-95ee-89bc0084c86f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:22.515183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb7de9-0dbb-4db6-95ee-89bc0084c86f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:22.516561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 330/635] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:22.520008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb7de9-0dbb-4db6-95ee-89bc0084c86f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:22.520927 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139f822-120d-4ec4-9098-6246af5a1e42 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:22.561182 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffcfbb-d1d7-40bc-a251-7bc3d759cab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:22.561982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffcfbb-d1d7-40bc-a251-7bc3d759cab7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:22.562269 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffcfbb-d1d7-40bc-a251-7bc3d759cab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:22.562545 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffcfbb-d1d7-40bc-a251-7bc3d759cab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:22.573416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffcfbb-d1d7-40bc-a251-7bc3d759cab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:22.574871 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffcfbb-d1d7-40bc-a251-7bc3d759cab7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:22.592900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b8ffcfbb-d1d7-40bc-a251-7bc3d759cab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:22.592900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:22.592900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:22.592900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:22.592900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:22.592900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:22.592900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:22.592900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:22.592900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:22.592900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:22.592900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:22.592900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:22.592900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:22.592900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:22.592900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:22.593798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:22.594681 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:22.594681 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:22.594681 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:22.594681 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:22.594681 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 306/636] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:22.595416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715115dd-4cce-43e3-a8f7-254222813a44 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:22.595711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715115dd-4cce-43e3-a8f7-254222813a44 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:22.596074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715115dd-4cce-43e3-a8f7-254222813a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:22.613001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-715115dd-4cce-43e3-a8f7-254222813a44 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:22.614161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-715115dd-4cce-43e3-a8f7-254222813a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:22.633275 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb7de9-0dbb-4db6-95ee-89bc0084c86f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:22.668241 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b83d8e-43f8-4dd0-80e1-bdf3bde47d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:22.669063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b83d8e-43f8-4dd0-80e1-bdf3bde47d43 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:22.669346 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b83d8e-43f8-4dd0-80e1-bdf3bde47d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:22.669623 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b83d8e-43f8-4dd0-80e1-bdf3bde47d43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:22.687125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 307/637] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:22.687317 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b83d8e-43f8-4dd0-80e1-bdf3bde47d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:22.687398 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715115dd-4cce-43e3-a8f7-254222813a44 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b9b83d8e-43f8-4dd0-80e1-bdf3bde47d43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:22.688212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:22.689122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:22.689939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:22.689939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:22.689939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:22.689939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:22.689939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:22.689939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:22.689939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:22.689939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:22.689939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:22.689939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:22.689939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:22.689939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:22.689939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 331/638] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:22.690606 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b83d8e-43f8-4dd0-80e1-bdf3bde47d43 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:22.789000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715115dd-4cce-43e3-a8f7-254222813a44 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:22.792353 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b83d8e-43f8-4dd0-80e1-bdf3bde47d43 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:22.823749 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fa875-7d57-421e-b661-33051415fe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:22.824424 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fa875-7d57-421e-b661-33051415fe9c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:22.824709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fa875-7d57-421e-b661-33051415fe9c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:22.824992 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fa875-7d57-421e-b661-33051415fe9c None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:22.825739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fa875-7d57-421e-b661-33051415fe9c None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:22.826051 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fa875-7d57-421e-b661-33051415fe9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:22.826653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697c174-815c-4ef6-9899-ba43164e956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:22.827443 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fa875-7d57-421e-b661-33051415fe9c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:22.827671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c174-815c-4ef6-9899-ba43164e956c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:22.828171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c174-815c-4ef6-9899-ba43164e956c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:22.828606 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c174-815c-4ef6-9899-ba43164e956c None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:22.829546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697c174-815c-4ef6-9899-ba43164e956c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:22.829907 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697c174-815c-4ef6-9899-ba43164e956c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:22.831270 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697c174-815c-4ef6-9899-ba43164e956c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:22.840654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 308/639] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:22.840654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fa875-7d57-421e-b661-33051415fe9c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:22.851134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 332/640] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:22.851999 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697c174-815c-4ef6-9899-ba43164e956c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:22.943593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fa875-7d57-421e-b661-33051415fe9c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:22.955730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697c174-815c-4ef6-9899-ba43164e956c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:22.977024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071f1ee-0015-40e9-898c-eb155db6fefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:22.978327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071f1ee-0015-40e9-898c-eb155db6fefe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:22.978611 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071f1ee-0015-40e9-898c-eb155db6fefe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:22.978884 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071f1ee-0015-40e9-898c-eb155db6fefe None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:22.979644 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071f1ee-0015-40e9-898c-eb155db6fefe None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:22.979944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071f1ee-0015-40e9-898c-eb155db6fefe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:22.981289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071f1ee-0015-40e9-898c-eb155db6fefe None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:22.994140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 309/641] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:22.994140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071f1ee-0015-40e9-898c-eb155db6fefe None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:22.995344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43b7e4-03f5-403c-a43a-48530497190e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:22.996142 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43b7e4-03f5-403c-a43a-48530497190e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:22.996422 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43b7e4-03f5-403c-a43a-48530497190e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:22.996697 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43b7e4-03f5-403c-a43a-48530497190e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:23.007432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43b7e4-03f5-403c-a43a-48530497190e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-2a43b7e4-03f5-403c-a43a-48530497190e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:23.015744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:23.016801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:23.017643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:23.017643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:23.017643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:23.017643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:23.017643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:23.017643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:23.017643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:23.017643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:23.017643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:23.017643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:23.017643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:23.017643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:23.017643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 333/642] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:23.017643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43b7e4-03f5-403c-a43a-48530497190e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:23.097641 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071f1ee-0015-40e9-898c-eb155db6fefe None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:23.116834 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43b7e4-03f5-403c-a43a-48530497190e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:23.130319 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f83c2-a02c-4e60-a491-350c30c3a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:23.131130 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f83c2-a02c-4e60-a491-350c30c3a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:23.131436 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f83c2-a02c-4e60-a491-350c30c3a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:23.131709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f83c2-a02c-4e60-a491-350c30c3a1a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:23.141907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f83c2-a02c-4e60-a491-350c30c3a1a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:23.143362 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f83c2-a02c-4e60-a491-350c30c3a1a5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:23.151049 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0a340-7af7-4183-984c-7679330f71f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:23.151856 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a340-7af7-4183-984c-7679330f71f7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:23.152135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a340-7af7-4183-984c-7679330f71f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:23.152405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a340-7af7-4183-984c-7679330f71f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:23.158996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0a340-7af7-4183-984c-7679330f71f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:23.160455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0a340-7af7-4183-984c-7679330f71f7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:23.160647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1b7f83c2-a02c-4e60-a491-350c30c3a1a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:23.160647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:23.160647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:23.160647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:23.160647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:23.160647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:23.160647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:23.160647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:23.160647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:23.160647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:23.160647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:23.160647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:23.160647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:23.160647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:23.160647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:23.161632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:23.162521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:23.162521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:23.162521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:23.162521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:23.162521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 310/643] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:23.162805 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f83c2-a02c-4e60-a491-350c30c3a1a5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:23.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-a5c0a340-7af7-4183-984c-7679330f71f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:23.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:23.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:23.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:23.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:23.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:23.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:23.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:23.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:23.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:23.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:23.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:23.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:23.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:23.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:23.178989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:23.179998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:23.179998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:23.179998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:23.179998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:23.179998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:23.179998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:23.179998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:23.179998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:23.179998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 334/644] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:23.179998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0a340-7af7-4183-984c-7679330f71f7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:23.264647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f83c2-a02c-4e60-a491-350c30c3a1a5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:23.278940 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0a340-7af7-4183-984c-7679330f71f7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:23.297389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817bbca-1bb9-4ccc-a28d-1c21f0b2468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:23.298189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817bbca-1bb9-4ccc-a28d-1c21f0b2468c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:23.298473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817bbca-1bb9-4ccc-a28d-1c21f0b2468c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:23.298753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817bbca-1bb9-4ccc-a28d-1c21f0b2468c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:23.310541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817bbca-1bb9-4ccc-a28d-1c21f0b2468c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:23.312019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817bbca-1bb9-4ccc-a28d-1c21f0b2468c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:23.314626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afef28d-55d3-4bde-b62c-efd91c8e2e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:23.315518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afef28d-55d3-4bde-b62c-efd91c8e2e3c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:23.315981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afef28d-55d3-4bde-b62c-efd91c8e2e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:23.316429 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afef28d-55d3-4bde-b62c-efd91c8e2e3c None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:23.317395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afef28d-55d3-4bde-b62c-efd91c8e2e3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:23.317875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afef28d-55d3-4bde-b62c-efd91c8e2e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:23.320182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afef28d-55d3-4bde-b62c-efd91c8e2e3c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:23.329330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f817bbca-1bb9-4ccc-a28d-1c21f0b2468c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:23.329330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:23.329330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:23.329330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:23.329330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:23.329330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:23.329330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:23.329330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:23.329330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:23.329330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:23.329330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:23.329330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:23.329330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:23.329330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:23.329330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:23.330210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:23.331096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:23.331096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:23.331096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:23.331096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:23.331712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 335/645] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:23.332663 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afef28d-55d3-4bde-b62c-efd91c8e2e3c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:23.334703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 311/646] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:23.335549 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817bbca-1bb9-4ccc-a28d-1c21f0b2468c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:23.435053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afef28d-55d3-4bde-b62c-efd91c8e2e3c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:23.435346 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817bbca-1bb9-4ccc-a28d-1c21f0b2468c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:23.468764 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b9cb-1e7d-4618-a171-ae91f8f55067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:23.469224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346839e5-2091-43a2-8a09-cb5cbb444c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:23.469424 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b9cb-1e7d-4618-a171-ae91f8f55067 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:23.469714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b9cb-1e7d-4618-a171-ae91f8f55067 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:23.469992 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b9cb-1e7d-4618-a171-ae91f8f55067 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:23.470485 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346839e5-2091-43a2-8a09-cb5cbb444c24 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:23.470778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3b9cb-1e7d-4618-a171-ae91f8f55067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:23.471068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346839e5-2091-43a2-8a09-cb5cbb444c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:23.471198 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3b9cb-1e7d-4618-a171-ae91f8f55067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:23.471586 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346839e5-2091-43a2-8a09-cb5cbb444c24 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:23.472456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346839e5-2091-43a2-8a09-cb5cbb444c24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:23.472567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3b9cb-1e7d-4618-a171-ae91f8f55067 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:23.473006 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346839e5-2091-43a2-8a09-cb5cbb444c24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:23.474502 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346839e5-2091-43a2-8a09-cb5cbb444c24 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:23.486004 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 312/647] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:23.486948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b9cb-1e7d-4618-a171-ae91f8f55067 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:23.491757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 336/648] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:23.493019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346839e5-2091-43a2-8a09-cb5cbb444c24 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:23.593749 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b9cb-1e7d-4618-a171-ae91f8f55067 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:23.601656 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346839e5-2091-43a2-8a09-cb5cbb444c24 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:23.627972 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b912edb-f72f-461e-8a16-2c53c9feba8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:23.628901 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b912edb-f72f-461e-8a16-2c53c9feba8d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:23.629281 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b912edb-f72f-461e-8a16-2c53c9feba8d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:23.629681 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b912edb-f72f-461e-8a16-2c53c9feba8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:23.636689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad141885-02b3-4de9-aae8-cc0f1ebcd73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:23.637349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad141885-02b3-4de9-aae8-cc0f1ebcd73a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:23.637632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad141885-02b3-4de9-aae8-cc0f1ebcd73a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:23.637915 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad141885-02b3-4de9-aae8-cc0f1ebcd73a None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:23.638643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad141885-02b3-4de9-aae8-cc0f1ebcd73a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:23.638950 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad141885-02b3-4de9-aae8-cc0f1ebcd73a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:23.640343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad141885-02b3-4de9-aae8-cc0f1ebcd73a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:23.640763 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b912edb-f72f-461e-8a16-2c53c9feba8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:23.642292 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b912edb-f72f-461e-8a16-2c53c9feba8d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:23.651825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 337/649] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:23.651825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad141885-02b3-4de9-aae8-cc0f1ebcd73a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:23.664366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1b912edb-f72f-461e-8a16-2c53c9feba8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:23.664366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:23.664366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:23.664366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:23.664366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:23.664366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:23.664366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:23.664366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:23.664366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:23.664366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:23.664366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:23.664366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:23.664366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:23.664366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:23.664366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:23.670604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:23.671762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:23.671762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:23.671762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:23.671762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:23.671762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 313/650] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:23.671762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b912edb-f72f-461e-8a16-2c53c9feba8d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:23.753719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad141885-02b3-4de9-aae8-cc0f1ebcd73a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:23.765002 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b912edb-f72f-461e-8a16-2c53c9feba8d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:23.786425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371ee1f-920b-43c4-bcc0-9c598c8f35b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:23.787219 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371ee1f-920b-43c4-bcc0-9c598c8f35b6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:23.787599 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371ee1f-920b-43c4-bcc0-9c598c8f35b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:23.787979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371ee1f-920b-43c4-bcc0-9c598c8f35b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:23.788897 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371ee1f-920b-43c4-bcc0-9c598c8f35b6 None admin] RBAC: Adding query filter params (role.id=17cc20a61bbf4f5ea7ae111203cfda47, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=68748827b9f14eb7958d5b202c5d6877) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:23.789308 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371ee1f-920b-43c4-bcc0-9c598c8f35b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:23.791457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371ee1f-920b-43c4-bcc0-9c598c8f35b6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:23.797229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 338/651] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:23 2022] GET /identity/v3/role_assignments?user.id=68748827b9f14eb7958d5b202c5d6877&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=17cc20a61bbf4f5ea7ae111203cfda47 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:23.798048 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371ee1f-920b-43c4-bcc0-9c598c8f35b6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:23.809356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841253cc-5580-442e-ba82-d3b18d7286d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:23.810455 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841253cc-5580-442e-ba82-d3b18d7286d7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:23.810883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841253cc-5580-442e-ba82-d3b18d7286d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:23.811344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841253cc-5580-442e-ba82-d3b18d7286d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:23.819977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841253cc-5580-442e-ba82-d3b18d7286d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:23.822169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841253cc-5580-442e-ba82-d3b18d7286d7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-841253cc-5580-442e-ba82-d3b18d7286d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:23.839741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:23.840937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:23.842060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:23.842060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:23.842060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:23.842060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:23.842060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:23.842060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:23.842060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:23.842060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:23.842060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 21:50:23.842060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:23.844431 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 314/652] 10.222.0.24 () {56 vars in 1093 bytes} [Tue May 17 21:50:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:23.845488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841253cc-5580-442e-ba82-d3b18d7286d7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:23.919530 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371ee1f-920b-43c4-bcc0-9c598c8f35b6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:23.957006 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b9d01-ebdd-4f83-af0f-dbe35126b318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:23.957917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b9d01-ebdd-4f83-af0f-dbe35126b318 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:23.958272 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b9d01-ebdd-4f83-af0f-dbe35126b318 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:23.958621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b9d01-ebdd-4f83-af0f-dbe35126b318 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:23.967127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841253cc-5580-442e-ba82-d3b18d7286d7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:23.969169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b9d01-ebdd-4f83-af0f-dbe35126b318 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:23.970731 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b9d01-ebdd-4f83-af0f-dbe35126b318 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-1c6b9d01-ebdd-4f83-af0f-dbe35126b318 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:23.986211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:23.987400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:23.988527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:23.988527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:23.988527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:23.988527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:23.988527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:23.988527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:23.988527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:23.988527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:23.988527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 21:50:23.988527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:23.996084 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 339/653] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:50:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:23.996084 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b9d01-ebdd-4f83-af0f-dbe35126b318 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:24.008372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bf7f4-4a42-4a6a-b48f-e6751bf7e4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:24.011502 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bf7f4-4a42-4a6a-b48f-e6751bf7e4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:24.011502 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bf7f4-4a42-4a6a-b48f-e6751bf7e4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:24.011502 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bf7f4-4a42-4a6a-b48f-e6751bf7e4c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:24.011502 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bf7f4-4a42-4a6a-b48f-e6751bf7e4c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:24.011855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bf7f4-4a42-4a6a-b48f-e6751bf7e4c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:24.014173 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bf7f4-4a42-4a6a-b48f-e6751bf7e4c5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:24.027515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 315/654] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:24.029438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bf7f4-4a42-4a6a-b48f-e6751bf7e4c5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:24.128130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b9d01-ebdd-4f83-af0f-dbe35126b318 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:24.155735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bf7f4-4a42-4a6a-b48f-e6751bf7e4c5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:24.167242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80060f0-e691-40b1-9a95-bd90c46c4643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:24.168062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80060f0-e691-40b1-9a95-bd90c46c4643 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:24.168469 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80060f0-e691-40b1-9a95-bd90c46c4643 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:24.168844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80060f0-e691-40b1-9a95-bd90c46c4643 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:24.169793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80060f0-e691-40b1-9a95-bd90c46c4643 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:24.170216 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80060f0-e691-40b1-9a95-bd90c46c4643 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:24.171807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80060f0-e691-40b1-9a95-bd90c46c4643 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:24.190558 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 340/655] 10.222.0.24 () {56 vars in 1133 bytes} [Tue May 17 21:50:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:24.195997 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80060f0-e691-40b1-9a95-bd90c46c4643 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:24.198970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf5023-ee7b-4313-882b-4769ac2eb529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:24.199783 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5023-ee7b-4313-882b-4769ac2eb529 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:24.200189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5023-ee7b-4313-882b-4769ac2eb529 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:24.200567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5023-ee7b-4313-882b-4769ac2eb529 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:24.201589 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf5023-ee7b-4313-882b-4769ac2eb529 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:24.202014 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf5023-ee7b-4313-882b-4769ac2eb529 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:24.203580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf5023-ee7b-4313-882b-4769ac2eb529 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:24.222729 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 316/656] 10.222.0.24 () {56 vars in 1137 bytes} [Tue May 17 21:50:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:24.223851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf5023-ee7b-4313-882b-4769ac2eb529 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:24.300014 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80060f0-e691-40b1-9a95-bd90c46c4643 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:24.330427 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf5023-ee7b-4313-882b-4769ac2eb529 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:24.338608 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f0d20-b036-4691-88e4-19d3d4bfeb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:24.339665 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f0d20-b036-4691-88e4-19d3d4bfeb30 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:24.340119 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f0d20-b036-4691-88e4-19d3d4bfeb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:24.340534 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f0d20-b036-4691-88e4-19d3d4bfeb30 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:24.348246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f0d20-b036-4691-88e4-19d3d4bfeb30 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:24.349854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f0d20-b036-4691-88e4-19d3d4bfeb30 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-cc4f0d20-b036-4691-88e4-19d3d4bfeb30 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:24.365961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:24.367090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:24.368776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:24.368776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:24.368776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:24.368776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:24.368776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:24.368776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:24.368776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:24.368776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:24.368776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 21:50:24.368776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:24.375276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 341/657] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:24.375504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4802d-8065-44da-b305-5f7181a09094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:24.375504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4802d-8065-44da-b305-5f7181a09094 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:24.375504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4802d-8065-44da-b305-5f7181a09094 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:24.375504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4802d-8065-44da-b305-5f7181a09094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:24.375880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f0d20-b036-4691-88e4-19d3d4bfeb30 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:24.461481 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4802d-8065-44da-b305-5f7181a09094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:24.463568 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4802d-8065-44da-b305-5f7181a09094 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:24.498831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f0d20-b036-4691-88e4-19d3d4bfeb30 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:24.590135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 317/658] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:50:24.591491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4802d-8065-44da-b305-5f7181a09094 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:24.657885 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b07eb-a86d-4e2c-960d-c89e77f7d5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:24.658545 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b07eb-a86d-4e2c-960d-c89e77f7d5aa None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:24.658823 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b07eb-a86d-4e2c-960d-c89e77f7d5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:24.659096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b07eb-a86d-4e2c-960d-c89e77f7d5aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:24.697277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4802d-8065-44da-b305-5f7181a09094 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:24.725754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b07eb-a86d-4e2c-960d-c89e77f7d5aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:24.727300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b07eb-a86d-4e2c-960d-c89e77f7d5aa None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:24.730762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7b052-bef2-4197-b924-f9037a5c3f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:24.731458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7b052-bef2-4197-b924-f9037a5c3f61 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:24.731735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7b052-bef2-4197-b924-f9037a5c3f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:24.732008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7b052-bef2-4197-b924-f9037a5c3f61 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:24.732841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7b052-bef2-4197-b924-f9037a5c3f61 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:24.733147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7b052-bef2-4197-b924-f9037a5c3f61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:24.734561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7b052-bef2-4197-b924-f9037a5c3f61 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:24.752118 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 318/659] 10.222.0.24 () {56 vars in 1139 bytes} [Tue May 17 21:50:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:24.757197 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7b052-bef2-4197-b924-f9037a5c3f61 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:24.831455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 342/660] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:50:24.831455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9573d7-bc0a-4851-860e-383252439e90 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:24.831455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9573d7-bc0a-4851-860e-383252439e90 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:24.831455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9573d7-bc0a-4851-860e-383252439e90 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:24.831455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 343/661] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:24.831455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9573d7-bc0a-4851-860e-383252439e90 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:24.866761 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7b052-bef2-4197-b924-f9037a5c3f61 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:24.906124 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e7b33-7ba3-453f-badf-9f39ac4a2b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:24.906920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e7b33-7ba3-453f-badf-9f39ac4a2b42 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:24.907236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e7b33-7ba3-453f-badf-9f39ac4a2b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:24.907515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e7b33-7ba3-453f-badf-9f39ac4a2b42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:24.918006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e7b33-7ba3-453f-badf-9f39ac4a2b42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:24.919468 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e7b33-7ba3-453f-badf-9f39ac4a2b42 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:24.937737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ee3e7b33-7ba3-453f-badf-9f39ac4a2b42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:24.937737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:24.937737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:24.937737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:24.937737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:24.937737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:24.937737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:24.937737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:24.937737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:24.937737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:24.937737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:24.937737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:24.937737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:24.937737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:24.937737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:24.938795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:24.940050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:24.940050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:24.940050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:24.940050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:24.940050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 319/662] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:24.940320 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e7b33-7ba3-453f-badf-9f39ac4a2b42 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:24.947278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9573d7-bc0a-4851-860e-383252439e90 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:24.981147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7acec9-b50c-4640-9507-01358d0eb122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:24.981788 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7acec9-b50c-4640-9507-01358d0eb122 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:24.982068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7acec9-b50c-4640-9507-01358d0eb122 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:24.982345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7acec9-b50c-4640-9507-01358d0eb122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:25.042349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e7b33-7ba3-453f-badf-9f39ac4a2b42 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:25.048945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7acec9-b50c-4640-9507-01358d0eb122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:25.050387 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7acec9-b50c-4640-9507-01358d0eb122 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:25.076381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fe9c8-798c-4b54-afc8-5ba1c40cc145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:25.077524 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fe9c8-798c-4b54-afc8-5ba1c40cc145 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:25.078017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fe9c8-798c-4b54-afc8-5ba1c40cc145 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:25.078506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fe9c8-798c-4b54-afc8-5ba1c40cc145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:25.089628 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fe9c8-798c-4b54-afc8-5ba1c40cc145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:25.091126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fe9c8-798c-4b54-afc8-5ba1c40cc145 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:25.109864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f20fe9c8-798c-4b54-afc8-5ba1c40cc145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:25.109864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:25.109864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:25.109864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:25.109864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:25.109864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:25.109864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:25.109864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:25.109864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:25.109864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:25.109864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:25.109864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:25.109864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:25.109864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:25.109864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:25.110827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:25.111745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:25.111745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:25.111745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:25.111745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:25.111745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 320/663] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:25.112446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa2ede-e27d-4d16-a5b5-9ece0b467778 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:25.112635 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa2ede-e27d-4d16-a5b5-9ece0b467778 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:25.112918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa2ede-e27d-4d16-a5b5-9ece0b467778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:25.130255 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2eaa2ede-e27d-4d16-a5b5-9ece0b467778 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:25.131366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2eaa2ede-e27d-4d16-a5b5-9ece0b467778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:25.154527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 344/664] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:50:25.155748 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7acec9-b50c-4640-9507-01358d0eb122 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:25.211174 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 321/665] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:25.211174 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa2ede-e27d-4d16-a5b5-9ece0b467778 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:25.255925 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7acec9-b50c-4640-9507-01358d0eb122 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:25.289427 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de61c-2bcb-482b-bb19-dbd50001f02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:25.290620 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de61c-2bcb-482b-bb19-dbd50001f02b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:25.291031 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de61c-2bcb-482b-bb19-dbd50001f02b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:25.291334 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de61c-2bcb-482b-bb19-dbd50001f02b None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:25.292057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623de61c-2bcb-482b-bb19-dbd50001f02b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:25.292420 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623de61c-2bcb-482b-bb19-dbd50001f02b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:25.293739 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623de61c-2bcb-482b-bb19-dbd50001f02b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:25.309259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 345/666] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:25.309259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de61c-2bcb-482b-bb19-dbd50001f02b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:25.322755 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa2ede-e27d-4d16-a5b5-9ece0b467778 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:25.358941 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9564e67-ef4f-4826-8079-2684a5e33389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:25.359643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9564e67-ef4f-4826-8079-2684a5e33389 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:25.359928 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9564e67-ef4f-4826-8079-2684a5e33389 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:25.360202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9564e67-ef4f-4826-8079-2684a5e33389 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:25.360915 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9564e67-ef4f-4826-8079-2684a5e33389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:25.361219 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9564e67-ef4f-4826-8079-2684a5e33389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:25.362572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9564e67-ef4f-4826-8079-2684a5e33389 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:25.375148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 322/667] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:25.375148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9564e67-ef4f-4826-8079-2684a5e33389 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:25.406294 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de61c-2bcb-482b-bb19-dbd50001f02b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:25.439365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e2c10-af2b-4839-bde5-734101bc1037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:25.440199 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e2c10-af2b-4839-bde5-734101bc1037 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:25.440480 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e2c10-af2b-4839-bde5-734101bc1037 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:25.440752 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e2c10-af2b-4839-bde5-734101bc1037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:25.451606 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e2c10-af2b-4839-bde5-734101bc1037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:25.453045 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e2c10-af2b-4839-bde5-734101bc1037 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:25.469742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3c1e2c10-af2b-4839-bde5-734101bc1037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:25.469742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:25.469742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:25.469742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:25.469742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:25.469742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:25.469742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:25.469742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:25.469742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:25.469742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:25.469742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:25.469742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:25.469742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:25.469742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:25.469742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:25.470789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:25.471741 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:25.471741 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:25.471741 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:25.471741 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:25.471741 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 346/668] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:25.472083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e2c10-af2b-4839-bde5-734101bc1037 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:25.493215 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9564e67-ef4f-4826-8079-2684a5e33389 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:25.534681 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face2b6a-cbe6-4c35-aaec-53c22bcb35e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:25.535497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face2b6a-cbe6-4c35-aaec-53c22bcb35e9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:25.535779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face2b6a-cbe6-4c35-aaec-53c22bcb35e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:25.536056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face2b6a-cbe6-4c35-aaec-53c22bcb35e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:25.547671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face2b6a-cbe6-4c35-aaec-53c22bcb35e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-face2b6a-cbe6-4c35-aaec-53c22bcb35e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:25.556572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:25.557569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:25.558390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:25.558390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:25.558390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:25.558390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:25.558390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:25.558390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:25.558390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:25.558390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:25.558390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:25.558390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:25.558390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:25.558390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:25.558390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 323/669] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:25.559087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face2b6a-cbe6-4c35-aaec-53c22bcb35e9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:25.582844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e2c10-af2b-4839-bde5-734101bc1037 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:25.616959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f1c61-ae0c-4066-97cd-d0334763e178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:25.618248 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f1c61-ae0c-4066-97cd-d0334763e178 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:25.618539 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f1c61-ae0c-4066-97cd-d0334763e178 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:25.618808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f1c61-ae0c-4066-97cd-d0334763e178 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:25.625707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f1c61-ae0c-4066-97cd-d0334763e178 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:25.627319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f1c61-ae0c-4066-97cd-d0334763e178 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:25.642448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-d57f1c61-ae0c-4066-97cd-d0334763e178 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:25.642448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:25.642448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:25.642448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:25.642448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:25.642448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:25.642448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:25.642448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:25.642448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:25.642448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:25.642448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:25.642448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:25.642448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:25.642448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:25.642448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:25.643645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:25.644561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:25.644561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:25.644561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:25.644561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:25.644561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:25.644561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:25.644561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:25.644561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:25.644561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 347/670] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:25.645039 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f1c61-ae0c-4066-97cd-d0334763e178 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:25.667628 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face2b6a-cbe6-4c35-aaec-53c22bcb35e9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:25.702098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c3976-2a53-4f2b-a636-ba9f1a54d575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:25.702892 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c3976-2a53-4f2b-a636-ba9f1a54d575 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:25.703179 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c3976-2a53-4f2b-a636-ba9f1a54d575 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:25.703453 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c3976-2a53-4f2b-a636-ba9f1a54d575 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:25.710020 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c3976-2a53-4f2b-a636-ba9f1a54d575 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:25.711565 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c3976-2a53-4f2b-a636-ba9f1a54d575 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:25.726475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-fb3c3976-2a53-4f2b-a636-ba9f1a54d575 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:25.726475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:25.726475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:25.726475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:25.726475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:25.726475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:25.726475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:25.726475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:25.726475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:25.726475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:25.726475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:25.726475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:25.726475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:25.726475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:25.726475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:25.727945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:25.733889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:25.733889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:25.733889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:25.733889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:25.733889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:25.733889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:25.733889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:25.733889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:25.733889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 324/671] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:25.733889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c3976-2a53-4f2b-a636-ba9f1a54d575 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:25.748366 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f1c61-ae0c-4066-97cd-d0334763e178 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:25.781825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd126f-32a1-46dc-bab0-8b2e6e5ae17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:25.782806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd126f-32a1-46dc-bab0-8b2e6e5ae17a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:25.783276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd126f-32a1-46dc-bab0-8b2e6e5ae17a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:25.783549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd126f-32a1-46dc-bab0-8b2e6e5ae17a None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:25.784270 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd126f-32a1-46dc-bab0-8b2e6e5ae17a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:25.784625 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd126f-32a1-46dc-bab0-8b2e6e5ae17a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:25.785975 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd126f-32a1-46dc-bab0-8b2e6e5ae17a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:25.798066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 348/672] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:25.802783 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd126f-32a1-46dc-bab0-8b2e6e5ae17a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:25.836480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c3976-2a53-4f2b-a636-ba9f1a54d575 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:25.871123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c4b0d-a804-47aa-aeea-84eb3ff5b536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:25.871810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c4b0d-a804-47aa-aeea-84eb3ff5b536 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:25.872143 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c4b0d-a804-47aa-aeea-84eb3ff5b536 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:25.872428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c4b0d-a804-47aa-aeea-84eb3ff5b536 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:25.873172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c4b0d-a804-47aa-aeea-84eb3ff5b536 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:25.873481 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c4b0d-a804-47aa-aeea-84eb3ff5b536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:25.874847 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c4b0d-a804-47aa-aeea-84eb3ff5b536 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:25.882888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 325/673] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:25.884574 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c4b0d-a804-47aa-aeea-84eb3ff5b536 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:25.896272 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd126f-32a1-46dc-bab0-8b2e6e5ae17a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:25.932559 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aec874-9585-4b89-936c-a7f15d74a50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:25.933237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aec874-9585-4b89-936c-a7f15d74a50b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:25.933578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aec874-9585-4b89-936c-a7f15d74a50b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:25.933769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aec874-9585-4b89-936c-a7f15d74a50b None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:25.936948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aec874-9585-4b89-936c-a7f15d74a50b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:25.936948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aec874-9585-4b89-936c-a7f15d74a50b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:25.936948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aec874-9585-4b89-936c-a7f15d74a50b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:25.953597 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 349/674] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:25.953597 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aec874-9585-4b89-936c-a7f15d74a50b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:25.994251 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c4b0d-a804-47aa-aeea-84eb3ff5b536 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:26.027357 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5f3e8-5fd2-4a26-b952-8cb9c43367fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:26.028037 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5f3e8-5fd2-4a26-b952-8cb9c43367fc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:26.028314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5f3e8-5fd2-4a26-b952-8cb9c43367fc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:26.028584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5f3e8-5fd2-4a26-b952-8cb9c43367fc None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:26.029383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5f3e8-5fd2-4a26-b952-8cb9c43367fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:26.029687 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5f3e8-5fd2-4a26-b952-8cb9c43367fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:26.031206 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5f3e8-5fd2-4a26-b952-8cb9c43367fc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:26.049282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 326/675] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:26.049282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5f3e8-5fd2-4a26-b952-8cb9c43367fc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:26.054998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aec874-9585-4b89-936c-a7f15d74a50b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:26.090105 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33512481-4531-48d5-aaec-95ae77ca93e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:26.090899 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33512481-4531-48d5-aaec-95ae77ca93e1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:26.091205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33512481-4531-48d5-aaec-95ae77ca93e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:26.091478 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33512481-4531-48d5-aaec-95ae77ca93e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:26.098057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33512481-4531-48d5-aaec-95ae77ca93e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:26.099523 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33512481-4531-48d5-aaec-95ae77ca93e1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:26.113614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-33512481-4531-48d5-aaec-95ae77ca93e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:26.113614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:26.113614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:26.113614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:26.113614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:26.113614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:26.113614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:26.113614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:26.113614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:26.113614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:26.113614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:26.113614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:26.113614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:26.113614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:26.113614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:26.114511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:26.115421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:26.115421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:26.115421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:26.115421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:26.115421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:26.115421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:26.115421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:26.115421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:26.115421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 350/676] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:26.115910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33512481-4531-48d5-aaec-95ae77ca93e1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:26.151382 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5f3e8-5fd2-4a26-b952-8cb9c43367fc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:26.184616 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4190b60-f0fa-446e-a232-759fb1cc74ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:26.185333 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4190b60-f0fa-446e-a232-759fb1cc74ee None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:26.185619 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4190b60-f0fa-446e-a232-759fb1cc74ee None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:26.185894 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4190b60-f0fa-446e-a232-759fb1cc74ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:26.195780 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4190b60-f0fa-446e-a232-759fb1cc74ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:26.198683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4190b60-f0fa-446e-a232-759fb1cc74ee None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:26.215230 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33512481-4531-48d5-aaec-95ae77ca93e1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:26.216658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d4190b60-f0fa-446e-a232-759fb1cc74ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:26.216658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:26.216658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:26.216658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:26.216658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:26.216658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:26.216658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:26.216658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:26.216658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:26.216658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:26.216658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:26.216658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:26.216658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:26.216658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:26.216658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:26.217935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:26.223609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:26.223609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:26.223609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:26.223609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:26.223609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 327/677] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:26.223609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4190b60-f0fa-446e-a232-759fb1cc74ee None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:26.248413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b170820-6979-4c14-adb2-c185bcb9ab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:26.249059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b170820-6979-4c14-adb2-c185bcb9ab7b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:26.249336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b170820-6979-4c14-adb2-c185bcb9ab7b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:26.249615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b170820-6979-4c14-adb2-c185bcb9ab7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:26.250466 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b170820-6979-4c14-adb2-c185bcb9ab7b None admin] RBAC: Adding query filter params (role.id=17cc20a61bbf4f5ea7ae111203cfda47, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=8d06113649924eae83d04bc22337bd6d) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:26.250774 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b170820-6979-4c14-adb2-c185bcb9ab7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:26.252247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b170820-6979-4c14-adb2-c185bcb9ab7b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:26.257796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 351/678] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:26 2022] GET /identity/v3/role_assignments?user.id=8d06113649924eae83d04bc22337bd6d&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=17cc20a61bbf4f5ea7ae111203cfda47 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:26.259293 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b170820-6979-4c14-adb2-c185bcb9ab7b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:26.328709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4190b60-f0fa-446e-a232-759fb1cc74ee None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:26.363335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b170820-6979-4c14-adb2-c185bcb9ab7b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:26.365326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bc5f3-0e9a-4549-b6ad-0055f4a92d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:26.366220 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bc5f3-0e9a-4549-b6ad-0055f4a92d6e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:26.366504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bc5f3-0e9a-4549-b6ad-0055f4a92d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:26.366782 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bc5f3-0e9a-4549-b6ad-0055f4a92d6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:26.368252 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bc5f3-0e9a-4549-b6ad-0055f4a92d6e None admin] RBAC: Adding query filter params (role.id=17cc20a61bbf4f5ea7ae111203cfda47, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=f765ee92b36e43478c04db32227a5872) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:26.368712 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bc5f3-0e9a-4549-b6ad-0055f4a92d6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:26.370175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bc5f3-0e9a-4549-b6ad-0055f4a92d6e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:26.376546 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 328/679] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:26 2022] GET /identity/v3/role_assignments?user.id=f765ee92b36e43478c04db32227a5872&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=17cc20a61bbf4f5ea7ae111203cfda47 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:26.377958 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1b5b3-cb9d-4e02-9e18-093e6c23532e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:26.378349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1b5b3-cb9d-4e02-9e18-093e6c23532e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:26.378524 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1b5b3-cb9d-4e02-9e18-093e6c23532e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:26.384809 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 329/680] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:26.385887 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1b5b3-cb9d-4e02-9e18-093e6c23532e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:26.410259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d82e3-bd81-4bc8-a318-4e2fcd9aa278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:26.412126 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d82e3-bd81-4bc8-a318-4e2fcd9aa278 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:26.412889 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d82e3-bd81-4bc8-a318-4e2fcd9aa278 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:26.413457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d82e3-bd81-4bc8-a318-4e2fcd9aa278 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:26.415285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d82e3-bd81-4bc8-a318-4e2fcd9aa278 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:26.415817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d82e3-bd81-4bc8-a318-4e2fcd9aa278 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:26.418380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d82e3-bd81-4bc8-a318-4e2fcd9aa278 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:26.436854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 352/681] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:26.438946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dc292-6285-4ad5-941c-28247f26e3f5 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:26.439431 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dc292-6285-4ad5-941c-28247f26e3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:26.439855 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dc292-6285-4ad5-941c-28247f26e3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:26.459869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-cb9dc292-6285-4ad5-941c-28247f26e3f5 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:26.461321 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cb9dc292-6285-4ad5-941c-28247f26e3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:26.518493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1b5b3-cb9d-4e02-9e18-093e6c23532e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:26.552999 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 353/682] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:26.556382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dc292-6285-4ad5-941c-28247f26e3f5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:26.565454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124da304-92c4-4ed9-a635-05096234d35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:26.566293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124da304-92c4-4ed9-a635-05096234d35b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:26.566673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124da304-92c4-4ed9-a635-05096234d35b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:26.567567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124da304-92c4-4ed9-a635-05096234d35b None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:26.568449 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124da304-92c4-4ed9-a635-05096234d35b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:26.568850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124da304-92c4-4ed9-a635-05096234d35b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:26.570707 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124da304-92c4-4ed9-a635-05096234d35b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:26.587752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 330/683] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:26.588527 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124da304-92c4-4ed9-a635-05096234d35b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:26.673488 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dc292-6285-4ad5-941c-28247f26e3f5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:26.705922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124da304-92c4-4ed9-a635-05096234d35b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:26.709558 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d23ef7-3920-4893-ab28-34b4d27a4cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:26.710462 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d23ef7-3920-4893-ab28-34b4d27a4cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:26.710947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d23ef7-3920-4893-ab28-34b4d27a4cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:26.711498 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d23ef7-3920-4893-ab28-34b4d27a4cc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:26.712565 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d23ef7-3920-4893-ab28-34b4d27a4cc7 None admin] RBAC: Adding query filter params (role.id=17cc20a61bbf4f5ea7ae111203cfda47, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=c084b56d682c44119654743809109bc4) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:26.713083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d23ef7-3920-4893-ab28-34b4d27a4cc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:26.714724 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d23ef7-3920-4893-ab28-34b4d27a4cc7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:26.721454 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 354/684] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:26 2022] GET /identity/v3/role_assignments?user.id=c084b56d682c44119654743809109bc4&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=17cc20a61bbf4f5ea7ae111203cfda47 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:26.722500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d23ef7-3920-4893-ab28-34b4d27a4cc7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:26.753481 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589ed13-eeb4-4506-9a65-3ec91959593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:26.754364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589ed13-eeb4-4506-9a65-3ec91959593d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:26.754648 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589ed13-eeb4-4506-9a65-3ec91959593d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:26.755307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589ed13-eeb4-4506-9a65-3ec91959593d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:26.772516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589ed13-eeb4-4506-9a65-3ec91959593d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:26.774050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589ed13-eeb4-4506-9a65-3ec91959593d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:26.809774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c589ed13-eeb4-4506-9a65-3ec91959593d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:26.809774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:26.809774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:26.809774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:26.809774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:26.809774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:26.809774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:26.809774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:26.809774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:26.809774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:26.809774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:26.809774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:26.809774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:26.809774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:26.809774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:26.810722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:26.811642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:26.811642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:26.811642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:26.811642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:26.815465 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 331/685] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:26.816845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589ed13-eeb4-4506-9a65-3ec91959593d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:26.836007 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d23ef7-3920-4893-ab28-34b4d27a4cc7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:26.882643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6333d0-ad56-4b4f-be35-a3a787fb6d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:26.883972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6333d0-ad56-4b4f-be35-a3a787fb6d59 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:26.884498 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6333d0-ad56-4b4f-be35-a3a787fb6d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:26.885002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6333d0-ad56-4b4f-be35-a3a787fb6d59 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:26.911999 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6333d0-ad56-4b4f-be35-a3a787fb6d59 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:26.913470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6333d0-ad56-4b4f-be35-a3a787fb6d59 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-4d6333d0-ad56-4b4f-be35-a3a787fb6d59 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:26.948212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:26.949224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:26.950147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:26.950147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:26.950147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:26.950147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:26.950147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:26.950147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:26.950147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:26.950147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:26.950147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 21:50:26.950147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:26.950147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 355/686] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:50:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:26.962199 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6333d0-ad56-4b4f-be35-a3a787fb6d59 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:26.986152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589ed13-eeb4-4506-9a65-3ec91959593d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:27.050436 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626a14e-b6d9-4052-a225-023beb3150bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:27.051423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626a14e-b6d9-4052-a225-023beb3150bd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:27.051703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626a14e-b6d9-4052-a225-023beb3150bd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:27.051975 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626a14e-b6d9-4052-a225-023beb3150bd None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:27.052700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626a14e-b6d9-4052-a225-023beb3150bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:27.053004 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626a14e-b6d9-4052-a225-023beb3150bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:27.054360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626a14e-b6d9-4052-a225-023beb3150bd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:27.067142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 332/687] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:27.076429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626a14e-b6d9-4052-a225-023beb3150bd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:27.107949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6333d0-ad56-4b4f-be35-a3a787fb6d59 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:27.142600 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2fa10-edac-4590-b307-6303df69fe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:27.143570 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2fa10-edac-4590-b307-6303df69fe77 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:27.143996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2fa10-edac-4590-b307-6303df69fe77 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:27.144482 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2fa10-edac-4590-b307-6303df69fe77 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:27.145517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2fa10-edac-4590-b307-6303df69fe77 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:27.146024 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2fa10-edac-4590-b307-6303df69fe77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:27.147708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2fa10-edac-4590-b307-6303df69fe77 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:27.166497 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 356/688] 10.222.0.24 () {56 vars in 1135 bytes} [Tue May 17 21:50:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:27.171556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2fa10-edac-4590-b307-6303df69fe77 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:27.182910 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626a14e-b6d9-4052-a225-023beb3150bd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:27.217743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8acec-e5e8-4983-99b4-942291ac3243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:27.218457 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8acec-e5e8-4983-99b4-942291ac3243 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:27.218833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8acec-e5e8-4983-99b4-942291ac3243 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:27.218833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8acec-e5e8-4983-99b4-942291ac3243 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:27.219594 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8acec-e5e8-4983-99b4-942291ac3243 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:27.221017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8acec-e5e8-4983-99b4-942291ac3243 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:27.282301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2fa10-edac-4590-b307-6303df69fe77 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:27.320453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507746d-e3ef-4f0b-acd1-5938fe9a58c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:27.321762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507746d-e3ef-4f0b-acd1-5938fe9a58c4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:27.322180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507746d-e3ef-4f0b-acd1-5938fe9a58c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:27.322627 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507746d-e3ef-4f0b-acd1-5938fe9a58c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:27.338301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 333/689] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:50:27 2022] POST /identity/v3/users => generated 254 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:50:27.398880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507746d-e3ef-4f0b-acd1-5938fe9a58c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:27.401288 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507746d-e3ef-4f0b-acd1-5938fe9a58c4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:27.509672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 357/690] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 21:50:27.515275 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8acec-e5e8-4983-99b4-942291ac3243 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:27.651307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8acec-e5e8-4983-99b4-942291ac3243 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:27.690404 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe1424-d396-4739-8719-723bdbc45d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:27.691225 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe1424-d396-4739-8719-723bdbc45d4d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:27.691510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe1424-d396-4739-8719-723bdbc45d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:27.691782 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe1424-d396-4739-8719-723bdbc45d4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:27.705929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe1424-d396-4739-8719-723bdbc45d4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:27.709072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe1424-d396-4739-8719-723bdbc45d4d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:27.726557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c8fe1424-d396-4739-8719-723bdbc45d4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:27.726557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:27.726557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:27.726557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:27.726557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:27.726557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:27.726557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:27.726557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:27.726557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:27.726557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:27.726557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:27.726557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:27.726557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:27.726557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:27.726557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:27.727592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:27.728452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:27.728452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:27.728452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:27.728452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:27.728452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 334/691] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:27.734593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507746d-e3ef-4f0b-acd1-5938fe9a58c4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:27.844049 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507746d-e3ef-4f0b-acd1-5938fe9a58c4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:27.880250 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd4f3-7ea7-4bb3-81c5-d54d27f5a842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:27.880918 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd4f3-7ea7-4bb3-81c5-d54d27f5a842 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:27.881199 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd4f3-7ea7-4bb3-81c5-d54d27f5a842 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:27.881472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cd4f3-7ea7-4bb3-81c5-d54d27f5a842 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:27.882201 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cd4f3-7ea7-4bb3-81c5-d54d27f5a842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:27.882510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cd4f3-7ea7-4bb3-81c5-d54d27f5a842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:27.884220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cd4f3-7ea7-4bb3-81c5-d54d27f5a842 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:27.896762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 358/692] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:27.902638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe1424-d396-4739-8719-723bdbc45d4d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:28.013058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe1424-d396-4739-8719-723bdbc45d4d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:28.050574 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddd39f-1bb1-4be2-befc-57fa148037ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:28.051652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddd39f-1bb1-4be2-befc-57fa148037ff None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:28.051939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddd39f-1bb1-4be2-befc-57fa148037ff None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:28.052216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddd39f-1bb1-4be2-befc-57fa148037ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:28.061901 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddd39f-1bb1-4be2-befc-57fa148037ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:28.063383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddd39f-1bb1-4be2-befc-57fa148037ff None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:28.081779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-40ddd39f-1bb1-4be2-befc-57fa148037ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:28.081779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:28.081779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:28.081779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:28.081779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:28.081779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:28.081779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:28.081779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:28.081779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:28.081779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:28.081779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:28.081779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:28.081779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:28.081779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:28.081779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:28.083849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:28.085970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:28.085970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:28.085970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:28.085970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:28.085970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:28.085970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:28.085970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:28.085970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:28.091135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 335/693] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:28.091671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd4f3-7ea7-4bb3-81c5-d54d27f5a842 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:28.236992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cd4f3-7ea7-4bb3-81c5-d54d27f5a842 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:28.271898 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cb638-4bde-41d6-b7ab-9f45bbd699b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:28.272619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cb638-4bde-41d6-b7ab-9f45bbd699b4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:28.272905 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cb638-4bde-41d6-b7ab-9f45bbd699b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:28.273178 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cb638-4bde-41d6-b7ab-9f45bbd699b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:28.274092 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560cb638-4bde-41d6-b7ab-9f45bbd699b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:28.274408 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560cb638-4bde-41d6-b7ab-9f45bbd699b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:28.276070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560cb638-4bde-41d6-b7ab-9f45bbd699b4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:28.288836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 359/694] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:28.294863 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddd39f-1bb1-4be2-befc-57fa148037ff None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:28.440585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddd39f-1bb1-4be2-befc-57fa148037ff None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:28.481165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7a4fd-7740-4ee6-86bc-22a4932bc887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:28.481824 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7a4fd-7740-4ee6-86bc-22a4932bc887 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:28.482107 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7a4fd-7740-4ee6-86bc-22a4932bc887 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:28.482377 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7a4fd-7740-4ee6-86bc-22a4932bc887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:28.483233 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7a4fd-7740-4ee6-86bc-22a4932bc887 None admin] RBAC: Adding query filter params (role.id=17cc20a61bbf4f5ea7ae111203cfda47, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=957c3decfb19445d80836f767fa23bd7) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:28.483597 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7a4fd-7740-4ee6-86bc-22a4932bc887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:28.485013 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7a4fd-7740-4ee6-86bc-22a4932bc887 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:28.498426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 336/695] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:28 2022] GET /identity/v3/role_assignments?user.id=957c3decfb19445d80836f767fa23bd7&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=17cc20a61bbf4f5ea7ae111203cfda47 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:28.984134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d90bf4-1d1a-4562-b9dd-619bea27d5a5 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:28.984651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d90bf4-1d1a-4562-b9dd-619bea27d5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:28.984753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d90bf4-1d1a-4562-b9dd-619bea27d5a5 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:28.986290 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 360/696] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:28.992123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e54b3-db78-444f-b9ec-5f671e49db17 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:28.992401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e54b3-db78-444f-b9ec-5f671e49db17 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:28.992750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e54b3-db78-444f-b9ec-5f671e49db17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:29.012893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f06e54b3-db78-444f-b9ec-5f671e49db17 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:29.014088 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f06e54b3-db78-444f-b9ec-5f671e49db17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:29.015970 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f3130-79b1-4b59-a11e-066892d7593f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:29.016256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f3130-79b1-4b59-a11e-066892d7593f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:29.016531 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f3130-79b1-4b59-a11e-066892d7593f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:29.018166 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 361/697] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:29.022823 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae6524-b716-49c3-bd5a-6830a3792fcb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:29.023139 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae6524-b716-49c3-bd5a-6830a3792fcb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:29.025397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae6524-b716-49c3-bd5a-6830a3792fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:29.044344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-12ae6524-b716-49c3-bd5a-6830a3792fcb None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:29.045514 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-12ae6524-b716-49c3-bd5a-6830a3792fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:29.093288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 337/698] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:50:29.121542 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e54b3-db78-444f-b9ec-5f671e49db17 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:29.130313 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 362/699] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:50:29.155241 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae6524-b716-49c3-bd5a-6830a3792fcb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:29.245622 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e54b3-db78-444f-b9ec-5f671e49db17 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:29.305803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5bb08-08b0-4d45-953a-22c79d8a7026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:29.306846 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5bb08-08b0-4d45-953a-22c79d8a7026 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:29.307140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5bb08-08b0-4d45-953a-22c79d8a7026 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:29.307418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5bb08-08b0-4d45-953a-22c79d8a7026 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:29.317851 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae6524-b716-49c3-bd5a-6830a3792fcb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:29.332630 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5bb08-08b0-4d45-953a-22c79d8a7026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-bcf5bb08-08b0-4d45-953a-22c79d8a7026 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:29.342264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:29.348287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:29.349133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:29.349133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:29.349133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:29.349133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:29.349133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:29.349133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:29.349133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:29.349133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:29.349133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:29.349133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:29.349133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:50:29.349133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:29.349133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 338/700] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:50:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:29.353959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5bb08-08b0-4d45-953a-22c79d8a7026 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:29.380238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a388975-afe1-4f0c-8655-45ac2758ff17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:29.381055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a388975-afe1-4f0c-8655-45ac2758ff17 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:29.381386 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a388975-afe1-4f0c-8655-45ac2758ff17 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:29.381658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a388975-afe1-4f0c-8655-45ac2758ff17 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:29.382286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a388975-afe1-4f0c-8655-45ac2758ff17 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:29.383886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a388975-afe1-4f0c-8655-45ac2758ff17 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3a388975-afe1-4f0c-8655-45ac2758ff17 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:29.399962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:29.402383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:29.404572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 363/701] 10.222.0.24 () {56 vars in 1129 bytes} [Tue May 17 21:50:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:29.416270 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a388975-afe1-4f0c-8655-45ac2758ff17 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:29.567378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5bb08-08b0-4d45-953a-22c79d8a7026 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:29.604993 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a388975-afe1-4f0c-8655-45ac2758ff17 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:29.625486 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53177b54-eee0-4b4a-bdc0-ea5726fd3acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:29.626487 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53177b54-eee0-4b4a-bdc0-ea5726fd3acf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:29.626989 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53177b54-eee0-4b4a-bdc0-ea5726fd3acf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:29.627477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53177b54-eee0-4b4a-bdc0-ea5726fd3acf None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:29.628404 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53177b54-eee0-4b4a-bdc0-ea5726fd3acf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:29.628923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53177b54-eee0-4b4a-bdc0-ea5726fd3acf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:29.630465 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53177b54-eee0-4b4a-bdc0-ea5726fd3acf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:29.640595 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 339/702] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:50:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:29.642240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec12fd-96b1-481e-81c8-f8a69f245e17 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:29.642738 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec12fd-96b1-481e-81c8-f8a69f245e17 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:29.643237 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec12fd-96b1-481e-81c8-f8a69f245e17 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:29.645037 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 340/703] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:29.648923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec12fd-96b1-481e-81c8-f8a69f245e17 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:29.656913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395a001-9917-414b-8f43-4369601a4d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:29.657590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395a001-9917-414b-8f43-4369601a4d89 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:29.657865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395a001-9917-414b-8f43-4369601a4d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:29.658132 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395a001-9917-414b-8f43-4369601a4d89 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:29.658832 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395a001-9917-414b-8f43-4369601a4d89 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:29.659516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395a001-9917-414b-8f43-4369601a4d89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:29.660511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395a001-9917-414b-8f43-4369601a4d89 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:29.669778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 364/704] 10.222.0.24 () {56 vars in 1124 bytes} [Tue May 17 21:50:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:29.669778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb9cd0-2ac3-4e83-99fb-a390004a8211 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:29.669778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb9cd0-2ac3-4e83-99fb-a390004a8211 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:29.669778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb9cd0-2ac3-4e83-99fb-a390004a8211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:29.686751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-fdeb9cd0-2ac3-4e83-99fb-a390004a8211 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:29.688207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fdeb9cd0-2ac3-4e83-99fb-a390004a8211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:29.756801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 365/705] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:29.757976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb9cd0-2ac3-4e83-99fb-a390004a8211 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:29.778768 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec12fd-96b1-481e-81c8-f8a69f245e17 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:29.821983 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9307c40-d75d-46dd-a4a6-0fde2a0d2842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:29.823100 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9307c40-d75d-46dd-a4a6-0fde2a0d2842 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:29.823465 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9307c40-d75d-46dd-a4a6-0fde2a0d2842 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:29.824133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9307c40-d75d-46dd-a4a6-0fde2a0d2842 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:29.838706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9307c40-d75d-46dd-a4a6-0fde2a0d2842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:29.840724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9307c40-d75d-46dd-a4a6-0fde2a0d2842 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:29.863047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d9307c40-d75d-46dd-a4a6-0fde2a0d2842 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:29.863047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:29.863047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:29.863047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:29.863047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:29.863047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:29.863047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:29.863047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:29.863047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:29.863047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:29.863047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:29.863047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:29.863047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:29.863047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:29.863047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:29.864207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:29.865282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:29.865282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:29.865282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:29.865282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:29.866431 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb9cd0-2ac3-4e83-99fb-a390004a8211 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:29.866906 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 341/706] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:29.868450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9307c40-d75d-46dd-a4a6-0fde2a0d2842 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:29.904335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a07107-432b-4e16-80eb-b712a740711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:29.905445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a07107-432b-4e16-80eb-b712a740711e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:29.905926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a07107-432b-4e16-80eb-b712a740711e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:29.906599 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a07107-432b-4e16-80eb-b712a740711e None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:29.907594 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a07107-432b-4e16-80eb-b712a740711e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:29.908151 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a07107-432b-4e16-80eb-b712a740711e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:29.909782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a07107-432b-4e16-80eb-b712a740711e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:29.923387 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 366/707] 10.222.0.24 () {56 vars in 1124 bytes} [Tue May 17 21:50:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:29.924753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a07107-432b-4e16-80eb-b712a740711e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:29.989040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9307c40-d75d-46dd-a4a6-0fde2a0d2842 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:30.035943 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b559d7a-40ce-417d-a705-5494a0df69a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:30.036774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b559d7a-40ce-417d-a705-5494a0df69a1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:30.037061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b559d7a-40ce-417d-a705-5494a0df69a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:30.037337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b559d7a-40ce-417d-a705-5494a0df69a1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:30.038010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b559d7a-40ce-417d-a705-5494a0df69a1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:30.040578 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b559d7a-40ce-417d-a705-5494a0df69a1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-7b559d7a-40ce-417d-a705-5494a0df69a1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:30.068058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:30.069172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:30.070415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:30.070415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:30.070415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:30.070415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:30.070415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:30.070415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:30.070415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:30.070415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:30.070415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:30.070415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:30.070415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:30.070415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:30.070415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 21:50:30.070415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:30.083824 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 342/708] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:29 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:30.084803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b559d7a-40ce-417d-a705-5494a0df69a1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:30.135419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a07107-432b-4e16-80eb-b712a740711e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:30.182190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da9c09-aa15-4f26-ad43-3cbb41625eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:30.182829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da9c09-aa15-4f26-ad43-3cbb41625eec None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:30.183134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da9c09-aa15-4f26-ad43-3cbb41625eec None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:30.184545 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da9c09-aa15-4f26-ad43-3cbb41625eec None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:30.185324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da9c09-aa15-4f26-ad43-3cbb41625eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:30.185636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da9c09-aa15-4f26-ad43-3cbb41625eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:30.187480 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da9c09-aa15-4f26-ad43-3cbb41625eec None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:30.209149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 367/709] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:30.215321 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da9c09-aa15-4f26-ad43-3cbb41625eec None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:30.262942 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b559d7a-40ce-417d-a705-5494a0df69a1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:30.299410 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909ed7a-4db9-43ed-bc52-559d1703c626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:30.300523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909ed7a-4db9-43ed-bc52-559d1703c626 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:30.301295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909ed7a-4db9-43ed-bc52-559d1703c626 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:30.301785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909ed7a-4db9-43ed-bc52-559d1703c626 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:30.302688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909ed7a-4db9-43ed-bc52-559d1703c626 None admin] RBAC: Adding query filter params (name=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:30.303223 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909ed7a-4db9-43ed-bc52-559d1703c626 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:30.305010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909ed7a-4db9-43ed-bc52-559d1703c626 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:30.310360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 343/710] 10.222.0.24 () {56 vars in 1112 bytes} [Tue May 17 21:50:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:30.320067 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909ed7a-4db9-43ed-bc52-559d1703c626 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:30.339476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da9c09-aa15-4f26-ad43-3cbb41625eec None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:30.383033 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b8491-8f27-44b4-bf4c-b81532fd6e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:30.383965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b8491-8f27-44b4-bf4c-b81532fd6e3f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:30.384311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b8491-8f27-44b4-bf4c-b81532fd6e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:30.384588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b8491-8f27-44b4-bf4c-b81532fd6e3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:30.394664 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b8491-8f27-44b4-bf4c-b81532fd6e3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:30.396172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b8491-8f27-44b4-bf4c-b81532fd6e3f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-280b8491-8f27-44b4-bf4c-b81532fd6e3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:30.410880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:30.412115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:30.413073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:30.413073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:30.413073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:30.413073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:30.413073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:30.413073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:30.413073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:30.413073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:30.413073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 21:50:30.413073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:30.413073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 368/711] 10.222.0.24 () {56 vars in 1093 bytes} [Tue May 17 21:50:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:30.413772 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71ad6e-400d-4200-bd3b-30f8fc47c18a None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:30.415300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71ad6e-400d-4200-bd3b-30f8fc47c18a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:30.415300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71ad6e-400d-4200-bd3b-30f8fc47c18a None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:30.416372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 369/712] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:30.421589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854953c7-ce02-4fe7-8666-236eb0845393 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:30.422067 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854953c7-ce02-4fe7-8666-236eb0845393 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:30.422354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854953c7-ce02-4fe7-8666-236eb0845393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:30.440539 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-854953c7-ce02-4fe7-8666-236eb0845393 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:30.441626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-854953c7-ce02-4fe7-8666-236eb0845393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:30.461580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909ed7a-4db9-43ed-bc52-559d1703c626 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:30.511803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d4c88-6834-4a37-b9db-807a16781bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:30.512523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d4c88-6834-4a37-b9db-807a16781bce None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:30.512851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d4c88-6834-4a37-b9db-807a16781bce None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:30.513127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d4c88-6834-4a37-b9db-807a16781bce None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:30.514031 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d4c88-6834-4a37-b9db-807a16781bce None admin] RBAC: Adding query filter params (type=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:30.514643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d4c88-6834-4a37-b9db-807a16781bce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:30.516296 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d4c88-6834-4a37-b9db-807a16781bce None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:30.519266 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 370/713] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 21:50:30.520260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854953c7-ce02-4fe7-8666-236eb0845393 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:30.527426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 344/714] 10.222.0.24 () {56 vars in 1112 bytes} [Tue May 17 21:50:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:30.547315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d4c88-6834-4a37-b9db-807a16781bce None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:30.628361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854953c7-ce02-4fe7-8666-236eb0845393 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:30.670175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934f806-22ae-4629-8379-6e2eea912a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:30.672082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934f806-22ae-4629-8379-6e2eea912a7d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:30.672247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934f806-22ae-4629-8379-6e2eea912a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:30.672543 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934f806-22ae-4629-8379-6e2eea912a7d None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:30.673644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934f806-22ae-4629-8379-6e2eea912a7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:30.673777 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934f806-22ae-4629-8379-6e2eea912a7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:30.675318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934f806-22ae-4629-8379-6e2eea912a7d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:30.677286 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d4c88-6834-4a37-b9db-807a16781bce None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:30.720831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 371/715] 10.222.0.24 () {56 vars in 1133 bytes} [Tue May 17 21:50:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:30.728005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0ca52-925b-4f2b-9017-7958dd5c5e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:30.728832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0ca52-925b-4f2b-9017-7958dd5c5e16 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:30.729118 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0ca52-925b-4f2b-9017-7958dd5c5e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:30.729394 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0ca52-925b-4f2b-9017-7958dd5c5e16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:30.730909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934f806-22ae-4629-8379-6e2eea912a7d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:30.755833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0ca52-925b-4f2b-9017-7958dd5c5e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-7cf0ca52-925b-4f2b-9017-7958dd5c5e16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:30.765334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:30.766326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:30.767626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:30.767626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:30.767626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:30.767626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:30.767626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:30.767626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:30.767626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:30.767626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:30.767626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:30.767626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:30.767626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:30.767626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:30.767626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 345/716] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:30.775437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0ca52-925b-4f2b-9017-7958dd5c5e16 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:30.923314 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934f806-22ae-4629-8379-6e2eea912a7d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:30.943205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0ca52-925b-4f2b-9017-7958dd5c5e16 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:30.994877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3267d-955f-40ff-b45b-be8aa3ad8b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:30.995898 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3267d-955f-40ff-b45b-be8aa3ad8b94 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:30.996377 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3267d-955f-40ff-b45b-be8aa3ad8b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:30.996955 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3267d-955f-40ff-b45b-be8aa3ad8b94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:31.014110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555152c-5add-4056-b2ad-c2a393f087a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:31.015270 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555152c-5add-4056-b2ad-c2a393f087a9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:31.015757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555152c-5add-4056-b2ad-c2a393f087a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:31.016295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555152c-5add-4056-b2ad-c2a393f087a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:31.017261 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555152c-5add-4056-b2ad-c2a393f087a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:31.017772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555152c-5add-4056-b2ad-c2a393f087a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:31.019643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555152c-5add-4056-b2ad-c2a393f087a9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:31.040954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 346/717] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:31.048198 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555152c-5add-4056-b2ad-c2a393f087a9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:31.161961 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555152c-5add-4056-b2ad-c2a393f087a9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:31.169203 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3267d-955f-40ff-b45b-be8aa3ad8b94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:31.171308 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3267d-955f-40ff-b45b-be8aa3ad8b94 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:31.217682 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca575d1-40a7-4c21-b474-ab811b536787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:31.219244 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca575d1-40a7-4c21-b474-ab811b536787 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:31.219727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca575d1-40a7-4c21-b474-ab811b536787 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:31.220199 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca575d1-40a7-4c21-b474-ab811b536787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:31.244797 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca575d1-40a7-4c21-b474-ab811b536787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:31.246668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca575d1-40a7-4c21-b474-ab811b536787 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:31.279669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8ca575d1-40a7-4c21-b474-ab811b536787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:31.279669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:31.279669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:31.279669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:31.279669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:31.279669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:31.279669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:31.279669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:31.279669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:31.279669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:31.279669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:31.279669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:31.279669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:31.279669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:31.279669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:31.280702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:31.281605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:31.281605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:31.281605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:31.281605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:31.284854 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 347/718] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:31.290908 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca575d1-40a7-4c21-b474-ab811b536787 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:31.377140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 372/719] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:50:31.381243 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3267d-955f-40ff-b45b-be8aa3ad8b94 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:31.472194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca575d1-40a7-4c21-b474-ab811b536787 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:31.496172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3267d-955f-40ff-b45b-be8aa3ad8b94 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:31.506909 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a6e4b-3301-4e9d-9753-4bf0dfab0da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:31.507576 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a6e4b-3301-4e9d-9753-4bf0dfab0da0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:31.508024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a6e4b-3301-4e9d-9753-4bf0dfab0da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:31.508219 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a6e4b-3301-4e9d-9753-4bf0dfab0da0 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:31.508887 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a6e4b-3301-4e9d-9753-4bf0dfab0da0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:31.509196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a6e4b-3301-4e9d-9753-4bf0dfab0da0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:31.510558 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a6e4b-3301-4e9d-9753-4bf0dfab0da0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:31.523081 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 348/720] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:31.525143 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ef3f2-f9d7-43c3-a963-a3e5be4f2fe6 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:31.525404 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ef3f2-f9d7-43c3-a963-a3e5be4f2fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:31.525686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ef3f2-f9d7-43c3-a963-a3e5be4f2fe6 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:31.531257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 349/721] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:31.532727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ef3f2-f9d7-43c3-a963-a3e5be4f2fe6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:31.536466 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89ef16-b949-4ebb-bfd6-051b40698f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:31.537542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89ef16-b949-4ebb-bfd6-051b40698f41 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:31.538025 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89ef16-b949-4ebb-bfd6-051b40698f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:31.538510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89ef16-b949-4ebb-bfd6-051b40698f41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:31.549818 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89ef16-b949-4ebb-bfd6-051b40698f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:31.551890 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89ef16-b949-4ebb-bfd6-051b40698f41 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:31.571751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-af89ef16-b949-4ebb-bfd6-051b40698f41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:31.571751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:31.571751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:31.571751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:31.571751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:31.571751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:31.571751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:31.571751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:31.571751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:31.571751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:31.571751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:31.571751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:31.571751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:31.571751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:31.571751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:31.572750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:31.573632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:31.573632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:31.573632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:31.573632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:31.580076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 373/722] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:31.581143 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc1ae3-25b6-4851-84d2-b7315b182d3b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:31.581438 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc1ae3-25b6-4851-84d2-b7315b182d3b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:31.581712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc1ae3-25b6-4851-84d2-b7315b182d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:31.609279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2dcc1ae3-25b6-4851-84d2-b7315b182d3b None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:31.610968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2dcc1ae3-25b6-4851-84d2-b7315b182d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:31.649552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ef3f2-f9d7-43c3-a963-a3e5be4f2fe6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:31.684200 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284a972-141f-4752-b948-72667d1ab472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:31.685012 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284a972-141f-4752-b948-72667d1ab472 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:31.685299 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284a972-141f-4752-b948-72667d1ab472 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:31.685579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284a972-141f-4752-b948-72667d1ab472 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:31.694562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284a972-141f-4752-b948-72667d1ab472 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:31.694562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284a972-141f-4752-b948-72667d1ab472 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:31.694991 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 374/723] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:31.696147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc1ae3-25b6-4851-84d2-b7315b182d3b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5284a972-141f-4752-b948-72667d1ab472 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:31.710720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:31.712260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:31.713995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:31.713995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:31.713995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:31.713995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:31.713995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:31.713995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:31.713995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:31.713995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:31.713995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 21:50:31.713995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:31.713995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 350/724] 10.222.0.24 () {56 vars in 1117 bytes} [Tue May 17 21:50:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:31.723304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284a972-141f-4752-b948-72667d1ab472 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:31.817530 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc1ae3-25b6-4851-84d2-b7315b182d3b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:31.849899 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284a972-141f-4752-b948-72667d1ab472 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:31.852747 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350658f8-f572-41a9-9a80-f3bb35cb8029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:31.853769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350658f8-f572-41a9-9a80-f3bb35cb8029 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:31.854258 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350658f8-f572-41a9-9a80-f3bb35cb8029 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:31.854747 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350658f8-f572-41a9-9a80-f3bb35cb8029 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:31.855705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350658f8-f572-41a9-9a80-f3bb35cb8029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:31.856233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350658f8-f572-41a9-9a80-f3bb35cb8029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:31.857817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350658f8-f572-41a9-9a80-f3bb35cb8029 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:31.870867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 375/725] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:31.873385 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350658f8-f572-41a9-9a80-f3bb35cb8029 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:31.893461 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81caf1f-f2fe-4433-b2e0-bffd5b4b1e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:31.894514 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81caf1f-f2fe-4433-b2e0-bffd5b4b1e02 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:31.895004 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81caf1f-f2fe-4433-b2e0-bffd5b4b1e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:31.895512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81caf1f-f2fe-4433-b2e0-bffd5b4b1e02 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:31.897196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81caf1f-f2fe-4433-b2e0-bffd5b4b1e02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:31.897790 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81caf1f-f2fe-4433-b2e0-bffd5b4b1e02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:31.899680 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81caf1f-f2fe-4433-b2e0-bffd5b4b1e02 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:31.923368 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 351/726] 10.222.0.24 () {56 vars in 1149 bytes} [Tue May 17 21:50:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:31.924640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81caf1f-f2fe-4433-b2e0-bffd5b4b1e02 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:31.999122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350658f8-f572-41a9-9a80-f3bb35cb8029 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:32.034726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b916d07-cd8c-41b5-9e3c-eb04eea2db49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:32.035094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81caf1f-f2fe-4433-b2e0-bffd5b4b1e02 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:32.036111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b916d07-cd8c-41b5-9e3c-eb04eea2db49 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:32.036601 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b916d07-cd8c-41b5-9e3c-eb04eea2db49 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:32.037114 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b916d07-cd8c-41b5-9e3c-eb04eea2db49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:32.048898 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b916d07-cd8c-41b5-9e3c-eb04eea2db49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-0b916d07-cd8c-41b5-9e3c-eb04eea2db49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:32.057458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:32.058395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:32.059278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:32.059278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:32.059278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:32.059278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:32.059278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:32.059278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:32.059278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:32.059278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:32.059278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:32.059278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:32.059278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:50:32.059278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:32.062507 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 376/727] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:50:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:32.063589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b916d07-cd8c-41b5-9e3c-eb04eea2db49 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:32.075373 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360f6d7-3e1a-4a7f-b6d5-a21669588a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:32.076432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360f6d7-3e1a-4a7f-b6d5-a21669588a0c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:32.076432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360f6d7-3e1a-4a7f-b6d5-a21669588a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:32.076603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360f6d7-3e1a-4a7f-b6d5-a21669588a0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:32.084208 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360f6d7-3e1a-4a7f-b6d5-a21669588a0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:32.085645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360f6d7-3e1a-4a7f-b6d5-a21669588a0c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:32.099618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a360f6d7-3e1a-4a7f-b6d5-a21669588a0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:32.099618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:32.099618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:32.099618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:32.099618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:32.099618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:32.099618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:32.099618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:32.099618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:32.099618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:32.099618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:32.099618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:32.099618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:32.099618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:32.099618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:32.100532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:32.101406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:32.101406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:32.101406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:32.101406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:32.101406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:32.101406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:32.101406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:32.101406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:32.105683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 352/728] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:32.106526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360f6d7-3e1a-4a7f-b6d5-a21669588a0c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:32.175566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b916d07-cd8c-41b5-9e3c-eb04eea2db49 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:32.208941 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360f6d7-3e1a-4a7f-b6d5-a21669588a0c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:32.211849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d6893-7124-491a-aa74-2a9e4adde837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:32.212732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d6893-7124-491a-aa74-2a9e4adde837 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:32.213218 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d6893-7124-491a-aa74-2a9e4adde837 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:32.213695 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d6893-7124-491a-aa74-2a9e4adde837 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:32.245818 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755600e-8b7b-406c-8c3e-7bb95de8f886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:32.246485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755600e-8b7b-406c-8c3e-7bb95de8f886 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:32.246771 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755600e-8b7b-406c-8c3e-7bb95de8f886 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:32.247037 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755600e-8b7b-406c-8c3e-7bb95de8f886 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:32.247853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755600e-8b7b-406c-8c3e-7bb95de8f886 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:32.248157 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755600e-8b7b-406c-8c3e-7bb95de8f886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:32.249505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755600e-8b7b-406c-8c3e-7bb95de8f886 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:32.263807 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 353/729] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:50:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:32.265282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755600e-8b7b-406c-8c3e-7bb95de8f886 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:32.294197 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d6893-7124-491a-aa74-2a9e4adde837 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:32.295849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d6893-7124-491a-aa74-2a9e4adde837 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:32.383918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755600e-8b7b-406c-8c3e-7bb95de8f886 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:32.424784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ccba9-58ff-4287-8f6b-e1829a504678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:32.426397 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ccba9-58ff-4287-8f6b-e1829a504678 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:32.427007 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ccba9-58ff-4287-8f6b-e1829a504678 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:32.427534 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ccba9-58ff-4287-8f6b-e1829a504678 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:32.428592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ccba9-58ff-4287-8f6b-e1829a504678 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:32.429332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ccba9-58ff-4287-8f6b-e1829a504678 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:32.430055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 377/730] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:50:32.431132 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d6893-7124-491a-aa74-2a9e4adde837 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:32.431923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ccba9-58ff-4287-8f6b-e1829a504678 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:32.449669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 354/731] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:32.450887 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ccba9-58ff-4287-8f6b-e1829a504678 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:32.536302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d6893-7124-491a-aa74-2a9e4adde837 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:32.570015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ccba9-58ff-4287-8f6b-e1829a504678 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:32.575706 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee839b3-220e-4286-992f-b60fcaad2864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:32.576489 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee839b3-220e-4286-992f-b60fcaad2864 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:32.576765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee839b3-220e-4286-992f-b60fcaad2864 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:32.577033 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee839b3-220e-4286-992f-b60fcaad2864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:32.587573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee839b3-220e-4286-992f-b60fcaad2864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:32.589010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee839b3-220e-4286-992f-b60fcaad2864 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:32.606072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-1ee839b3-220e-4286-992f-b60fcaad2864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:32.606072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:32.606072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:32.606072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:32.606072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:32.606072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:32.606072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:32.606072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:32.606072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:32.606072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:32.606072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:32.606072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:32.606072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:32.606072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:32.606072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:32.607190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:32.608087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:32.608087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:32.608087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:32.608087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:32.608087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 378/732] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:32.608087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee839b3-220e-4286-992f-b60fcaad2864 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:32.612524 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3263d7-0726-45b3-87e5-d6b9d0314d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:32.613491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3263d7-0726-45b3-87e5-d6b9d0314d59 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:32.613778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3263d7-0726-45b3-87e5-d6b9d0314d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:32.614265 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3263d7-0726-45b3-87e5-d6b9d0314d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:32.624970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3263d7-0726-45b3-87e5-d6b9d0314d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:32.626400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3263d7-0726-45b3-87e5-d6b9d0314d59 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:32.644624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8d3263d7-0726-45b3-87e5-d6b9d0314d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:32.644624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:32.644624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:32.644624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:32.644624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:32.644624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:32.644624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:32.644624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:32.644624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:32.644624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:32.644624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:32.644624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:32.644624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:32.644624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:32.644624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:32.645493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:32.646367 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:32.646367 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:32.646367 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:32.646367 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:32.654043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 355/733] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:32.654043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cb893-356a-4b7e-b806-ba4efd4b2688 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:32.654043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cb893-356a-4b7e-b806-ba4efd4b2688 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:32.654043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cb893-356a-4b7e-b806-ba4efd4b2688 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:32.655676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 356/734] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:32.656023 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cb893-356a-4b7e-b806-ba4efd4b2688 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:32.719943 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee839b3-220e-4286-992f-b60fcaad2864 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:32.752345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63d92a-0921-4ee1-8f22-4ffde8d29377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:32.753000 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63d92a-0921-4ee1-8f22-4ffde8d29377 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:32.753281 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63d92a-0921-4ee1-8f22-4ffde8d29377 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:32.753555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63d92a-0921-4ee1-8f22-4ffde8d29377 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:32.754378 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63d92a-0921-4ee1-8f22-4ffde8d29377 None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=8d06113649924eae83d04bc22337bd6d) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:32.754685 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63d92a-0921-4ee1-8f22-4ffde8d29377 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:32.756138 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63d92a-0921-4ee1-8f22-4ffde8d29377 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:32.761637 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cb893-356a-4b7e-b806-ba4efd4b2688 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:32.768920 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 379/735] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:32 2022] GET /identity/v3/role_assignments?user.id=8d06113649924eae83d04bc22337bd6d&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:32.768920 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63d92a-0921-4ee1-8f22-4ffde8d29377 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:32.811597 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c7f1d-f119-4ff3-9d72-51c3476692bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:32.812308 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c7f1d-f119-4ff3-9d72-51c3476692bd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:32.812592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c7f1d-f119-4ff3-9d72-51c3476692bd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:32.812869 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c7f1d-f119-4ff3-9d72-51c3476692bd None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:32.813615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c7f1d-f119-4ff3-9d72-51c3476692bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:32.813923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c7f1d-f119-4ff3-9d72-51c3476692bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:32.816521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c7f1d-f119-4ff3-9d72-51c3476692bd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:32.835277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 357/736] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:32.837803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5287f-63fd-416b-ab57-7718d524078d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:32.838536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5287f-63fd-416b-ab57-7718d524078d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:32.840470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5287f-63fd-416b-ab57-7718d524078d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:32.864524 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f1d5287f-63fd-416b-ab57-7718d524078d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:32.867365 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f1d5287f-63fd-416b-ab57-7718d524078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:32.919305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63d92a-0921-4ee1-8f22-4ffde8d29377 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:32.965903 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 358/737] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:32.966103 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5287f-63fd-416b-ab57-7718d524078d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:32.971894 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49b60f-18e9-4ae0-aaac-54db65a8394c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:32.972689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49b60f-18e9-4ae0-aaac-54db65a8394c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:32.973076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49b60f-18e9-4ae0-aaac-54db65a8394c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:32.973454 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49b60f-18e9-4ae0-aaac-54db65a8394c None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:32.974722 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49b60f-18e9-4ae0-aaac-54db65a8394c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:32.975140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49b60f-18e9-4ae0-aaac-54db65a8394c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:32.977057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49b60f-18e9-4ae0-aaac-54db65a8394c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:32.995580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 380/738] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:33.001193 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49b60f-18e9-4ae0-aaac-54db65a8394c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:33.078793 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5287f-63fd-416b-ab57-7718d524078d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:33.109644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49b60f-18e9-4ae0-aaac-54db65a8394c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:33.113249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecbfc2-71d8-4151-b477-ff69e16c405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:33.114044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecbfc2-71d8-4151-b477-ff69e16c405a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:33.114331 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecbfc2-71d8-4151-b477-ff69e16c405a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:33.114607 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecbfc2-71d8-4151-b477-ff69e16c405a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:33.122625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fecbfc2-71d8-4151-b477-ff69e16c405a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:33.124122 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fecbfc2-71d8-4151-b477-ff69e16c405a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-7fecbfc2-71d8-4151-b477-ff69e16c405a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:33.138339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:33.139330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:33.140250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:33.140250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:33.140250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:33.140250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:33.140250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:33.140250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:33.140250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:33.140250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:33.140250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 21:50:33.140250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:33.140250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 359/739] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:50:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:33.140853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecbfc2-71d8-4151-b477-ff69e16c405a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:33.147808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c346f38-3ac6-4e64-b480-beb2686ff5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:33.149179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c346f38-3ac6-4e64-b480-beb2686ff5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:33.149694 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c346f38-3ac6-4e64-b480-beb2686ff5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:33.149967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c346f38-3ac6-4e64-b480-beb2686ff5d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:33.156765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c346f38-3ac6-4e64-b480-beb2686ff5d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:33.158195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c346f38-3ac6-4e64-b480-beb2686ff5d8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:33.171746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-7c346f38-3ac6-4e64-b480-beb2686ff5d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:33.171746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:33.171746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:33.171746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:33.171746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:33.171746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:33.171746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:33.171746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:33.171746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:33.171746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:33.171746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:33.171746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:33.171746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:33.171746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:33.171746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:33.172626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:33.173516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:33.173516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:33.173516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:33.173516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:33.173516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:33.173516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:33.173516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:33.173516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:33.173516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 381/740] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:33.174312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfd25c-73c3-4523-91fb-44a0ef78c965 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:33.174482 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfd25c-73c3-4523-91fb-44a0ef78c965 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:33.174772 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfd25c-73c3-4523-91fb-44a0ef78c965 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:33.179150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 382/741] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:33.179150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfd25c-73c3-4523-91fb-44a0ef78c965 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:33.244536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecbfc2-71d8-4151-b477-ff69e16c405a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:33.279475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfd25c-73c3-4523-91fb-44a0ef78c965 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:33.282473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a43c5-20f0-417d-b26a-ff03aa99b151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:33.283342 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a43c5-20f0-417d-b26a-ff03aa99b151 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:33.283794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a43c5-20f0-417d-b26a-ff03aa99b151 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:33.284210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a43c5-20f0-417d-b26a-ff03aa99b151 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:33.285093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a43c5-20f0-417d-b26a-ff03aa99b151 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:33.286649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a43c5-20f0-417d-b26a-ff03aa99b151 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:33.314958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4a501-7b94-4f9b-8577-2d74bc0fc894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:33.317194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4a501-7b94-4f9b-8577-2d74bc0fc894 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:33.317194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4a501-7b94-4f9b-8577-2d74bc0fc894 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:33.317194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4a501-7b94-4f9b-8577-2d74bc0fc894 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:33.317194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4a501-7b94-4f9b-8577-2d74bc0fc894 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:33.317530 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4a501-7b94-4f9b-8577-2d74bc0fc894 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:33.318720 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4a501-7b94-4f9b-8577-2d74bc0fc894 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:33.335916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 383/742] 10.222.0.24 () {56 vars in 1135 bytes} [Tue May 17 21:50:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:33.340313 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4a501-7b94-4f9b-8577-2d74bc0fc894 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:33.379884 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 360/743] 10.222.0.24 () {60 vars in 1141 bytes} [Tue May 17 21:50:33 2022] POST /identity/v3/services => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:50:33.381243 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60abd4-eac9-403e-89c7-cfc46d07289e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:33.381642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60abd4-eac9-403e-89c7-cfc46d07289e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:33.381918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60abd4-eac9-403e-89c7-cfc46d07289e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:33.399009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9b60abd4-eac9-403e-89c7-cfc46d07289e None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:33.400220 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9b60abd4-eac9-403e-89c7-cfc46d07289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:33.453641 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4a501-7b94-4f9b-8577-2d74bc0fc894 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:33.498119 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e35450-f4c9-4b32-ace3-5d1c5a0d81de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:33.498820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e35450-f4c9-4b32-ace3-5d1c5a0d81de None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:33.499099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e35450-f4c9-4b32-ace3-5d1c5a0d81de None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:33.499396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e35450-f4c9-4b32-ace3-5d1c5a0d81de None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:33.500181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e35450-f4c9-4b32-ace3-5d1c5a0d81de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:33.500480 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e35450-f4c9-4b32-ace3-5d1c5a0d81de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:33.501998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e35450-f4c9-4b32-ace3-5d1c5a0d81de None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:33.514548 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 361/744] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 21:50:33.514548 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60abd4-eac9-403e-89c7-cfc46d07289e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:33.529276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 384/745] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:33.540700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e35450-f4c9-4b32-ace3-5d1c5a0d81de None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:33.640127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60abd4-eac9-403e-89c7-cfc46d07289e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:33.683240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d9851-f2d8-4a48-9ec3-485632c70320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:33.683788 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e35450-f4c9-4b32-ace3-5d1c5a0d81de None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:33.683926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d9851-f2d8-4a48-9ec3-485632c70320 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:33.684168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d9851-f2d8-4a48-9ec3-485632c70320 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:33.684442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d9851-f2d8-4a48-9ec3-485632c70320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:33.724431 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c2b30-750e-4e9d-8a05-acbd92c3f4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:33.725008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c2b30-750e-4e9d-8a05-acbd92c3f4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:33.725291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c2b30-750e-4e9d-8a05-acbd92c3f4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:33.725570 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c2b30-750e-4e9d-8a05-acbd92c3f4a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:33.726612 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c2b30-750e-4e9d-8a05-acbd92c3f4a6 None admin] RBAC: Adding query filter params (role.id=17cc20a61bbf4f5ea7ae111203cfda47, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=f6f7d26d4d434ad5a3abc45f8f05e4e9) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:33.726763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c2b30-750e-4e9d-8a05-acbd92c3f4a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:33.728368 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c2b30-750e-4e9d-8a05-acbd92c3f4a6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:33.734288 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 385/746] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:33 2022] GET /identity/v3/role_assignments?user.id=f6f7d26d4d434ad5a3abc45f8f05e4e9&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=17cc20a61bbf4f5ea7ae111203cfda47 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:33.735150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c2b30-750e-4e9d-8a05-acbd92c3f4a6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:33.762963 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d9851-f2d8-4a48-9ec3-485632c70320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:33.764809 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d9851-f2d8-4a48-9ec3-485632c70320 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:33.842059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c2b30-750e-4e9d-8a05-acbd92c3f4a6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:33.879443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4e278-76f4-44f0-a888-cf146c61da61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:33.880127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4e278-76f4-44f0-a888-cf146c61da61 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:33.880414 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4e278-76f4-44f0-a888-cf146c61da61 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:33.880689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4e278-76f4-44f0-a888-cf146c61da61 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:33.881426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4e278-76f4-44f0-a888-cf146c61da61 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:33.882870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4e278-76f4-44f0-a888-cf146c61da61 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:33.890453 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 362/747] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:33 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 21:50:33.897665 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d9851-f2d8-4a48-9ec3-485632c70320 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:33.975210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 386/748] 10.222.0.24 () {60 vars in 1141 bytes} [Tue May 17 21:50:33 2022] POST /identity/v3/services => generated 240 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:50:34.040320 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d9851-f2d8-4a48-9ec3-485632c70320 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:34.101788 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d59f7-5857-4fbf-b68a-8c584b148110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:34.102711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d59f7-5857-4fbf-b68a-8c584b148110 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:34.102997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d59f7-5857-4fbf-b68a-8c584b148110 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:34.103299 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d59f7-5857-4fbf-b68a-8c584b148110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:34.120377 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d59f7-5857-4fbf-b68a-8c584b148110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:34.121855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d59f7-5857-4fbf-b68a-8c584b148110 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:34.140858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e03d59f7-5857-4fbf-b68a-8c584b148110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:34.140858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:34.140858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:34.140858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:34.140858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:34.140858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:34.140858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:34.140858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:34.140858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:34.140858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:34.140858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:34.140858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:34.140858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:34.140858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:34.140858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:34.141836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:34.142720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:34.142720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:34.142720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:34.142720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:34.142720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 363/749] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:34.147732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4e278-76f4-44f0-a888-cf146c61da61 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:34.285510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4e278-76f4-44f0-a888-cf146c61da61 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:34.322263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6f36a-5a8e-4a2a-bb87-4dae9e44d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:34.322931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6f36a-5a8e-4a2a-bb87-4dae9e44d7dc None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:34.323249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6f36a-5a8e-4a2a-bb87-4dae9e44d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:34.323533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6f36a-5a8e-4a2a-bb87-4dae9e44d7dc None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:34.324253 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6f36a-5a8e-4a2a-bb87-4dae9e44d7dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:34.324558 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6f36a-5a8e-4a2a-bb87-4dae9e44d7dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:34.325926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6f36a-5a8e-4a2a-bb87-4dae9e44d7dc None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:34.338603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 387/750] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:34.343651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d59f7-5857-4fbf-b68a-8c584b148110 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:34.448467 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d59f7-5857-4fbf-b68a-8c584b148110 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:34.483643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72262eb6-8dc3-4215-9b8e-c99dad4c3bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:34.484444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72262eb6-8dc3-4215-9b8e-c99dad4c3bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:34.484729 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72262eb6-8dc3-4215-9b8e-c99dad4c3bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:34.485008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72262eb6-8dc3-4215-9b8e-c99dad4c3bb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:34.493002 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72262eb6-8dc3-4215-9b8e-c99dad4c3bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:34.494466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72262eb6-8dc3-4215-9b8e-c99dad4c3bb4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:34.510419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-72262eb6-8dc3-4215-9b8e-c99dad4c3bb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:34.510419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:34.510419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:34.510419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:34.510419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:34.510419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:34.510419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:34.510419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:34.510419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:34.510419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:34.510419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:34.510419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:34.510419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:34.510419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:34.510419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:34.512538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:34.514582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:34.514582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:34.514582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:34.514582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:34.514582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:34.514582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:34.514582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:34.514582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:34.514582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 364/751] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:34.517702 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6f36a-5a8e-4a2a-bb87-4dae9e44d7dc None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:34.641829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6f36a-5a8e-4a2a-bb87-4dae9e44d7dc None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:34.677234 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0189052-aef4-4a84-80f8-cd369da65106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:34.677895 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0189052-aef4-4a84-80f8-cd369da65106 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:34.678177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0189052-aef4-4a84-80f8-cd369da65106 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:34.678450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0189052-aef4-4a84-80f8-cd369da65106 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:34.679273 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0189052-aef4-4a84-80f8-cd369da65106 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:34.679581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0189052-aef4-4a84-80f8-cd369da65106 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:34.681725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0189052-aef4-4a84-80f8-cd369da65106 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:34.694007 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 388/752] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:34.700368 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72262eb6-8dc3-4215-9b8e-c99dad4c3bb4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:34.809841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72262eb6-8dc3-4215-9b8e-c99dad4c3bb4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:34.850417 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43fa8f-3a53-4d51-bb48-4458a37fdb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:34.851092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43fa8f-3a53-4d51-bb48-4458a37fdb85 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:34.851400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43fa8f-3a53-4d51-bb48-4458a37fdb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:34.852213 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43fa8f-3a53-4d51-bb48-4458a37fdb85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:34.853065 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43fa8f-3a53-4d51-bb48-4458a37fdb85 None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=957c3decfb19445d80836f767fa23bd7) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:34.853380 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43fa8f-3a53-4d51-bb48-4458a37fdb85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:34.854833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43fa8f-3a53-4d51-bb48-4458a37fdb85 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:34.863340 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 365/753] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:34 2022] GET /identity/v3/role_assignments?user.id=957c3decfb19445d80836f767fa23bd7&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:35.353028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46173bd9-54dc-4e9d-8c18-abf5c6928e8f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:35.354043 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46173bd9-54dc-4e9d-8c18-abf5c6928e8f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:35.354537 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46173bd9-54dc-4e9d-8c18-abf5c6928e8f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:35.356388 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 389/754] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:35.362088 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c81da-cf9b-4da2-8089-2fc3eecb49f3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:35.362608 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c81da-cf9b-4da2-8089-2fc3eecb49f3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:35.363082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c81da-cf9b-4da2-8089-2fc3eecb49f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:35.380813 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-967c81da-cf9b-4da2-8089-2fc3eecb49f3 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:35.382325 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-967c81da-cf9b-4da2-8089-2fc3eecb49f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:35.451002 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 366/755] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:35.473557 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46173bd9-54dc-4e9d-8c18-abf5c6928e8f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:35.611867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46173bd9-54dc-4e9d-8c18-abf5c6928e8f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:35.660383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f2d05-f1f3-429e-84a7-59adaecf93d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:35.661188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2d05-f1f3-429e-84a7-59adaecf93d4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:35.661477 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2d05-f1f3-429e-84a7-59adaecf93d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:35.661755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2d05-f1f3-429e-84a7-59adaecf93d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:35.678751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f2d05-f1f3-429e-84a7-59adaecf93d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-315f2d05-f1f3-429e-84a7-59adaecf93d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:35.687068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:35.688110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:35.688924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:35.688924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:35.688924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:35.688924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:35.688924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:35.688924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:35.688924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:35.688924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:35.688924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:35.688924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:35.688924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:50:35.688924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:35.688924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 390/756] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:50:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:35.694867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c81da-cf9b-4da2-8089-2fc3eecb49f3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:35.822305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c81da-cf9b-4da2-8089-2fc3eecb49f3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:35.857642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9ad44-4c72-4a90-8b8e-2444643ef96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:35.858733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9ad44-4c72-4a90-8b8e-2444643ef96f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:35.859267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9ad44-4c72-4a90-8b8e-2444643ef96f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:35.859756 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9ad44-4c72-4a90-8b8e-2444643ef96f None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:35.860780 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9ad44-4c72-4a90-8b8e-2444643ef96f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:35.861279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9ad44-4c72-4a90-8b8e-2444643ef96f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:35.862887 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9ad44-4c72-4a90-8b8e-2444643ef96f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:35.872735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 367/757] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:50:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:35.880551 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f2d05-f1f3-429e-84a7-59adaecf93d4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:36.043573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f2d05-f1f3-429e-84a7-59adaecf93d4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:36.088442 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562dafd-6f90-438d-add8-2e8050ecef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:36.089240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562dafd-6f90-438d-add8-2e8050ecef64 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:36.089518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562dafd-6f90-438d-add8-2e8050ecef64 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:36.089789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562dafd-6f90-438d-add8-2e8050ecef64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:36.105264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562dafd-6f90-438d-add8-2e8050ecef64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:36.106720 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562dafd-6f90-438d-add8-2e8050ecef64 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:36.127382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-7562dafd-6f90-438d-add8-2e8050ecef64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:36.127382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:36.127382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:36.127382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:36.127382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:36.127382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:36.127382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:36.127382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:36.127382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:36.127382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:36.127382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:36.127382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:36.127382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:36.127382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:36.127382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:36.128247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:36.129115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:36.129115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:36.129115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:36.129115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:36.129115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 391/758] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:36.134808 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9ad44-4c72-4a90-8b8e-2444643ef96f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:36.181088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754f445-e62d-42a4-99ef-066c0529a821 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:36.181413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754f445-e62d-42a4-99ef-066c0529a821 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:36.181638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754f445-e62d-42a4-99ef-066c0529a821 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:36.183335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 392/759] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:50:36.188691 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ffd0f-5bce-451a-a9e7-48eb91783d65 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:36.188982 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ffd0f-5bce-451a-a9e7-48eb91783d65 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:36.189257 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ffd0f-5bce-451a-a9e7-48eb91783d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:36.216832 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e29ffd0f-5bce-451a-a9e7-48eb91783d65 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:36.218020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e29ffd0f-5bce-451a-a9e7-48eb91783d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:36.256225 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9ad44-4c72-4a90-8b8e-2444643ef96f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:36.299175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2d135-4139-47e5-85f3-538c8ec1034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:36.299175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2d135-4139-47e5-85f3-538c8ec1034a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:36.299175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2d135-4139-47e5-85f3-538c8ec1034a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:36.299175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2d135-4139-47e5-85f3-538c8ec1034a None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:36.299557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2d135-4139-47e5-85f3-538c8ec1034a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:36.299557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2d135-4139-47e5-85f3-538c8ec1034a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:36.299557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2d135-4139-47e5-85f3-538c8ec1034a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:36.319674 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 368/760] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:36.328131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2d135-4139-47e5-85f3-538c8ec1034a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:36.349834 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 393/761] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:36.420144 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ffd0f-5bce-451a-a9e7-48eb91783d65 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:36.454587 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2d135-4139-47e5-85f3-538c8ec1034a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:36.490821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c669e-4aca-43e7-80e7-0900be2f2232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:36.491664 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c669e-4aca-43e7-80e7-0900be2f2232 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:36.491947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c669e-4aca-43e7-80e7-0900be2f2232 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:36.492224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c669e-4aca-43e7-80e7-0900be2f2232 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:36.505854 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c669e-4aca-43e7-80e7-0900be2f2232 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:36.507326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c669e-4aca-43e7-80e7-0900be2f2232 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-727c669e-4aca-43e7-80e7-0900be2f2232 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:36.522626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:36.524288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:36.525300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:36.525300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:36.525300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:36.525300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:36.525300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:36.525300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:36.525300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:36.525300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:36.525300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 21:50:36.525300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:36.525300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 369/762] 10.222.0.24 () {56 vars in 1093 bytes} [Tue May 17 21:50:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:36.527024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaaee3-e883-4ab0-8311-337717c9e1e8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:36.527024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaaee3-e883-4ab0-8311-337717c9e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:36.527024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaaee3-e883-4ab0-8311-337717c9e1e8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:36.530125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 370/763] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:36.530125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaaee3-e883-4ab0-8311-337717c9e1e8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:36.570107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ffd0f-5bce-451a-a9e7-48eb91783d65 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:36.611072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e6dd8-d40a-455f-a409-01e656f23097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:36.612722 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e6dd8-d40a-455f-a409-01e656f23097 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:36.613001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e6dd8-d40a-455f-a409-01e656f23097 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:36.613277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e6dd8-d40a-455f-a409-01e656f23097 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:36.613940 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e6dd8-d40a-455f-a409-01e656f23097 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:36.615333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e6dd8-d40a-455f-a409-01e656f23097 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-2c5e6dd8-d40a-455f-a409-01e656f23097 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:36.631348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:36.634185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:36.636194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 394/764] 10.222.0.24 () {56 vars in 1129 bytes} [Tue May 17 21:50:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:36.638048 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26256dac-b6c6-4886-8613-24db83444a78 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:36.638048 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26256dac-b6c6-4886-8613-24db83444a78 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:36.638048 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26256dac-b6c6-4886-8613-24db83444a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:36.656395 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaaee3-e883-4ab0-8311-337717c9e1e8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:36.658399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-26256dac-b6c6-4886-8613-24db83444a78 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:36.659598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-26256dac-b6c6-4886-8613-24db83444a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:36.700982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639ab10-e54c-4b93-b824-cc059d92ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:36.701680 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639ab10-e54c-4b93-b824-cc059d92ec09 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:36.702025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639ab10-e54c-4b93-b824-cc059d92ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:36.702366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639ab10-e54c-4b93-b824-cc059d92ec09 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:36.703310 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639ab10-e54c-4b93-b824-cc059d92ec09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:36.704057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639ab10-e54c-4b93-b824-cc059d92ec09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:36.705849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639ab10-e54c-4b93-b824-cc059d92ec09 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:36.729164 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 371/765] 10.222.0.24 () {56 vars in 1133 bytes} [Tue May 17 21:50:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:36.730087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639ab10-e54c-4b93-b824-cc059d92ec09 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:36.739971 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 395/766] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:36.740825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26256dac-b6c6-4886-8613-24db83444a78 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:36.850798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26256dac-b6c6-4886-8613-24db83444a78 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:36.855421 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639ab10-e54c-4b93-b824-cc059d92ec09 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:36.892781 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841b5cc-dea1-4e62-a267-167ceb85d5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:36.892781 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841b5cc-dea1-4e62-a267-167ceb85d5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:36.892781 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841b5cc-dea1-4e62-a267-167ceb85d5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:36.892781 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841b5cc-dea1-4e62-a267-167ceb85d5b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:36.894205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0192a-6835-47f8-9244-c6aeb9b39e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:36.903137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0192a-6835-47f8-9244-c6aeb9b39e2d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:36.903137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0192a-6835-47f8-9244-c6aeb9b39e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:36.903137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0192a-6835-47f8-9244-c6aeb9b39e2d None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:36.903137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0192a-6835-47f8-9244-c6aeb9b39e2d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:36.903137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0192a-6835-47f8-9244-c6aeb9b39e2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:36.903137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0192a-6835-47f8-9244-c6aeb9b39e2d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:36.903793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841b5cc-dea1-4e62-a267-167ceb85d5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:36.903793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841b5cc-dea1-4e62-a267-167ceb85d5b5 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:36.908125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 372/767] 10.222.0.24 () {56 vars in 1124 bytes} [Tue May 17 21:50:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:36.909067 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0192a-6835-47f8-9244-c6aeb9b39e2d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:36.928066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-6841b5cc-dea1-4e62-a267-167ceb85d5b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:36.928066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:36.928066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:36.928066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:36.928066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:36.928066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:36.928066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:36.928066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:36.928066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:36.928066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:36.928066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:36.928066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:36.928066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:36.928066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:36.928066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:36.929186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:36.931829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:36.931829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:36.931829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:36.931829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:36.941015 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 396/768] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:36.941015 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841b5cc-dea1-4e62-a267-167ceb85d5b5 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:37.019232 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0192a-6835-47f8-9244-c6aeb9b39e2d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:37.053948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9261081-d382-4287-8b35-52732544cf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:37.054819 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9261081-d382-4287-8b35-52732544cf61 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:37.055755 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9261081-d382-4287-8b35-52732544cf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:37.056037 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9261081-d382-4287-8b35-52732544cf61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:37.063918 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841b5cc-dea1-4e62-a267-167ceb85d5b5 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:37.066154 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9261081-d382-4287-8b35-52732544cf61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b9261081-d382-4287-8b35-52732544cf61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:37.076161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:37.078356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:37.080370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:37.080370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:37.080370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:37.080370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:37.080370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:37.080370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:37.080370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:37.080370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:37.080370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:37.080370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:37.080370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:37.080370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:37.087140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 373/769] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:37.087140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9261081-d382-4287-8b35-52732544cf61 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:37.105961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a912d81-56d8-4e85-bdce-632602e3c51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:37.106623 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a912d81-56d8-4e85-bdce-632602e3c51a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:37.106913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a912d81-56d8-4e85-bdce-632602e3c51a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:37.107208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a912d81-56d8-4e85-bdce-632602e3c51a None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:37.107923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a912d81-56d8-4e85-bdce-632602e3c51a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:37.108227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a912d81-56d8-4e85-bdce-632602e3c51a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:37.109596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a912d81-56d8-4e85-bdce-632602e3c51a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:37.114550 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 397/770] 10.222.0.24 () {56 vars in 1124 bytes} [Tue May 17 21:50:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:37.120219 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a912d81-56d8-4e85-bdce-632602e3c51a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:37.188948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9261081-d382-4287-8b35-52732544cf61 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:37.217217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a912d81-56d8-4e85-bdce-632602e3c51a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:37.221694 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c610d-1943-490d-bac3-413ea54a69f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:37.222343 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c610d-1943-490d-bac3-413ea54a69f9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:37.222621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c610d-1943-490d-bac3-413ea54a69f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:37.222888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c610d-1943-490d-bac3-413ea54a69f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:37.223629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c610d-1943-490d-bac3-413ea54a69f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:37.223931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c610d-1943-490d-bac3-413ea54a69f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:37.225273 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c610d-1943-490d-bac3-413ea54a69f9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:37.242082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 374/771] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:37.242082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71e5d7-db27-4327-94f7-c2fe78387570 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:37.242082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71e5d7-db27-4327-94f7-c2fe78387570 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:37.242082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71e5d7-db27-4327-94f7-c2fe78387570 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:37.244876 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 375/772] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:37.245508 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71e5d7-db27-4327-94f7-c2fe78387570 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:37.256263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cc230-5f71-4035-bf96-676dd204304c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:37.256939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cc230-5f71-4035-bf96-676dd204304c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:37.257225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cc230-5f71-4035-bf96-676dd204304c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:37.257499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cc230-5f71-4035-bf96-676dd204304c None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:37.258822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cc230-5f71-4035-bf96-676dd204304c None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:37.259164 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cc230-5f71-4035-bf96-676dd204304c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:37.260535 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cc230-5f71-4035-bf96-676dd204304c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:37.273049 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 398/773] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:37.273049 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cc230-5f71-4035-bf96-676dd204304c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:37.352136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71e5d7-db27-4327-94f7-c2fe78387570 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:37.371313 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cc230-5f71-4035-bf96-676dd204304c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:37.385647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee4a16-f019-4926-85b0-0c04a2df0d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:37.386495 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee4a16-f019-4926-85b0-0c04a2df0d1b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:37.386986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee4a16-f019-4926-85b0-0c04a2df0d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:37.387432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee4a16-f019-4926-85b0-0c04a2df0d1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:37.388417 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee4a16-f019-4926-85b0-0c04a2df0d1b None admin] RBAC: Adding query filter params (interface=public, service_id=ce70307a80ea4a109d77c60e127d30ee, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:37.388873 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee4a16-f019-4926-85b0-0c04a2df0d1b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:37.390378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee4a16-f019-4926-85b0-0c04a2df0d1b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:37.398335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 376/774] 10.222.0.24 () {56 vars in 1251 bytes} [Tue May 17 21:50:37 2022] GET /identity/v3/endpoints?service_id=ce70307a80ea4a109d77c60e127d30ee&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:37.400267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f229f-2a1d-4631-83ab-bd3913d408a8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:37.400552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f229f-2a1d-4631-83ab-bd3913d408a8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:37.400827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f229f-2a1d-4631-83ab-bd3913d408a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:37.408768 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0f659-f5bc-4ba6-baab-779183f99c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:37.409561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0f659-f5bc-4ba6-baab-779183f99c58 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:37.409846 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0f659-f5bc-4ba6-baab-779183f99c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:37.410119 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0f659-f5bc-4ba6-baab-779183f99c58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:37.417456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-423f229f-2a1d-4631-83ab-bd3913d408a8 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:37.417707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0f659-f5bc-4ba6-baab-779183f99c58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:37.418573 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-423f229f-2a1d-4631-83ab-bd3913d408a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:37.419137 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0f659-f5bc-4ba6-baab-779183f99c58 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:37.434432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-20f0f659-f5bc-4ba6-baab-779183f99c58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:37.434432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:37.434432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:37.434432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:37.434432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:37.434432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:37.434432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:37.434432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:37.434432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:37.434432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:37.434432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:37.434432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:37.434432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:37.434432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:37.434432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:37.436010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:37.436872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:37.436872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:37.436872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:37.436872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:37.436872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:37.436872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:37.436872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:37.436872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:37.436872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 399/775] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:37.437597 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0f659-f5bc-4ba6-baab-779183f99c58 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:37.495364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 377/776] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:37.496495 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f229f-2a1d-4631-83ab-bd3913d408a8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:37.539713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0f659-f5bc-4ba6-baab-779183f99c58 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:37.574450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a1efd-2f46-40d4-adc5-c89d453fc874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:37.575284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a1efd-2f46-40d4-adc5-c89d453fc874 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:37.575554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a1efd-2f46-40d4-adc5-c89d453fc874 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:37.575840 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a1efd-2f46-40d4-adc5-c89d453fc874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:37.586628 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a1efd-2f46-40d4-adc5-c89d453fc874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:37.588244 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a1efd-2f46-40d4-adc5-c89d453fc874 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:37.604414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f229f-2a1d-4631-83ab-bd3913d408a8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:37.606001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-9f3a1efd-2f46-40d4-adc5-c89d453fc874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:37.606001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:37.606001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:37.606001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:37.606001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:37.606001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:37.606001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:37.606001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:37.606001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:37.606001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:37.606001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:37.606001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:37.606001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:37.606001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:37.606001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:37.606880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:37.607804 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:37.607804 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:37.607804 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:37.607804 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:37.607804 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 400/777] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:37.608073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a1efd-2f46-40d4-adc5-c89d453fc874 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:37.642371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65486e-e1ac-4002-aebc-93657537320f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:37.643040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65486e-e1ac-4002-aebc-93657537320f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:37.643353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65486e-e1ac-4002-aebc-93657537320f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:37.643634 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65486e-e1ac-4002-aebc-93657537320f None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:37.644319 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65486e-e1ac-4002-aebc-93657537320f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:37.645690 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65486e-e1ac-4002-aebc-93657537320f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:37.652570 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 378/778] 10.222.0.24 () {56 vars in 1087 bytes} [Tue May 17 21:50:37 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:37.653349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65486e-e1ac-4002-aebc-93657537320f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:37.723266 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a1efd-2f46-40d4-adc5-c89d453fc874 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:37.761735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd92db9-c75f-43c2-a126-495059dad30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:37.762405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd92db9-c75f-43c2-a126-495059dad30d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:37.762682 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd92db9-c75f-43c2-a126-495059dad30d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:37.762954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd92db9-c75f-43c2-a126-495059dad30d None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:37.763853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd92db9-c75f-43c2-a126-495059dad30d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:37.764168 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd92db9-c75f-43c2-a126-495059dad30d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:37.765633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd92db9-c75f-43c2-a126-495059dad30d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:37.767162 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65486e-e1ac-4002-aebc-93657537320f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:37.782867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 401/779] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:37.782867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd92db9-c75f-43c2-a126-495059dad30d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:37.810157 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741aff4-da24-43c8-a0db-957cca3196bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:37.810880 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741aff4-da24-43c8-a0db-957cca3196bb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:37.811202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741aff4-da24-43c8-a0db-957cca3196bb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:37.811484 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741aff4-da24-43c8-a0db-957cca3196bb None admin] PATH_INFO: `/v3/services/network` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:37.812146 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741aff4-da24-43c8-a0db-957cca3196bb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:37.813700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741aff4-da24-43c8-a0db-957cca3196bb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f741aff4-da24-43c8-a0db-957cca3196bb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:37.826406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:37.827439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:37.828276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:37.828276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:37.828276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:37.828276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:37.828276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:37.828276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:37.828276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:37.828276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:37.828276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:37.828276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:37.828276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:37.828276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:37.828276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 21:50:37.828276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:37.828276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 379/780] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:37 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:37.829297 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcc38e-b2bb-4522-aa48-70dead95ee61 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:37.829632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcc38e-b2bb-4522-aa48-70dead95ee61 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:37.830321 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcc38e-b2bb-4522-aa48-70dead95ee61 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:37.832915 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 380/781] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:37.832915 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcc38e-b2bb-4522-aa48-70dead95ee61 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:37.903832 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd92db9-c75f-43c2-a126-495059dad30d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:37.938214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c70de0-0c66-491d-a785-1a928217aa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:37.938977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c70de0-0c66-491d-a785-1a928217aa3a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:37.939368 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c70de0-0c66-491d-a785-1a928217aa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:37.939647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c70de0-0c66-491d-a785-1a928217aa3a None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:37.940425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c70de0-0c66-491d-a785-1a928217aa3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:37.940735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c70de0-0c66-491d-a785-1a928217aa3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:37.942101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c70de0-0c66-491d-a785-1a928217aa3a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:37.942629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcc38e-b2bb-4522-aa48-70dead95ee61 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:37.955013 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 402/782] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:37.955848 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c70de0-0c66-491d-a785-1a928217aa3a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:37.982800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08e745-b5e7-4320-99e7-b2ae71b2af3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:37.983785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08e745-b5e7-4320-99e7-b2ae71b2af3c None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:37.984070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08e745-b5e7-4320-99e7-b2ae71b2af3c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:37.984344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08e745-b5e7-4320-99e7-b2ae71b2af3c None admin] PATH_INFO: `/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/8d06113649924eae83d04bc22337bd6d/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:37.986337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08e745-b5e7-4320-99e7-b2ae71b2af3c None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e90e91d3094e67b09b2b8137f210f4, user_id=8d06113649924eae83d04bc22337bd6d, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:37.987796 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08e745-b5e7-4320-99e7-b2ae71b2af3c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:38.053515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c70de0-0c66-491d-a785-1a928217aa3a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:38.059337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 381/783] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:50:37 2022] PUT /identity/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/8d06113649924eae83d04bc22337bd6d/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:50:38.059337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2c9fb-12ad-4477-a50f-19a6dbfad3f4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:38.059337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2c9fb-12ad-4477-a50f-19a6dbfad3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:38.059337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2c9fb-12ad-4477-a50f-19a6dbfad3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:38.076742 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4cd2c9fb-12ad-4477-a50f-19a6dbfad3f4 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:38.077997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4cd2c9fb-12ad-4477-a50f-19a6dbfad3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:38.111212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a668602-6ab5-464f-b4df-a4cc3aacfb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:38.111893 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a668602-6ab5-464f-b4df-a4cc3aacfb5f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:38.112169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a668602-6ab5-464f-b4df-a4cc3aacfb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:38.112440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a668602-6ab5-464f-b4df-a4cc3aacfb5f None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:38.113209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a668602-6ab5-464f-b4df-a4cc3aacfb5f None admin] RBAC: Adding query filter params (name=network) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:38.113448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a668602-6ab5-464f-b4df-a4cc3aacfb5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:38.114959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a668602-6ab5-464f-b4df-a4cc3aacfb5f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:38.125255 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 403/784] 10.222.0.24 () {56 vars in 1112 bytes} [Tue May 17 21:50:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:38.125255 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a668602-6ab5-464f-b4df-a4cc3aacfb5f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:38.179131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 382/785] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:38.179131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2c9fb-12ad-4477-a50f-19a6dbfad3f4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:38.259362 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a668602-6ab5-464f-b4df-a4cc3aacfb5f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:38.299936 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2c9fb-12ad-4477-a50f-19a6dbfad3f4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:38.300458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70fb89-c9f6-4fb7-b5e6-5c3a8997b244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:38.301692 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70fb89-c9f6-4fb7-b5e6-5c3a8997b244 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:38.301981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70fb89-c9f6-4fb7-b5e6-5c3a8997b244 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:38.303058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70fb89-c9f6-4fb7-b5e6-5c3a8997b244 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:38.311909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70fb89-c9f6-4fb7-b5e6-5c3a8997b244 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:38.313993 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70fb89-c9f6-4fb7-b5e6-5c3a8997b244 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-2d70fb89-c9f6-4fb7-b5e6-5c3a8997b244 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:38.334268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:38.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:38.337235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:38.337235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:38.337235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:38.337235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:38.337235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:38.337235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:38.337235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:38.337235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:38.337235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 21:50:38.337235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:38.337235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 404/786] 10.222.0.24 () {56 vars in 1117 bytes} [Tue May 17 21:50:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:38.337235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70fb89-c9f6-4fb7-b5e6-5c3a8997b244 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:38.341756 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30955435-aaf8-4cb5-aaf5-7be73ab9f393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:38.342592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30955435-aaf8-4cb5-aaf5-7be73ab9f393 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:38.343031 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30955435-aaf8-4cb5-aaf5-7be73ab9f393 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:38.343467 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30955435-aaf8-4cb5-aaf5-7be73ab9f393 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:38.345845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30955435-aaf8-4cb5-aaf5-7be73ab9f393 None admin] RBAC: Adding query filter params (type=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:38.346304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30955435-aaf8-4cb5-aaf5-7be73ab9f393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:38.347819 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30955435-aaf8-4cb5-aaf5-7be73ab9f393 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:38.354539 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 383/787] 10.222.0.24 () {56 vars in 1112 bytes} [Tue May 17 21:50:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:38.355901 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30955435-aaf8-4cb5-aaf5-7be73ab9f393 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:38.444306 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70fb89-c9f6-4fb7-b5e6-5c3a8997b244 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:38.473562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30955435-aaf8-4cb5-aaf5-7be73ab9f393 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:38.480430 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760cf94-cea0-4fb2-bbc2-d4741fd3d9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:38.481336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760cf94-cea0-4fb2-bbc2-d4741fd3d9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:38.482034 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760cf94-cea0-4fb2-bbc2-d4741fd3d9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:38.482034 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760cf94-cea0-4fb2-bbc2-d4741fd3d9f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:38.493115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760cf94-cea0-4fb2-bbc2-d4741fd3d9f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-6760cf94-cea0-4fb2-bbc2-d4741fd3d9f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:38.500973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:38.502078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:38.503002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:38.503002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:38.503002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:38.503002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:38.503002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:38.503002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:38.503002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:38.503002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:38.503002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:38.503002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:38.503002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:50:38.503002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:38.503988 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 405/788] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:50:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:38.504902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760cf94-cea0-4fb2-bbc2-d4741fd3d9f5 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:38.513606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2743380-6262-43d9-8817-66b939f12f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:38.514541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2743380-6262-43d9-8817-66b939f12f67 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:38.515055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2743380-6262-43d9-8817-66b939f12f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:38.515537 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2743380-6262-43d9-8817-66b939f12f67 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:38.516547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2743380-6262-43d9-8817-66b939f12f67 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:38.517073 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2743380-6262-43d9-8817-66b939f12f67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:38.518729 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2743380-6262-43d9-8817-66b939f12f67 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:38.537345 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 384/789] 10.222.0.24 () {56 vars in 1149 bytes} [Tue May 17 21:50:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:38.538535 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2743380-6262-43d9-8817-66b939f12f67 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:38.618961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760cf94-cea0-4fb2-bbc2-d4741fd3d9f5 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:38.643609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2743380-6262-43d9-8817-66b939f12f67 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:38.660765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02abf5c-3eb6-4e3b-9bd2-8915b2faf5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:38.661580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02abf5c-3eb6-4e3b-9bd2-8915b2faf5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:38.661865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02abf5c-3eb6-4e3b-9bd2-8915b2faf5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:38.662137 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02abf5c-3eb6-4e3b-9bd2-8915b2faf5a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:38.663248 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02abf5c-3eb6-4e3b-9bd2-8915b2faf5a3 None admin] RBAC: Adding query filter params (interface=public, service_id=f19cc0d8cc5e4f3485d47c1c2ef27b23, region_id=RegionOne) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:38.663566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02abf5c-3eb6-4e3b-9bd2-8915b2faf5a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:38.665615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02abf5c-3eb6-4e3b-9bd2-8915b2faf5a3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:38.680561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 406/790] 10.222.0.24 () {56 vars in 1251 bytes} [Tue May 17 21:50:38 2022] GET /identity/v3/endpoints?service_id=f19cc0d8cc5e4f3485d47c1c2ef27b23&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:38.680561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02abf5c-3eb6-4e3b-9bd2-8915b2faf5a3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:38.685967 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64985253-3436-4776-b0e0-ef811b6e15f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:38.686949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64985253-3436-4776-b0e0-ef811b6e15f9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:38.687499 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64985253-3436-4776-b0e0-ef811b6e15f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:38.687969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64985253-3436-4776-b0e0-ef811b6e15f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:38.688922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64985253-3436-4776-b0e0-ef811b6e15f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:38.689416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64985253-3436-4776-b0e0-ef811b6e15f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:38.691026 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64985253-3436-4776-b0e0-ef811b6e15f9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:38.699980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 385/791] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:50:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:38.701007 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64985253-3436-4776-b0e0-ef811b6e15f9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:38.796774 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02abf5c-3eb6-4e3b-9bd2-8915b2faf5a3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:38.836065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cbc87-5f11-4f5b-a7c0-5c5c7e87d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:38.837308 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cbc87-5f11-4f5b-a7c0-5c5c7e87d8aa None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:38.837597 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cbc87-5f11-4f5b-a7c0-5c5c7e87d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:38.837875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cbc87-5f11-4f5b-a7c0-5c5c7e87d8aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:38.852415 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9cbc87-5f11-4f5b-a7c0-5c5c7e87d8aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:38.854453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9cbc87-5f11-4f5b-a7c0-5c5c7e87d8aa None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:38.875020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-be9cbc87-5f11-4f5b-a7c0-5c5c7e87d8aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:38.875020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:38.875020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:38.875020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:38.875020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:38.875020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:38.875020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:38.875020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:38.875020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:38.875020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:38.875020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:38.875020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:38.875020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:38.875020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:38.875020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:38.875949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:38.876834 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:38.876834 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:38.876834 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:38.876834 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:38.876834 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 407/792] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:38.877640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cbc87-5f11-4f5b-a7c0-5c5c7e87d8aa None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:38.955705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64985253-3436-4776-b0e0-ef811b6e15f9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:38.988411 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cbc87-5f11-4f5b-a7c0-5c5c7e87d8aa None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:38.989228 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea13e7-39ba-4487-90bf-dee9edf76035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:38.989987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea13e7-39ba-4487-90bf-dee9edf76035 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:38.990361 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea13e7-39ba-4487-90bf-dee9edf76035 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:38.990731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea13e7-39ba-4487-90bf-dee9edf76035 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:38.991575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea13e7-39ba-4487-90bf-dee9edf76035 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:38.993785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea13e7-39ba-4487-90bf-dee9edf76035 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:39.003820 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 386/793] 10.222.0.24 () {56 vars in 1087 bytes} [Tue May 17 21:50:38 2022] GET /identity/v3/services => generated 772 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:39.004966 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea13e7-39ba-4487-90bf-dee9edf76035 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:39.032061 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e43bb-83a4-4a6b-a54b-fbf24d7514ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:39.032886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e43bb-83a4-4a6b-a54b-fbf24d7514ff None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:39.033167 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e43bb-83a4-4a6b-a54b-fbf24d7514ff None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:39.033444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e43bb-83a4-4a6b-a54b-fbf24d7514ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:39.061760 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e43bb-83a4-4a6b-a54b-fbf24d7514ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:39.063282 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e43bb-83a4-4a6b-a54b-fbf24d7514ff None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:39.100931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-fe6e43bb-83a4-4a6b-a54b-fbf24d7514ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:39.100931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:39.100931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:39.100931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:39.100931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:39.100931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:39.100931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:39.100931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:39.100931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:39.100931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:39.100931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:39.100931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:39.100931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:39.100931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:39.100931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:39.103087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:39.104945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:39.104945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:39.104945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:39.104945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:39.104945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 408/794] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:39.112080 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e43bb-83a4-4a6b-a54b-fbf24d7514ff None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:39.223918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea13e7-39ba-4487-90bf-dee9edf76035 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:39.237945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e43bb-83a4-4a6b-a54b-fbf24d7514ff None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:39.258692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee282a0-3be5-4d0e-9a16-b5f25bb8ee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:39.259586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee282a0-3be5-4d0e-9a16-b5f25bb8ee03 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:39.259924 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee282a0-3be5-4d0e-9a16-b5f25bb8ee03 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:39.260268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee282a0-3be5-4d0e-9a16-b5f25bb8ee03 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:39.261066 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee282a0-3be5-4d0e-9a16-b5f25bb8ee03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:39.261381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee282a0-3be5-4d0e-9a16-b5f25bb8ee03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:39.262741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee282a0-3be5-4d0e-9a16-b5f25bb8ee03 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:39.276349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 387/795] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:39.284031 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954403d-f90a-401f-b132-abde3871bb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:39.284440 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee282a0-3be5-4d0e-9a16-b5f25bb8ee03 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:39.285280 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954403d-f90a-401f-b132-abde3871bb75 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:39.285788 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954403d-f90a-401f-b132-abde3871bb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:39.286267 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954403d-f90a-401f-b132-abde3871bb75 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:39.287222 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954403d-f90a-401f-b132-abde3871bb75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:39.287722 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954403d-f90a-401f-b132-abde3871bb75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:39.289845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954403d-f90a-401f-b132-abde3871bb75 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:39.303045 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 409/796] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:39.308721 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954403d-f90a-401f-b132-abde3871bb75 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:39.412580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee282a0-3be5-4d0e-9a16-b5f25bb8ee03 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:39.455877 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1ddb5-2f4b-412c-b656-b5dc92f3b5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:39.456691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1ddb5-2f4b-412c-b656-b5dc92f3b5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:39.456979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1ddb5-2f4b-412c-b656-b5dc92f3b5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:39.457251 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1ddb5-2f4b-412c-b656-b5dc92f3b5d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:39.460588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954403d-f90a-401f-b132-abde3871bb75 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:39.472281 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1ddb5-2f4b-412c-b656-b5dc92f3b5d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:39.473745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1ddb5-2f4b-412c-b656-b5dc92f3b5d1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:39.496052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-44c1ddb5-2f4b-412c-b656-b5dc92f3b5d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:39.496052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:39.496052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:39.496052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:39.496052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:39.496052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:39.496052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:39.496052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:39.496052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:39.496052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:39.496052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:39.496052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:39.496052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:39.496052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:39.496052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:39.497032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:39.497916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:39.497916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:39.497916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:39.497916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:39.497916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:39.497916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:39.497916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:39.497916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:39.498341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 388/797] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:39.504391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1ddb5-2f4b-412c-b656-b5dc92f3b5d1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:39.510252 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59193981-988d-4c7e-86d6-cb84153cd535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:39.511534 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59193981-988d-4c7e-86d6-cb84153cd535 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:39.511971 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59193981-988d-4c7e-86d6-cb84153cd535 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:39.512397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59193981-988d-4c7e-86d6-cb84153cd535 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:39.530279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59193981-988d-4c7e-86d6-cb84153cd535 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:39.531757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59193981-988d-4c7e-86d6-cb84153cd535 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-59193981-988d-4c7e-86d6-cb84153cd535 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:39.546794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:39.549714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:39.552287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:39.552287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:39.552287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:39.552287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:39.552287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:39.552287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:39.552287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:39.552287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:39.552287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 21:50:39.552287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:39.553842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 410/798] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:50:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:39.558226 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59193981-988d-4c7e-86d6-cb84153cd535 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:39.656076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59193981-988d-4c7e-86d6-cb84153cd535 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:39.696905 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e5fe7-c78d-4d69-8a6f-687aaf68c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:39.697670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e5fe7-c78d-4d69-8a6f-687aaf68c568 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:39.698156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e5fe7-c78d-4d69-8a6f-687aaf68c568 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:39.698649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e5fe7-c78d-4d69-8a6f-687aaf68c568 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:39.700035 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e5fe7-c78d-4d69-8a6f-687aaf68c568 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:39.700582 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e5fe7-c78d-4d69-8a6f-687aaf68c568 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:39.702727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e5fe7-c78d-4d69-8a6f-687aaf68c568 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:39.726631 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 411/799] 10.222.0.24 () {56 vars in 1135 bytes} [Tue May 17 21:50:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:39.727899 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e5fe7-c78d-4d69-8a6f-687aaf68c568 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:39.792759 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1ddb5-2f4b-412c-b656-b5dc92f3b5d1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:39.833778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e5fe7-c78d-4d69-8a6f-687aaf68c568 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:39.870946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e83029-e777-4776-8bbe-be95086e9c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:39.871778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e83029-e777-4776-8bbe-be95086e9c09 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:39.872060 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e83029-e777-4776-8bbe-be95086e9c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:39.872337 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e83029-e777-4776-8bbe-be95086e9c09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:39.884185 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9d4d2-fbdc-4912-bc35-cf2570d7552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:39.884861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9d4d2-fbdc-4912-bc35-cf2570d7552f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:39.887895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9d4d2-fbdc-4912-bc35-cf2570d7552f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:39.887895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9d4d2-fbdc-4912-bc35-cf2570d7552f None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:39.887895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9d4d2-fbdc-4912-bc35-cf2570d7552f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:39.887895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9d4d2-fbdc-4912-bc35-cf2570d7552f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:39.888161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e83029-e777-4776-8bbe-be95086e9c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:39.888254 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9d4d2-fbdc-4912-bc35-cf2570d7552f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:39.888723 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e83029-e777-4776-8bbe-be95086e9c09 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:39.908506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-26e83029-e777-4776-8bbe-be95086e9c09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:39.908506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:39.908506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:39.908506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:39.908506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:39.908506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:39.908506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:39.908506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:39.908506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:39.908506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:39.908506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:39.908506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:39.908506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:39.908506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:39.908506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:39.909610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:39.910515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:39.910515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:39.910515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:39.910515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:39.915227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 412/800] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:39.916512 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e83029-e777-4776-8bbe-be95086e9c09 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:39.921422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 389/801] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:39.932075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9d4d2-fbdc-4912-bc35-cf2570d7552f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:40.026400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e83029-e777-4776-8bbe-be95086e9c09 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:40.070844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5beba9-be63-4e42-9e94-39119481fb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:40.071474 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5beba9-be63-4e42-9e94-39119481fb75 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:40.071755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5beba9-be63-4e42-9e94-39119481fb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:40.072040 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5beba9-be63-4e42-9e94-39119481fb75 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:40.072756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5beba9-be63-4e42-9e94-39119481fb75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:40.073058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5beba9-be63-4e42-9e94-39119481fb75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:40.074431 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5beba9-be63-4e42-9e94-39119481fb75 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:40.091197 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 413/802] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:40.092862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9a69-63bd-42eb-9855-a519cf8ff2a7 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:40.093371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9a69-63bd-42eb-9855-a519cf8ff2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:40.093848 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9a69-63bd-42eb-9855-a519cf8ff2a7 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:40.099188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 414/803] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:40.100167 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb9a69-63bd-42eb-9855-a519cf8ff2a7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:40.106973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9d4d2-fbdc-4912-bc35-cf2570d7552f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:40.154978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696037a-ee7b-4329-8d8e-bd4856bd3a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:40.155904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696037a-ee7b-4329-8d8e-bd4856bd3a0f None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:40.156189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696037a-ee7b-4329-8d8e-bd4856bd3a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:40.156468 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696037a-ee7b-4329-8d8e-bd4856bd3a0f None admin] PATH_INFO: `/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/f6f7d26d4d434ad5a3abc45f8f05e4e9/roles/17cc20a61bbf4f5ea7ae111203cfda47` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:40.175451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696037a-ee7b-4329-8d8e-bd4856bd3a0f None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e90e91d3094e67b09b2b8137f210f4, user_id=f6f7d26d4d434ad5a3abc45f8f05e4e9, role_id=17cc20a61bbf4f5ea7ae111203cfda47)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:40.177882 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696037a-ee7b-4329-8d8e-bd4856bd3a0f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:40.207311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb9a69-63bd-42eb-9855-a519cf8ff2a7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:40.245419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d4ada-2a59-40f7-9825-e688eff0d8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:40.246604 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d4ada-2a59-40f7-9825-e688eff0d8ff None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:40.247134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d4ada-2a59-40f7-9825-e688eff0d8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:40.247624 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d4ada-2a59-40f7-9825-e688eff0d8ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:40.251450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 390/804] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:50:39 2022] PUT /identity/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/f6f7d26d4d434ad5a3abc45f8f05e4e9/roles/17cc20a61bbf4f5ea7ae111203cfda47 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 21:50:40.253096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfc1fa-60c0-4a12-ad11-7051c96d27bd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:40.253543 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfc1fa-60c0-4a12-ad11-7051c96d27bd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:40.253918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfc1fa-60c0-4a12-ad11-7051c96d27bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:40.256832 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d4ada-2a59-40f7-9825-e688eff0d8ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:40.259425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d4ada-2a59-40f7-9825-e688eff0d8ff None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:40.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-377d4ada-2a59-40f7-9825-e688eff0d8ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:40.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:40.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:40.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:40.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:40.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:40.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:40.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:40.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:40.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:40.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:40.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:40.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:40.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:40.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:40.281260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:40.282326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:40.282326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:40.282326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:40.282326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:40.282326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:40.282326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:40.282326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:40.282326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:40.289640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 415/805] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:40.291348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d4ada-2a59-40f7-9825-e688eff0d8ff None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:40.300337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-69cfc1fa-60c0-4a12-ad11-7051c96d27bd None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:40.301966 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-69cfc1fa-60c0-4a12-ad11-7051c96d27bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:40.419867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d4ada-2a59-40f7-9825-e688eff0d8ff None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:40.461422 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac57a91-4647-4b40-8c36-214a6bf77f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:40.463267 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac57a91-4647-4b40-8c36-214a6bf77f3e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:40.463707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac57a91-4647-4b40-8c36-214a6bf77f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:40.464155 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac57a91-4647-4b40-8c36-214a6bf77f3e None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:40.465112 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac57a91-4647-4b40-8c36-214a6bf77f3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:40.465570 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac57a91-4647-4b40-8c36-214a6bf77f3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:40.467241 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac57a91-4647-4b40-8c36-214a6bf77f3e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:40.486532 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 416/806] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:40.489265 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac57a91-4647-4b40-8c36-214a6bf77f3e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:40.491507 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 391/807] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:40.529918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfc1fa-60c0-4a12-ad11-7051c96d27bd None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:40.612282 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac57a91-4647-4b40-8c36-214a6bf77f3e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:40.645198 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfc1fa-60c0-4a12-ad11-7051c96d27bd None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:40.654387 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a495e-e06a-4f9f-8a5c-59c68058327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:40.655860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a495e-e06a-4f9f-8a5c-59c68058327f None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:40.656587 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a495e-e06a-4f9f-8a5c-59c68058327f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:40.657174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a495e-e06a-4f9f-8a5c-59c68058327f None admin] PATH_INFO: `/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/957c3decfb19445d80836f767fa23bd7/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:40.660000 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a495e-e06a-4f9f-8a5c-59c68058327f None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e90e91d3094e67b09b2b8137f210f4, user_id=957c3decfb19445d80836f767fa23bd7, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:40.662090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a495e-e06a-4f9f-8a5c-59c68058327f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:40.680115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e51172-f04b-466c-81fe-a7c14d545c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:40.681361 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e51172-f04b-466c-81fe-a7c14d545c56 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:40.681640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e51172-f04b-466c-81fe-a7c14d545c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:40.681910 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e51172-f04b-466c-81fe-a7c14d545c56 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:40.682555 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e51172-f04b-466c-81fe-a7c14d545c56 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:40.683926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e51172-f04b-466c-81fe-a7c14d545c56 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a2e51172-f04b-466c-81fe-a7c14d545c56 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:40.696834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:40.697757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:40.698584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 392/808] 10.222.0.24 () {56 vars in 1129 bytes} [Tue May 17 21:50:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:40.699572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c2f12-85d5-4335-92cf-e75a2f23287c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:40.703156 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c2f12-85d5-4335-92cf-e75a2f23287c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:40.703156 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c2f12-85d5-4335-92cf-e75a2f23287c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:40.703156 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 393/809] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:40.706169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c2f12-85d5-4335-92cf-e75a2f23287c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:40.774720 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 417/810] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:50:40 2022] PUT /identity/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/957c3decfb19445d80836f767fa23bd7/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:50:40.776584 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22a833-e639-4c2f-a05d-a059f3fbac41 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:40.777145 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22a833-e639-4c2f-a05d-a059f3fbac41 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:40.777631 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22a833-e639-4c2f-a05d-a059f3fbac41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:40.814651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7f22a833-e639-4c2f-a05d-a059f3fbac41 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:40.817146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7f22a833-e639-4c2f-a05d-a059f3fbac41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:40.819362 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c2f12-85d5-4335-92cf-e75a2f23287c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:40.900393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b0bef-6304-4044-acd6-9df2420adcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:40.901283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b0bef-6304-4044-acd6-9df2420adcdd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:40.902996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b0bef-6304-4044-acd6-9df2420adcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:40.904365 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b0bef-6304-4044-acd6-9df2420adcdd None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:40.905278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b0bef-6304-4044-acd6-9df2420adcdd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:40.906689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b0bef-6304-4044-acd6-9df2420adcdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:40.909883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b0bef-6304-4044-acd6-9df2420adcdd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:40.921567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 394/811] 10.222.0.24 () {56 vars in 1124 bytes} [Tue May 17 21:50:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:40.927095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b0bef-6304-4044-acd6-9df2420adcdd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:40.956433 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 418/812] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:41.008758 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22a833-e639-4c2f-a05d-a059f3fbac41 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:41.065432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b0bef-6304-4044-acd6-9df2420adcdd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:41.105001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289faa9c-798a-4594-82d5-881acca7599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:41.105883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289faa9c-798a-4594-82d5-881acca7599a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:41.106258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289faa9c-798a-4594-82d5-881acca7599a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:41.106632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289faa9c-798a-4594-82d5-881acca7599a None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:41.107478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289faa9c-798a-4594-82d5-881acca7599a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:41.108014 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289faa9c-798a-4594-82d5-881acca7599a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:41.109252 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289faa9c-798a-4594-82d5-881acca7599a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:41.114514 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 395/813] 10.222.0.24 () {56 vars in 1124 bytes} [Tue May 17 21:50:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:41.122234 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289faa9c-798a-4594-82d5-881acca7599a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:41.154460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22a833-e639-4c2f-a05d-a059f3fbac41 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:41.219742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8693f3-f910-428e-9e2e-8c2f6cd0620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:41.220465 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8693f3-f910-428e-9e2e-8c2f6cd0620f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:41.220738 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8693f3-f910-428e-9e2e-8c2f6cd0620f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:41.221005 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8693f3-f910-428e-9e2e-8c2f6cd0620f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:41.242939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8693f3-f910-428e-9e2e-8c2f6cd0620f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-5a8693f3-f910-428e-9e2e-8c2f6cd0620f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:41.259323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:41.260500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:41.261509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:41.261509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:41.261509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:41.261509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:41.261509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:41.261509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:41.261509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:41.261509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:41.261509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:41.261509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:41.261509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:50:41.261509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:41.261509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 419/814] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:50:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:41.267989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8693f3-f910-428e-9e2e-8c2f6cd0620f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:41.286278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289faa9c-798a-4594-82d5-881acca7599a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:41.383126 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8693f3-f910-428e-9e2e-8c2f6cd0620f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:41.392730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a57fa9-3538-411f-bfee-6e200cb9f08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:41.393388 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a57fa9-3538-411f-bfee-6e200cb9f08e None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:41.393672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a57fa9-3538-411f-bfee-6e200cb9f08e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:41.393947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a57fa9-3538-411f-bfee-6e200cb9f08e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:41.394763 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a57fa9-3538-411f-bfee-6e200cb9f08e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:41.396069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a57fa9-3538-411f-bfee-6e200cb9f08e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:41.420525 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226fc91-2c45-4616-b076-58b54876d48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:41.421548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226fc91-2c45-4616-b076-58b54876d48e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:41.421979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226fc91-2c45-4616-b076-58b54876d48e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:41.422440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226fc91-2c45-4616-b076-58b54876d48e None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:41.423407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226fc91-2c45-4616-b076-58b54876d48e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:41.423873 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226fc91-2c45-4616-b076-58b54876d48e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:41.425427 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226fc91-2c45-4616-b076-58b54876d48e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:41.435704 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 420/815] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:50:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:41.443165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226fc91-2c45-4616-b076-58b54876d48e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:41.533237 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 396/816] 10.222.0.24 () {60 vars in 1144 bytes} [Tue May 17 21:50:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:50:41.553884 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226fc91-2c45-4616-b076-58b54876d48e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:41.607606 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af22b9-ddd0-42ee-a243-072a1e517769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:41.608684 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af22b9-ddd0-42ee-a243-072a1e517769 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:41.609117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af22b9-ddd0-42ee-a243-072a1e517769 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:41.609539 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af22b9-ddd0-42ee-a243-072a1e517769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:41.622083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af22b9-ddd0-42ee-a243-072a1e517769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:41.628005 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af22b9-ddd0-42ee-a243-072a1e517769 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:41.651134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-54af22b9-ddd0-42ee-a243-072a1e517769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:41.651134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:41.651134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:41.651134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:41.651134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:41.651134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:41.651134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:41.651134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:41.651134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:41.651134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:41.651134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:41.651134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:41.651134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:41.651134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:41.651134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:41.652262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:41.653351 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:41.653351 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:41.653351 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:41.653351 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:41.655381 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 421/817] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:41.660999 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a57fa9-3538-411f-bfee-6e200cb9f08e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:41.779249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a57fa9-3538-411f-bfee-6e200cb9f08e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:41.788338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e5618-96b1-4540-9c15-46c8ad68e131 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:41.788801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e5618-96b1-4540-9c15-46c8ad68e131 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:41.789725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e5618-96b1-4540-9c15-46c8ad68e131 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:41.791333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 422/818] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:41.800860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ae23e-d099-49d8-8c57-f478aaa57ccd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:41.801467 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ae23e-d099-49d8-8c57-f478aaa57ccd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:41.801767 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ae23e-d099-49d8-8c57-f478aaa57ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:41.828809 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb252e-621e-447d-9d0f-a7894502daf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:41.830817 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb252e-621e-447d-9d0f-a7894502daf7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:41.831101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb252e-621e-447d-9d0f-a7894502daf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:41.831416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb252e-621e-447d-9d0f-a7894502daf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:41.832181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb252e-621e-447d-9d0f-a7894502daf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:41.832494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb252e-621e-447d-9d0f-a7894502daf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:41.833887 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb252e-621e-447d-9d0f-a7894502daf7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:41.836481 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-373ae23e-d099-49d8-8c57-f478aaa57ccd None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:41.837702 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-373ae23e-d099-49d8-8c57-f478aaa57ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:41.866609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 397/819] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:41.869400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb252e-621e-447d-9d0f-a7894502daf7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:41.957682 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 423/820] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:41.980463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ae23e-d099-49d8-8c57-f478aaa57ccd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:42.004331 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb252e-621e-447d-9d0f-a7894502daf7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:42.047689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f7d06-8350-49eb-a1ca-b440d3276f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:42.048406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f7d06-8350-49eb-a1ca-b440d3276f85 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:42.049105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f7d06-8350-49eb-a1ca-b440d3276f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:42.049385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f7d06-8350-49eb-a1ca-b440d3276f85 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:42.059534 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f7d06-8350-49eb-a1ca-b440d3276f85 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:42.061235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f7d06-8350-49eb-a1ca-b440d3276f85 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-db5f7d06-8350-49eb-a1ca-b440d3276f85 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:42.079650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:42.080657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:42.081600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:42.081600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:42.081600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:42.081600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:42.081600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:42.081600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:42.081600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:42.081600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:42.081600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 21:50:42.081600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:42.081600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 398/821] 10.222.0.24 () {56 vars in 1093 bytes} [Tue May 17 21:50:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:42.090360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f7d06-8350-49eb-a1ca-b440d3276f85 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:42.104279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ae23e-d099-49d8-8c57-f478aaa57ccd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:42.148098 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c463f-d0f5-4552-995c-c24a7b60a6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:42.148956 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c463f-d0f5-4552-995c-c24a7b60a6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:42.149345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c463f-d0f5-4552-995c-c24a7b60a6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:42.149627 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c463f-d0f5-4552-995c-c24a7b60a6d1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:42.150288 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c463f-d0f5-4552-995c-c24a7b60a6d1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:42.151688 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c463f-d0f5-4552-995c-c24a7b60a6d1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-737c463f-d0f5-4552-995c-c24a7b60a6d1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:42.165826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:42.168206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:42.169806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:42.169806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:42.169806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:42.169806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:42.169806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:42.169806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:42.169806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:42.169806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:42.169806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:42.169806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:42.169806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:42.169806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:42.169806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 21:50:42.169806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:42.169806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 424/822] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:41 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:42.177969 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c463f-d0f5-4552-995c-c24a7b60a6d1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:42.283779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f7d06-8350-49eb-a1ca-b440d3276f85 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:42.323745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32797f58-3e9a-47ad-adeb-9cc44b333a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:42.324488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32797f58-3e9a-47ad-adeb-9cc44b333a3b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:42.324840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32797f58-3e9a-47ad-adeb-9cc44b333a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:42.325182 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32797f58-3e9a-47ad-adeb-9cc44b333a3b None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:42.326094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32797f58-3e9a-47ad-adeb-9cc44b333a3b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:42.327433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32797f58-3e9a-47ad-adeb-9cc44b333a3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:42.328935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32797f58-3e9a-47ad-adeb-9cc44b333a3b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:42.361433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 399/823] 10.222.0.24 () {56 vars in 1133 bytes} [Tue May 17 21:50:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:42.368825 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32797f58-3e9a-47ad-adeb-9cc44b333a3b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:42.401862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c463f-d0f5-4552-995c-c24a7b60a6d1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:42.478474 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a834eb4-6e70-43f2-b8f7-e02d866b251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:42.479262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a834eb4-6e70-43f2-b8f7-e02d866b251d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:42.479614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a834eb4-6e70-43f2-b8f7-e02d866b251d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:42.480022 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a834eb4-6e70-43f2-b8f7-e02d866b251d None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:42.480810 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a834eb4-6e70-43f2-b8f7-e02d866b251d None admin] RBAC: Adding query filter params (name=network) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:42.481186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a834eb4-6e70-43f2-b8f7-e02d866b251d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:42.482690 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a834eb4-6e70-43f2-b8f7-e02d866b251d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:42.495150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 425/824] 10.222.0.24 () {56 vars in 1112 bytes} [Tue May 17 21:50:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:42.500634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a834eb4-6e70-43f2-b8f7-e02d866b251d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:42.569325 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32797f58-3e9a-47ad-adeb-9cc44b333a3b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:42.641073 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc4c96-2bc3-47e8-b825-3f3584265861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:42.641665 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc4c96-2bc3-47e8-b825-3f3584265861 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:42.641952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc4c96-2bc3-47e8-b825-3f3584265861 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:42.642288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc4c96-2bc3-47e8-b825-3f3584265861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:42.673541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a834eb4-6e70-43f2-b8f7-e02d866b251d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:42.715835 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd87381-2c00-458b-a804-619e625b0312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:42.716509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd87381-2c00-458b-a804-619e625b0312 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:42.716789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd87381-2c00-458b-a804-619e625b0312 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:42.717002 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc4c96-2bc3-47e8-b825-3f3584265861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:42.717111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd87381-2c00-458b-a804-619e625b0312 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:42.717757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd87381-2c00-458b-a804-619e625b0312 None admin] RBAC: Adding query filter params (type=network) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:42.718059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd87381-2c00-458b-a804-619e625b0312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:42.718449 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc4c96-2bc3-47e8-b825-3f3584265861 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:42.719429 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd87381-2c00-458b-a804-619e625b0312 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:42.734343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 426/825] 10.222.0.24 () {56 vars in 1112 bytes} [Tue May 17 21:50:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:42.749786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd87381-2c00-458b-a804-619e625b0312 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:42.830717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 400/826] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:50:42.831993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc4c96-2bc3-47e8-b825-3f3584265861 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:42.921359 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd87381-2c00-458b-a804-619e625b0312 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:42.931811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc4c96-2bc3-47e8-b825-3f3584265861 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:42.956002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4dea7-cfc5-4ce8-bd5d-0a70788c1d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:42.956662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4dea7-cfc5-4ce8-bd5d-0a70788c1d2e None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:42.956944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4dea7-cfc5-4ce8-bd5d-0a70788c1d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:42.957220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4dea7-cfc5-4ce8-bd5d-0a70788c1d2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:42.957962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4dea7-cfc5-4ce8-bd5d-0a70788c1d2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:42.959353 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4dea7-cfc5-4ce8-bd5d-0a70788c1d2e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:42.968884 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adfcb0-826c-4fc2-89f9-4ba58fc3df49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:42.969685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adfcb0-826c-4fc2-89f9-4ba58fc3df49 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:42.969968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adfcb0-826c-4fc2-89f9-4ba58fc3df49 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:42.970492 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adfcb0-826c-4fc2-89f9-4ba58fc3df49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:42.981989 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adfcb0-826c-4fc2-89f9-4ba58fc3df49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:42.983455 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adfcb0-826c-4fc2-89f9-4ba58fc3df49 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:43.000921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-54adfcb0-826c-4fc2-89f9-4ba58fc3df49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:43.000921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:43.000921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:43.000921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:43.000921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:43.000921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:43.000921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:43.000921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:43.000921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:43.000921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:43.000921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:43.000921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:43.000921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:43.000921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:43.000921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:43.001851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:43.002716 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:43.002716 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:43.002716 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:43.002716 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:43.002716 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 401/827] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:43.006793 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29e17a-28d2-4404-ba80-695337c1483d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:43.006793 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29e17a-28d2-4404-ba80-695337c1483d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:43.006793 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29e17a-28d2-4404-ba80-695337c1483d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:43.006793 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 402/828] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:43.007286 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29e17a-28d2-4404-ba80-695337c1483d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:43.067458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 427/829] 10.222.0.24 () {60 vars in 1144 bytes} [Tue May 17 21:50:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:50:43.069108 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde34c8-7f31-48eb-b22d-a0e9510b20e4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:43.069614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde34c8-7f31-48eb-b22d-a0e9510b20e4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:43.070731 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde34c8-7f31-48eb-b22d-a0e9510b20e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:43.093031 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ccde34c8-7f31-48eb-b22d-a0e9510b20e4 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:43.095291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ccde34c8-7f31-48eb-b22d-a0e9510b20e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:43.187455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 428/830] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:43.200548 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29e17a-28d2-4404-ba80-695337c1483d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:43.214600 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde34c8-7f31-48eb-b22d-a0e9510b20e4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:43.270746 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4777ea2-ba1c-4d49-915b-9a794807ebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:43.271745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4777ea2-ba1c-4d49-915b-9a794807ebe7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:43.272026 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4777ea2-ba1c-4d49-915b-9a794807ebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:43.272300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4777ea2-ba1c-4d49-915b-9a794807ebe7 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:43.273047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4777ea2-ba1c-4d49-915b-9a794807ebe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:43.273421 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4777ea2-ba1c-4d49-915b-9a794807ebe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:43.275638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4777ea2-ba1c-4d49-915b-9a794807ebe7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:43.295152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 403/831] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:43.304194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4777ea2-ba1c-4d49-915b-9a794807ebe7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:43.410543 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde34c8-7f31-48eb-b22d-a0e9510b20e4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:43.419868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4777ea2-ba1c-4d49-915b-9a794807ebe7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:43.450464 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d11e0-a7a9-4e06-9905-bb3ab6c27b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:43.451629 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d11e0-a7a9-4e06-9905-bb3ab6c27b9d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:43.452107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d11e0-a7a9-4e06-9905-bb3ab6c27b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:43.452574 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d11e0-a7a9-4e06-9905-bb3ab6c27b9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:43.459465 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22e30c-eb55-40e2-bb5d-bf2637ae90e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:43.460423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22e30c-eb55-40e2-bb5d-bf2637ae90e0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:43.461230 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22e30c-eb55-40e2-bb5d-bf2637ae90e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:43.461509 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22e30c-eb55-40e2-bb5d-bf2637ae90e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:43.465272 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d11e0-a7a9-4e06-9905-bb3ab6c27b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:43.468995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22e30c-eb55-40e2-bb5d-bf2637ae90e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:43.470434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22e30c-eb55-40e2-bb5d-bf2637ae90e0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-8c3d11e0-a7a9-4e06-9905-bb3ab6c27b9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:43.473726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:43.474619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:43.475448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:43.475448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:43.475448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:43.475448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:43.475448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:43.475448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:43.475448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:43.475448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:43.475448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:43.475448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:43.475448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:50:43.475448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:43.478531 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 429/832] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:50:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:43.484905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4d22e30c-eb55-40e2-bb5d-bf2637ae90e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:43.484905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:43.484905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:43.484905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:43.484905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:43.484905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:43.484905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:43.484905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:43.484905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:43.484905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:43.484905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:43.484905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:43.484905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:43.484905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:43.484905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:43.485767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:43.486646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:43.486646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:43.486646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:43.486646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:43.486646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:43.486646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:43.486646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:43.486646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:43.486646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 404/833] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:43.488477 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d11e0-a7a9-4e06-9905-bb3ab6c27b9d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:43.491744 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22e30c-eb55-40e2-bb5d-bf2637ae90e0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:43.600618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d11e0-a7a9-4e06-9905-bb3ab6c27b9d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:43.605955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22e30c-eb55-40e2-bb5d-bf2637ae90e0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:43.635272 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bd63c-16d9-4ff6-af6b-b961c6e923cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:43.635929 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bd63c-16d9-4ff6-af6b-b961c6e923cc None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:43.636205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bd63c-16d9-4ff6-af6b-b961c6e923cc None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:43.636474 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bd63c-16d9-4ff6-af6b-b961c6e923cc None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:43.637204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bd63c-16d9-4ff6-af6b-b961c6e923cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:43.637502 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bd63c-16d9-4ff6-af6b-b961c6e923cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:43.638596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b25e5b-1e3a-4ea9-b433-57a9d43f99ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:43.638853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bd63c-16d9-4ff6-af6b-b961c6e923cc None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:43.639283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b25e5b-1e3a-4ea9-b433-57a9d43f99ea None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:43.639568 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b25e5b-1e3a-4ea9-b433-57a9d43f99ea None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:43.639841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b25e5b-1e3a-4ea9-b433-57a9d43f99ea None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:43.640618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b25e5b-1e3a-4ea9-b433-57a9d43f99ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:43.640930 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b25e5b-1e3a-4ea9-b433-57a9d43f99ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:43.642335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b25e5b-1e3a-4ea9-b433-57a9d43f99ea None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:43.649960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 430/834] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:50:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:43.651705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd614172-6250-4d62-aa0d-5b5fdd8d1aaf None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:43.652066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd614172-6250-4d62-aa0d-5b5fdd8d1aaf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:43.652452 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd614172-6250-4d62-aa0d-5b5fdd8d1aaf None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:43.653900 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 431/835] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:43.657702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 405/836] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:43.658804 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd614172-6250-4d62-aa0d-5b5fdd8d1aaf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:43.659575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93011ba-defa-4802-aef0-b6bffba2402a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:43.660029 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93011ba-defa-4802-aef0-b6bffba2402a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:43.660477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93011ba-defa-4802-aef0-b6bffba2402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:43.676903 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a93011ba-defa-4802-aef0-b6bffba2402a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:43.678055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a93011ba-defa-4802-aef0-b6bffba2402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:43.749085 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 406/837] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:43.749847 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93011ba-defa-4802-aef0-b6bffba2402a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:43.779643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd614172-6250-4d62-aa0d-5b5fdd8d1aaf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:43.818516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8dc9-88ef-4ca1-8bc9-8f07011d7d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:43.827317 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8dc9-88ef-4ca1-8bc9-8f07011d7d49 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:43.827317 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8dc9-88ef-4ca1-8bc9-8f07011d7d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:43.827317 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8dc9-88ef-4ca1-8bc9-8f07011d7d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:43.831079 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe8dc9-88ef-4ca1-8bc9-8f07011d7d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:43.832549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe8dc9-88ef-4ca1-8bc9-8f07011d7d49 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:43.850130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-fffe8dc9-88ef-4ca1-8bc9-8f07011d7d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:43.850130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:43.850130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:43.850130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:43.850130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:43.850130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:43.850130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:43.850130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:43.850130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:43.850130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:43.850130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:43.850130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:43.850130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:43.850130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:43.850130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:43.851450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:43.852373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:43.852373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:43.852373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:43.852373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:43.852373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 432/838] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:43.852373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8dc9-88ef-4ca1-8bc9-8f07011d7d49 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:43.862884 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93011ba-defa-4802-aef0-b6bffba2402a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:43.902957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596c48c-960d-4245-ba74-92707b9f5a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:43.903710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596c48c-960d-4245-ba74-92707b9f5a8d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:43.903990 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596c48c-960d-4245-ba74-92707b9f5a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:43.904570 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596c48c-960d-4245-ba74-92707b9f5a8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:43.905109 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596c48c-960d-4245-ba74-92707b9f5a8d None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=8d06113649924eae83d04bc22337bd6d) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:43.905412 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596c48c-960d-4245-ba74-92707b9f5a8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:43.906909 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596c48c-960d-4245-ba74-92707b9f5a8d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:43.923526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 407/839] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:43 2022] GET /identity/v3/role_assignments?user.id=8d06113649924eae83d04bc22337bd6d&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:43.923526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596c48c-960d-4245-ba74-92707b9f5a8d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:43.982048 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8dc9-88ef-4ca1-8bc9-8f07011d7d49 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:44.019740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eceb6b-b9a2-4c30-bc3f-0ef0bac9ff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:44.020448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eceb6b-b9a2-4c30-bc3f-0ef0bac9ff80 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:44.020726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eceb6b-b9a2-4c30-bc3f-0ef0bac9ff80 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:44.021177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eceb6b-b9a2-4c30-bc3f-0ef0bac9ff80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:44.032698 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eceb6b-b9a2-4c30-bc3f-0ef0bac9ff80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-c4eceb6b-b9a2-4c30-bc3f-0ef0bac9ff80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:44.041227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:44.042229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:44.043798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:44.043798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:44.043798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:44.043798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:44.043798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:44.043798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:44.043798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:44.043798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:44.043798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:44.043798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:44.043798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:50:44.043798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:44.043798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 433/840] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:50:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:44.048363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eceb6b-b9a2-4c30-bc3f-0ef0bac9ff80 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:44.061130 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596c48c-960d-4245-ba74-92707b9f5a8d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:44.102188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c2a15-08a6-4943-b91c-c16cb64b4ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:44.103358 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c2a15-08a6-4943-b91c-c16cb64b4ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:44.103850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c2a15-08a6-4943-b91c-c16cb64b4ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:44.104366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c2a15-08a6-4943-b91c-c16cb64b4ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:44.105327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c2a15-08a6-4943-b91c-c16cb64b4ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:44.105848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c2a15-08a6-4943-b91c-c16cb64b4ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:44.107479 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c2a15-08a6-4943-b91c-c16cb64b4ca6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:44.125471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 408/841] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:44.127338 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c2a15-08a6-4943-b91c-c16cb64b4ca6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:44.201577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eceb6b-b9a2-4c30-bc3f-0ef0bac9ff80 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:44.254488 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70695b98-58d1-4b37-9349-d48607c6e829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:44.255182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70695b98-58d1-4b37-9349-d48607c6e829 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:44.255462 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70695b98-58d1-4b37-9349-d48607c6e829 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:44.255727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70695b98-58d1-4b37-9349-d48607c6e829 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:44.256465 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70695b98-58d1-4b37-9349-d48607c6e829 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:44.256759 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70695b98-58d1-4b37-9349-d48607c6e829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:44.258291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70695b98-58d1-4b37-9349-d48607c6e829 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:44.263684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c2a15-08a6-4943-b91c-c16cb64b4ca6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:44.266869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 434/842] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:50:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:44.272547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee0aa5-4f16-4203-9caa-1d003092e284 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:44.272790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee0aa5-4f16-4203-9caa-1d003092e284 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:44.273040 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee0aa5-4f16-4203-9caa-1d003092e284 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:44.274983 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 435/843] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:44.278998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee0aa5-4f16-4203-9caa-1d003092e284 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:44.298619 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520e89e-3078-4629-aebc-0d6bd53ade48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:44.299454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520e89e-3078-4629-aebc-0d6bd53ade48 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:44.299731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520e89e-3078-4629-aebc-0d6bd53ade48 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:44.300004 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520e89e-3078-4629-aebc-0d6bd53ade48 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:44.309008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520e89e-3078-4629-aebc-0d6bd53ade48 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:44.310426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520e89e-3078-4629-aebc-0d6bd53ade48 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b520e89e-3078-4629-aebc-0d6bd53ade48 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:44.325912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:44.326900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:44.327860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:44.327860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:44.327860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:44.327860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:44.327860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:44.327860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:44.327860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:44.327860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:44.327860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 21:50:44.327860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:44.327860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 409/844] 10.222.0.24 () {56 vars in 1117 bytes} [Tue May 17 21:50:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:44.328451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32605539-31bd-44ec-9a04-0e426574a06f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:44.328520 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32605539-31bd-44ec-9a04-0e426574a06f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:44.328823 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32605539-31bd-44ec-9a04-0e426574a06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:44.348332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-32605539-31bd-44ec-9a04-0e426574a06f None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:44.349579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-32605539-31bd-44ec-9a04-0e426574a06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:44.379124 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee0aa5-4f16-4203-9caa-1d003092e284 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:44.413171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b18dd-5193-41cd-ba25-b61522edfeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:44.414625 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b18dd-5193-41cd-ba25-b61522edfeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:44.414951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b18dd-5193-41cd-ba25-b61522edfeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:44.415256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b18dd-5193-41cd-ba25-b61522edfeb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:44.417116 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 410/845] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:44.418417 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32605539-31bd-44ec-9a04-0e426574a06f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:44.425618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b18dd-5193-41cd-ba25-b61522edfeb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:44.427363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b18dd-5193-41cd-ba25-b61522edfeb9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:44.446520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-660b18dd-5193-41cd-ba25-b61522edfeb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:44.446520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:44.446520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:44.446520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:44.446520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:44.446520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:44.446520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:44.446520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:44.446520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:44.446520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:44.446520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:44.446520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:44.446520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:44.446520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:44.446520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:44.447518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:44.453246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:44.453246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:44.453246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:44.453246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:44.453246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 436/846] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:44.453246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b18dd-5193-41cd-ba25-b61522edfeb9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:44.532056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32605539-31bd-44ec-9a04-0e426574a06f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:44.566111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed00b-fa17-407b-a0ce-0857a10bdb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:44.566856 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed00b-fa17-407b-a0ce-0857a10bdb1a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:44.567156 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed00b-fa17-407b-a0ce-0857a10bdb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:44.567435 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed00b-fa17-407b-a0ce-0857a10bdb1a None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:44.568279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed00b-fa17-407b-a0ce-0857a10bdb1a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:44.568581 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed00b-fa17-407b-a0ce-0857a10bdb1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:44.568686 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b18dd-5193-41cd-ba25-b61522edfeb9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:44.570521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed00b-fa17-407b-a0ce-0857a10bdb1a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:44.594050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 411/847] 10.222.0.24 () {56 vars in 1149 bytes} [Tue May 17 21:50:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:44.594050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed00b-fa17-407b-a0ce-0857a10bdb1a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:44.616026 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cc769-192d-45b5-a378-3ec77e525bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:44.617079 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cc769-192d-45b5-a378-3ec77e525bbc None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:44.617552 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cc769-192d-45b5-a378-3ec77e525bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:44.617961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cc769-192d-45b5-a378-3ec77e525bbc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:44.618750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cc769-192d-45b5-a378-3ec77e525bbc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:44.620187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cc769-192d-45b5-a378-3ec77e525bbc None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-328cc769-192d-45b5-a378-3ec77e525bbc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:44.631979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:44.633546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:44.634456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:44.634456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:44.634456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:44.634456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:44.634456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:44.634456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:44.634456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:44.634456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:44.634456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:44.634456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:44.634456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:44.634456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:44.634456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 21:50:44.634456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:44.634456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 437/848] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:50:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:44.635977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cc769-192d-45b5-a378-3ec77e525bbc None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:44.694464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed00b-fa17-407b-a0ce-0857a10bdb1a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:44.729081 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb716a-3c57-4b58-a439-2551c548baab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:44.729768 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb716a-3c57-4b58-a439-2551c548baab None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:44.730046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb716a-3c57-4b58-a439-2551c548baab None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:44.730533 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb716a-3c57-4b58-a439-2551c548baab None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:44.731025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb716a-3c57-4b58-a439-2551c548baab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:44.731364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb716a-3c57-4b58-a439-2551c548baab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:44.732734 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb716a-3c57-4b58-a439-2551c548baab None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:44.736011 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cc769-192d-45b5-a378-3ec77e525bbc None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:44.747442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 412/849] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:44.748965 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb716a-3c57-4b58-a439-2551c548baab None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:44.771959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb1e23-be31-49eb-847d-5e03f90a411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:44.773338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb1e23-be31-49eb-847d-5e03f90a411f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:44.773791 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb1e23-be31-49eb-847d-5e03f90a411f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:44.774456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb1e23-be31-49eb-847d-5e03f90a411f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:44.844764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb1e23-be31-49eb-847d-5e03f90a411f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:44.846242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb1e23-be31-49eb-847d-5e03f90a411f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:44.849516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb716a-3c57-4b58-a439-2551c548baab None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:44.889679 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af327a-f281-420b-8844-a4a94ecf97fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:44.890350 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af327a-f281-420b-8844-a4a94ecf97fd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:44.890629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af327a-f281-420b-8844-a4a94ecf97fd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:44.890904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af327a-f281-420b-8844-a4a94ecf97fd None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:44.891755 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af327a-f281-420b-8844-a4a94ecf97fd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:44.892064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af327a-f281-420b-8844-a4a94ecf97fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:44.893472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af327a-f281-420b-8844-a4a94ecf97fd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:44.897934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 413/850] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:50:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:44.903702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af327a-f281-420b-8844-a4a94ecf97fd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:44.961672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 438/851] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:50:44.961672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb1e23-be31-49eb-847d-5e03f90a411f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:45.015041 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af327a-f281-420b-8844-a4a94ecf97fd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:45.047839 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd160dd-8f62-4d77-a768-aa32b3cb8682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:45.048627 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd160dd-8f62-4d77-a768-aa32b3cb8682 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:45.048911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd160dd-8f62-4d77-a768-aa32b3cb8682 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:45.049189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd160dd-8f62-4d77-a768-aa32b3cb8682 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:45.053995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb1e23-be31-49eb-847d-5e03f90a411f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:45.058348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd160dd-8f62-4d77-a768-aa32b3cb8682 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:45.059826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd160dd-8f62-4d77-a768-aa32b3cb8682 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5bd160dd-8f62-4d77-a768-aa32b3cb8682 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:45.078239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:45.079221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:45.080189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:45.080189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:45.080189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:45.080189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:45.080189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:45.080189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:45.080189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:45.080189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:45.080189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 21:50:45.080189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:45.080189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 414/852] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:50:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:45.080796 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd160dd-8f62-4d77-a768-aa32b3cb8682 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:45.091749 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b165e-b455-4872-b773-9be247e355a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:45.092689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b165e-b455-4872-b773-9be247e355a3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:45.092978 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b165e-b455-4872-b773-9be247e355a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:45.093414 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b165e-b455-4872-b773-9be247e355a3 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:45.093957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b165e-b455-4872-b773-9be247e355a3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:45.094266 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b165e-b455-4872-b773-9be247e355a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:45.095747 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b165e-b455-4872-b773-9be247e355a3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:45.111453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 439/853] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:50:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:45.111453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b165e-b455-4872-b773-9be247e355a3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:45.196172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd160dd-8f62-4d77-a768-aa32b3cb8682 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:45.233888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2642fd-f3cb-451c-9d86-60075b0e2152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:45.234699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2642fd-f3cb-451c-9d86-60075b0e2152 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:45.234984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2642fd-f3cb-451c-9d86-60075b0e2152 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:45.235296 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2642fd-f3cb-451c-9d86-60075b0e2152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:45.247332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2642fd-f3cb-451c-9d86-60075b0e2152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:45.248806 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2642fd-f3cb-451c-9d86-60075b0e2152 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:45.253784 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b165e-b455-4872-b773-9be247e355a3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:45.267733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1f2642fd-f3cb-451c-9d86-60075b0e2152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:45.267733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:45.267733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:45.267733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:45.267733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:45.267733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:45.267733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:45.267733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:45.267733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:45.267733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:45.267733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:45.267733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:45.267733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:45.267733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:45.267733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:45.268686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:45.269541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:45.269541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:45.269541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:45.269541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:45.274472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 415/854] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:45.276077 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2642fd-f3cb-451c-9d86-60075b0e2152 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:45.300490 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479300b3-48ea-4b01-9afb-c5d0716699fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:45.301464 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479300b3-48ea-4b01-9afb-c5d0716699fd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:45.301903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479300b3-48ea-4b01-9afb-c5d0716699fd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:45.302181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479300b3-48ea-4b01-9afb-c5d0716699fd None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:45.303650 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479300b3-48ea-4b01-9afb-c5d0716699fd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:45.303964 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479300b3-48ea-4b01-9afb-c5d0716699fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:45.306141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479300b3-48ea-4b01-9afb-c5d0716699fd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:45.326692 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 440/855] 10.222.0.24 () {56 vars in 1135 bytes} [Tue May 17 21:50:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:45.331836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479300b3-48ea-4b01-9afb-c5d0716699fd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:45.390978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2642fd-f3cb-451c-9d86-60075b0e2152 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:45.425120 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e60ac-f653-4f9c-9f26-f74eada052a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:45.425823 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e60ac-f653-4f9c-9f26-f74eada052a7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:45.426362 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e60ac-f653-4f9c-9f26-f74eada052a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:45.426639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e60ac-f653-4f9c-9f26-f74eada052a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:45.427424 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e60ac-f653-4f9c-9f26-f74eada052a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:45.427689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e60ac-f653-4f9c-9f26-f74eada052a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:45.429043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e60ac-f653-4f9c-9f26-f74eada052a7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:45.442235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 416/856] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:45.447729 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e60ac-f653-4f9c-9f26-f74eada052a7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:45.448493 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479300b3-48ea-4b01-9afb-c5d0716699fd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:45.483894 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ea65-b0c8-4f03-9303-81465fbcb398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:45.484886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ea65-b0c8-4f03-9303-81465fbcb398 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:45.485382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ea65-b0c8-4f03-9303-81465fbcb398 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:45.485868 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ea65-b0c8-4f03-9303-81465fbcb398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:45.557604 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148ea65-b0c8-4f03-9303-81465fbcb398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:45.559464 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148ea65-b0c8-4f03-9303-81465fbcb398 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:45.573535 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e60ac-f653-4f9c-9f26-f74eada052a7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:45.609590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6af3f2-9b06-45b0-a75c-05b107f997d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:45.610412 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6af3f2-9b06-45b0-a75c-05b107f997d1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:45.610696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6af3f2-9b06-45b0-a75c-05b107f997d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:45.610975 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6af3f2-9b06-45b0-a75c-05b107f997d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:45.618679 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6af3f2-9b06-45b0-a75c-05b107f997d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:45.620136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6af3f2-9b06-45b0-a75c-05b107f997d1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:45.634837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ea6af3f2-9b06-45b0-a75c-05b107f997d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:45.634837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:45.634837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:45.634837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:45.634837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:45.634837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:45.634837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:45.634837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:45.634837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:45.634837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:45.634837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:45.634837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:45.634837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:45.634837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:45.634837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:45.635773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:45.636645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:45.636645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:45.636645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:45.636645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:45.636645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:45.636645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:45.636645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:45.636645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:45.640880 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 417/857] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:45.641810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6af3f2-9b06-45b0-a75c-05b107f997d1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:45.666613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 441/858] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:50:45.672280 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ea65-b0c8-4f03-9303-81465fbcb398 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:45.751418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6af3f2-9b06-45b0-a75c-05b107f997d1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:45.773890 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ea65-b0c8-4f03-9303-81465fbcb398 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:45.789291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42d9b0-8dbf-48f0-8c45-413c58e0f47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:45.789656 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42d9b0-8dbf-48f0-8c45-413c58e0f47a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:45.789979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42d9b0-8dbf-48f0-8c45-413c58e0f47a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:45.790259 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42d9b0-8dbf-48f0-8c45-413c58e0f47a None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:45.791197 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42d9b0-8dbf-48f0-8c45-413c58e0f47a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:45.791407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42d9b0-8dbf-48f0-8c45-413c58e0f47a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:45.793186 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42d9b0-8dbf-48f0-8c45-413c58e0f47a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:45.811919 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f12b82-af19-48c7-898f-f21dc52daa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:45.812112 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 418/859] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:45.812960 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42d9b0-8dbf-48f0-8c45-413c58e0f47a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:45.813436 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f12b82-af19-48c7-898f-f21dc52daa9d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:45.813873 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f12b82-af19-48c7-898f-f21dc52daa9d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:45.814302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f12b82-af19-48c7-898f-f21dc52daa9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:45.825574 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f12b82-af19-48c7-898f-f21dc52daa9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:45.827580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f12b82-af19-48c7-898f-f21dc52daa9d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:45.849549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-29f12b82-af19-48c7-898f-f21dc52daa9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:45.849549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:45.849549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:45.849549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:45.849549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:45.849549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:45.849549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:45.849549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:45.849549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:45.849549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:45.849549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:45.849549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:45.849549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:45.849549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:45.849549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:45.850989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:45.852563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:45.852563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:45.852563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:45.852563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:45.859365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 442/860] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:45.860722 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f12b82-af19-48c7-898f-f21dc52daa9d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:45.938616 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42d9b0-8dbf-48f0-8c45-413c58e0f47a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:45.973684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fca056-f202-413d-a1d3-245af83183e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:45.974341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fca056-f202-413d-a1d3-245af83183e4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:45.974702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fca056-f202-413d-a1d3-245af83183e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:45.974967 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fca056-f202-413d-a1d3-245af83183e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:45.975834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fca056-f202-413d-a1d3-245af83183e4 None admin] RBAC: Adding query filter params (role.id=17cc20a61bbf4f5ea7ae111203cfda47, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=f6f7d26d4d434ad5a3abc45f8f05e4e9) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:45.976146 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fca056-f202-413d-a1d3-245af83183e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:45.978180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fca056-f202-413d-a1d3-245af83183e4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:45.980971 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f12b82-af19-48c7-898f-f21dc52daa9d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:45.991441 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 419/861] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:45 2022] GET /identity/v3/role_assignments?user.id=f6f7d26d4d434ad5a3abc45f8f05e4e9&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=17cc20a61bbf4f5ea7ae111203cfda47 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:46.019916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564d44a-3856-4cce-a4de-e6adeebc67b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:46.020853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564d44a-3856-4cce-a4de-e6adeebc67b2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:46.021274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564d44a-3856-4cce-a4de-e6adeebc67b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:46.021726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564d44a-3856-4cce-a4de-e6adeebc67b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:46.022616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564d44a-3856-4cce-a4de-e6adeebc67b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:46.023065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564d44a-3856-4cce-a4de-e6adeebc67b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:46.024875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564d44a-3856-4cce-a4de-e6adeebc67b2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:46.037958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 443/862] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:46.044344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fca056-f202-413d-a1d3-245af83183e4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:46.158484 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fca056-f202-413d-a1d3-245af83183e4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:46.204581 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6227b-40d5-4569-9e2a-bc1fa8b44de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:46.205400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6227b-40d5-4569-9e2a-bc1fa8b44de4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:46.205685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6227b-40d5-4569-9e2a-bc1fa8b44de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:46.205962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6227b-40d5-4569-9e2a-bc1fa8b44de4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:46.216399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6227b-40d5-4569-9e2a-bc1fa8b44de4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:46.218161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6227b-40d5-4569-9e2a-bc1fa8b44de4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:46.233561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-bfe6227b-40d5-4569-9e2a-bc1fa8b44de4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:46.233561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:46.233561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:46.233561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:46.233561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:46.233561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:46.233561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:46.233561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:46.233561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:46.233561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:46.233561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:46.233561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:46.233561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:46.233561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:46.233561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:46.234523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:46.235859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:46.235859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:46.235859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:46.235859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:46.235859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:46.235859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:46.235859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:46.235859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:46.235859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 420/863] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:46.241265 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564d44a-3856-4cce-a4de-e6adeebc67b2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:46.304096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9b69f-6298-43cd-b0dc-f753f95b01b3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:46.304490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9b69f-6298-43cd-b0dc-f753f95b01b3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:46.305005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9b69f-6298-43cd-b0dc-f753f95b01b3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:46.306770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 421/864] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:46.315657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ffe77-5826-4068-a17b-15bfe5cc1ad3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:46.315996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ffe77-5826-4068-a17b-15bfe5cc1ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:46.316417 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ffe77-5826-4068-a17b-15bfe5cc1ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:46.340014 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a73ffe77-5826-4068-a17b-15bfe5cc1ad3 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:46.341202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a73ffe77-5826-4068-a17b-15bfe5cc1ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:46.354336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564d44a-3856-4cce-a4de-e6adeebc67b2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:46.389813 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc56c5d-58d9-4713-b81d-295d0940fcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:46.390480 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc56c5d-58d9-4713-b81d-295d0940fcbb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:46.390760 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc56c5d-58d9-4713-b81d-295d0940fcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:46.391036 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc56c5d-58d9-4713-b81d-295d0940fcbb None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:46.391861 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc56c5d-58d9-4713-b81d-295d0940fcbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:46.392169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc56c5d-58d9-4713-b81d-295d0940fcbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:46.393734 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc56c5d-58d9-4713-b81d-295d0940fcbb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:46.407127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 444/865] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:46.412967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc56c5d-58d9-4713-b81d-295d0940fcbb None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:46.421797 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 422/866] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:46.444997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ffe77-5826-4068-a17b-15bfe5cc1ad3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:46.530099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc56c5d-58d9-4713-b81d-295d0940fcbb None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:46.564555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa8130-7027-4968-be98-a57f700e33df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:46.565205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa8130-7027-4968-be98-a57f700e33df None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:46.565490 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa8130-7027-4968-be98-a57f700e33df None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:46.565765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa8130-7027-4968-be98-a57f700e33df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:46.566194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ffe77-5826-4068-a17b-15bfe5cc1ad3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:46.566725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa8130-7027-4968-be98-a57f700e33df None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=957c3decfb19445d80836f767fa23bd7) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:46.567037 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa8130-7027-4968-be98-a57f700e33df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:46.568502 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa8130-7027-4968-be98-a57f700e33df None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:46.574818 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 445/867] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:46 2022] GET /identity/v3/role_assignments?user.id=957c3decfb19445d80836f767fa23bd7&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:46.611882 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980cfd4-a521-4760-bb8e-30985ff26808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:46.613100 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980cfd4-a521-4760-bb8e-30985ff26808 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:46.613518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980cfd4-a521-4760-bb8e-30985ff26808 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:46.613928 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980cfd4-a521-4760-bb8e-30985ff26808 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:46.614942 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980cfd4-a521-4760-bb8e-30985ff26808 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:46.617887 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980cfd4-a521-4760-bb8e-30985ff26808 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8980cfd4-a521-4760-bb8e-30985ff26808 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:46.633959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:46.635309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:46.636131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:46.636131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:46.636131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:46.636131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:46.636131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:46.636131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:46.636131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:46.636131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:46.636131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:46.636131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:46.636131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:46.636131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:46.636131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:46.636131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 21:50:46.636131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:46.636920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 423/868] 10.222.0.24 () {56 vars in 1132 bytes} [Tue May 17 21:50:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:46.642463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa8130-7027-4968-be98-a57f700e33df None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:46.774371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa8130-7027-4968-be98-a57f700e33df None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:46.809451 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c9f48-9f44-48c6-8aaa-a11451ee4ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:46.810117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c9f48-9f44-48c6-8aaa-a11451ee4ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:46.810511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c9f48-9f44-48c6-8aaa-a11451ee4ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:46.810876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c9f48-9f44-48c6-8aaa-a11451ee4ac3 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:46.811634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c9f48-9f44-48c6-8aaa-a11451ee4ac3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:46.811986 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c9f48-9f44-48c6-8aaa-a11451ee4ac3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:46.813361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c9f48-9f44-48c6-8aaa-a11451ee4ac3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:46.818222 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 446/869] 10.222.0.24 () {56 vars in 1126 bytes} [Tue May 17 21:50:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:46.823959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980cfd4-a521-4760-bb8e-30985ff26808 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:46.925793 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980cfd4-a521-4760-bb8e-30985ff26808 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:46.960728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e41c75-39ee-4d93-b161-0717365e0503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:46.961774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e41c75-39ee-4d93-b161-0717365e0503 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:46.962274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e41c75-39ee-4d93-b161-0717365e0503 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:46.962739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e41c75-39ee-4d93-b161-0717365e0503 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:46.963694 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e41c75-39ee-4d93-b161-0717365e0503 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:46.964217 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e41c75-39ee-4d93-b161-0717365e0503 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:46.965777 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e41c75-39ee-4d93-b161-0717365e0503 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:46.971222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 424/870] 10.222.0.24 () {56 vars in 1126 bytes} [Tue May 17 21:50:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:47.442024 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d13d19-0093-4427-a170-d45f2b996c38 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:47.442545 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d13d19-0093-4427-a170-d45f2b996c38 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:47.442652 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d13d19-0093-4427-a170-d45f2b996c38 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:47.444208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 447/871] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:47.450471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd628b6-7153-4110-9d08-5bf5374d4be8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:47.450908 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd628b6-7153-4110-9d08-5bf5374d4be8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:47.451085 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd628b6-7153-4110-9d08-5bf5374d4be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:47.468447 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fbd628b6-7153-4110-9d08-5bf5374d4be8 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:47.469630 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fbd628b6-7153-4110-9d08-5bf5374d4be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:47.540307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 425/872] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:50:47.562668 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d13d19-0093-4427-a170-d45f2b996c38 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:47.665022 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d13d19-0093-4427-a170-d45f2b996c38 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:47.699501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d866bc3-2aa1-442c-9098-04cd00c215d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:47.700143 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d866bc3-2aa1-442c-9098-04cd00c215d9 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:47.700470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d866bc3-2aa1-442c-9098-04cd00c215d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:47.700746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d866bc3-2aa1-442c-9098-04cd00c215d9 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:47.701468 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d866bc3-2aa1-442c-9098-04cd00c215d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:47.702821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d866bc3-2aa1-442c-9098-04cd00c215d9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:47.786619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 448/873] 10.222.0.24 () {60 vars in 1141 bytes} [Tue May 17 21:50:47 2022] POST /identity/v3/services => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:50:48.461221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb43fbd-e780-4585-9077-2605b8e0081f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:48.461906 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb43fbd-e780-4585-9077-2605b8e0081f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:48.461906 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb43fbd-e780-4585-9077-2605b8e0081f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:48.463531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 426/874] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:48.468715 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550c3fb-2c34-43e1-a34c-136945ca1650 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:48.469180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550c3fb-2c34-43e1-a34c-136945ca1650 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:48.469335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550c3fb-2c34-43e1-a34c-136945ca1650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:48.486647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c550c3fb-2c34-43e1-a34c-136945ca1650 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:48.487846 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c550c3fb-2c34-43e1-a34c-136945ca1650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:48.564909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 449/875] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:48.584931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb43fbd-e780-4585-9077-2605b8e0081f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:48.690366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb43fbd-e780-4585-9077-2605b8e0081f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:48.725371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb2cb1-2737-4cb3-9414-784ed8a80cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:48.726140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb2cb1-2737-4cb3-9414-784ed8a80cda None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:48.727580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb2cb1-2737-4cb3-9414-784ed8a80cda None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:48.727860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb2cb1-2737-4cb3-9414-784ed8a80cda None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:48.738142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb2cb1-2737-4cb3-9414-784ed8a80cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-7dfb2cb1-2737-4cb3-9414-784ed8a80cda None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:48.746389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:48.748525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:48.750518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:48.750518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:48.750518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:48.750518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:48.750518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:48.750518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:48.750518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:48.750518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:48.750518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:48.750518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:48.750518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 21:50:48.750518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:48.755135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 427/876] 10.222.0.24 () {56 vars in 1120 bytes} [Tue May 17 21:50:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:48.755345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550c3fb-2c34-43e1-a34c-136945ca1650 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:48.860733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550c3fb-2c34-43e1-a34c-136945ca1650 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:48.899253 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da397d0-01b1-4687-8e89-e7b60ac2e755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:48.900193 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da397d0-01b1-4687-8e89-e7b60ac2e755 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:48.900673 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da397d0-01b1-4687-8e89-e7b60ac2e755 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:48.901181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da397d0-01b1-4687-8e89-e7b60ac2e755 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:48.902157 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da397d0-01b1-4687-8e89-e7b60ac2e755 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:48.902659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da397d0-01b1-4687-8e89-e7b60ac2e755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:48.904278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da397d0-01b1-4687-8e89-e7b60ac2e755 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:48.917568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 450/877] 10.222.0.24 () {56 vars in 1115 bytes} [Tue May 17 21:50:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:48.919194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb2cb1-2737-4cb3-9414-784ed8a80cda None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:49.026520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb48a6-88de-49e4-b2a5-1ae81b8cd1a9 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:49.026836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb48a6-88de-49e4-b2a5-1ae81b8cd1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:49.026993 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb48a6-88de-49e4-b2a5-1ae81b8cd1a9 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:49.028501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 451/878] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:49.035153 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adf591-bbd7-4707-9f1b-a48c65ee3bbf None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:49.035153 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adf591-bbd7-4707-9f1b-a48c65ee3bbf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:49.035153 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adf591-bbd7-4707-9f1b-a48c65ee3bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:49.036636 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb2cb1-2737-4cb3-9414-784ed8a80cda None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:49.052651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-06adf591-bbd7-4707-9f1b-a48c65ee3bbf None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:49.054242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-06adf591-bbd7-4707-9f1b-a48c65ee3bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:49.074985 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c08ef-4f76-4e91-afeb-336a3824229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:49.075902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c08ef-4f76-4e91-afeb-336a3824229d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:49.076185 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c08ef-4f76-4e91-afeb-336a3824229d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:49.076463 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c08ef-4f76-4e91-afeb-336a3824229d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:49.089987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c08ef-4f76-4e91-afeb-336a3824229d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:49.091487 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c08ef-4f76-4e91-afeb-336a3824229d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:49.110169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a57c08ef-4f76-4e91-afeb-336a3824229d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:49.110169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:49.110169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:49.110169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:49.110169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:49.110169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:49.110169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:49.110169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:49.110169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:49.110169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:49.110169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:49.110169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:49.110169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:49.110169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:49.110169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:49.111095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:49.112000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:49.112000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:49.112000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:49.112000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:49.115187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 428/879] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:49.117850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c08ef-4f76-4e91-afeb-336a3824229d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:49.142690 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 452/880] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:50:49.173710 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adf591-bbd7-4707-9f1b-a48c65ee3bbf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:49.237682 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c08ef-4f76-4e91-afeb-336a3824229d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:49.272625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ffb93-fe5f-4b1d-94aa-48a2143cc8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:49.273878 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ffb93-fe5f-4b1d-94aa-48a2143cc8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:49.274163 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ffb93-fe5f-4b1d-94aa-48a2143cc8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:49.274438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ffb93-fe5f-4b1d-94aa-48a2143cc8a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:49.275186 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ffb93-fe5f-4b1d-94aa-48a2143cc8a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:49.275676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ffb93-fe5f-4b1d-94aa-48a2143cc8a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:49.277096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ffb93-fe5f-4b1d-94aa-48a2143cc8a5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:49.293129 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 429/881] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:49.293286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adf591-bbd7-4707-9f1b-a48c65ee3bbf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:49.293369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d3bae-8ce0-4a21-87e7-657a71712cf8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:49.293369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d3bae-8ce0-4a21-87e7-657a71712cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:49.293369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d3bae-8ce0-4a21-87e7-657a71712cf8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:49.293369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 430/882] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:49.296437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d3bae-8ce0-4a21-87e7-657a71712cf8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:49.328632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572bb05-142c-40e1-a323-58cfc5aa8d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:49.329426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572bb05-142c-40e1-a323-58cfc5aa8d26 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:49.329709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572bb05-142c-40e1-a323-58cfc5aa8d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:49.329982 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572bb05-142c-40e1-a323-58cfc5aa8d26 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:49.330793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572bb05-142c-40e1-a323-58cfc5aa8d26 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:49.332974 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572bb05-142c-40e1-a323-58cfc5aa8d26 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-8572bb05-142c-40e1-a323-58cfc5aa8d26 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:49.346500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:49.351404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:49.352264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:49.352264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:49.352264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:49.352264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:49.352264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:49.352264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:49.352264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:49.352264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:49.352264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:49.352264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:49.352264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:49.352264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:49.352264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 21:50:49.352264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:49.352264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 453/883] 10.222.0.24 () {56 vars in 1126 bytes} [Tue May 17 21:50:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:49.353038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710a2bb-ccf4-4bf1-a97a-d6874ea40747 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:49.353038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710a2bb-ccf4-4bf1-a97a-d6874ea40747 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:49.353038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710a2bb-ccf4-4bf1-a97a-d6874ea40747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:49.367904 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d710a2bb-ccf4-4bf1-a97a-d6874ea40747 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:49.369090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d710a2bb-ccf4-4bf1-a97a-d6874ea40747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:49.401563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d3bae-8ce0-4a21-87e7-657a71712cf8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:49.435084 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece602f-2df5-42ca-b249-c674e2eec9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:49.435604 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 454/884] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:49.436128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710a2bb-ccf4-4bf1-a97a-d6874ea40747 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:49.447912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece602f-2df5-42ca-b249-c674e2eec9db None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:49.448193 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece602f-2df5-42ca-b249-c674e2eec9db None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:49.448466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece602f-2df5-42ca-b249-c674e2eec9db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:49.457871 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece602f-2df5-42ca-b249-c674e2eec9db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:49.459377 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece602f-2df5-42ca-b249-c674e2eec9db None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6ece602f-2df5-42ca-b249-c674e2eec9db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:49.475061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:49.476661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:49.478115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:49.478115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:49.478115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:49.478115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:49.478115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:49.478115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:49.478115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:49.478115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:49.478115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 21:50:49.478115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:49.478115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 431/885] 10.222.0.24 () {56 vars in 1117 bytes} [Tue May 17 21:50:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:49.478115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece602f-2df5-42ca-b249-c674e2eec9db None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:49.547061 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710a2bb-ccf4-4bf1-a97a-d6874ea40747 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:49.581396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd0493-c7f9-4b89-9e13-3231696d44df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:49.581602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece602f-2df5-42ca-b249-c674e2eec9db None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:49.582064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd0493-c7f9-4b89-9e13-3231696d44df None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:49.582342 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd0493-c7f9-4b89-9e13-3231696d44df None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:49.582614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd0493-c7f9-4b89-9e13-3231696d44df None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:49.583344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd0493-c7f9-4b89-9e13-3231696d44df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:49.583649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd0493-c7f9-4b89-9e13-3231696d44df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:49.585013 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd0493-c7f9-4b89-9e13-3231696d44df None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:49.595743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 455/886] 10.222.0.24 () {56 vars in 1122 bytes} [Tue May 17 21:50:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:49.595743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd0493-c7f9-4b89-9e13-3231696d44df None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:49.626031 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc43393-ad9c-4ce1-9f8e-43612f929d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:49.626693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc43393-ad9c-4ce1-9f8e-43612f929d91 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:49.626977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc43393-ad9c-4ce1-9f8e-43612f929d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:49.627285 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc43393-ad9c-4ce1-9f8e-43612f929d91 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:49.628006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc43393-ad9c-4ce1-9f8e-43612f929d91 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:49.629369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc43393-ad9c-4ce1-9f8e-43612f929d91 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:49.696504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd0493-c7f9-4b89-9e13-3231696d44df None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:49.705393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 432/887] 10.222.0.24 () {60 vars in 1141 bytes} [Tue May 17 21:50:49 2022] POST /identity/v3/services => generated 269 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:50:49.706477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc43393-ad9c-4ce1-9f8e-43612f929d91 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:49.740177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e716d5-8faa-4037-82bd-3d4efa6fbe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:49.740864 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e716d5-8faa-4037-82bd-3d4efa6fbe7a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:49.741146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e716d5-8faa-4037-82bd-3d4efa6fbe7a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:49.741419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e716d5-8faa-4037-82bd-3d4efa6fbe7a None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:49.742333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e716d5-8faa-4037-82bd-3d4efa6fbe7a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:49.742727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e716d5-8faa-4037-82bd-3d4efa6fbe7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:49.744176 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e716d5-8faa-4037-82bd-3d4efa6fbe7a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:49.770203 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 456/888] 10.222.0.24 () {56 vars in 1149 bytes} [Tue May 17 21:50:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:49.771764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e716d5-8faa-4037-82bd-3d4efa6fbe7a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:49.848191 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc43393-ad9c-4ce1-9f8e-43612f929d91 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:49.891317 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b04256-9660-4fb2-867a-645cbcc30c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:49.892049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b04256-9660-4fb2-867a-645cbcc30c3c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:49.892335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b04256-9660-4fb2-867a-645cbcc30c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:49.892613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b04256-9660-4fb2-867a-645cbcc30c3c None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:49.893791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b04256-9660-4fb2-867a-645cbcc30c3c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:49.893791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b04256-9660-4fb2-867a-645cbcc30c3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:49.895037 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b04256-9660-4fb2-867a-645cbcc30c3c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:49.900615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 433/889] 10.222.0.24 () {56 vars in 1122 bytes} [Tue May 17 21:50:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:49.909321 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e716d5-8faa-4037-82bd-3d4efa6fbe7a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:49.963181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da116e-aea5-4739-88dc-ca5e9152ab9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:49.964184 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da116e-aea5-4739-88dc-ca5e9152ab9c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:49.964461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da116e-aea5-4739-88dc-ca5e9152ab9c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:49.964739 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da116e-aea5-4739-88dc-ca5e9152ab9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:50.045264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da116e-aea5-4739-88dc-ca5e9152ab9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:50.046753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da116e-aea5-4739-88dc-ca5e9152ab9c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:50.139372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db96956-3a7d-4cc7-bb47-2ec89579baa8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:50.139630 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db96956-3a7d-4cc7-bb47-2ec89579baa8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:50.139854 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db96956-3a7d-4cc7-bb47-2ec89579baa8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:50.141466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 434/890] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:50:50.146416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53351c6e-6a4e-473d-a204-bef52b9b5d00 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:50.146705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53351c6e-6a4e-473d-a204-bef52b9b5d00 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:50.146982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53351c6e-6a4e-473d-a204-bef52b9b5d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:50.151769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 457/891] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:49 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:50:50.156843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da116e-aea5-4739-88dc-ca5e9152ab9c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:50.164911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-53351c6e-6a4e-473d-a204-bef52b9b5d00 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:50.166093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-53351c6e-6a4e-473d-a204-bef52b9b5d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:50.234724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 435/892] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:50.256733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da116e-aea5-4739-88dc-ca5e9152ab9c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:50.256935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53351c6e-6a4e-473d-a204-bef52b9b5d00 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:50.292215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e90178-3add-44c8-94f2-a91025d232f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:50.293011 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e90178-3add-44c8-94f2-a91025d232f8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:50.293292 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e90178-3add-44c8-94f2-a91025d232f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:50.293572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e90178-3add-44c8-94f2-a91025d232f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:50.304720 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e90178-3add-44c8-94f2-a91025d232f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:50.306183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e90178-3add-44c8-94f2-a91025d232f8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:50.324113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-03e90178-3add-44c8-94f2-a91025d232f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:50.324113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:50.324113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:50.324113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:50.324113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:50.324113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:50.324113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:50.324113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:50.324113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:50.324113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:50.324113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:50.324113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:50.324113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:50.324113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:50.324113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:50.325058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:50.325936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:50.325936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:50.325936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:50.325936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:50.325936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 458/893] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:50.331139 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e90178-3add-44c8-94f2-a91025d232f8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:50.356658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53351c6e-6a4e-473d-a204-bef52b9b5d00 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:50.390457 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536053db-b893-4849-8c40-79a6e94210c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:50.391213 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536053db-b893-4849-8c40-79a6e94210c9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:50.391496 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536053db-b893-4849-8c40-79a6e94210c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:50.391767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536053db-b893-4849-8c40-79a6e94210c9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:50.392415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536053db-b893-4849-8c40-79a6e94210c9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:50.393770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536053db-b893-4849-8c40-79a6e94210c9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-536053db-b893-4849-8c40-79a6e94210c9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:50.406046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:50.408439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:50.410494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:50.410494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:50.410494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:50.410494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:50.410494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:50.410494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:50.410494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:50.410494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:50.410494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:50.410494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:50.410494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:50.410494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:50.410494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 21:50:50.410494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:50.412328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 436/894] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:50:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:50.415229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536053db-b893-4849-8c40-79a6e94210c9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:50.432112 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e90178-3add-44c8-94f2-a91025d232f8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:50.467915 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0f483-cf9a-4245-8878-63a05ca2eae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:50.468655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0f483-cf9a-4245-8878-63a05ca2eae0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:50.468901 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0f483-cf9a-4245-8878-63a05ca2eae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:50.469179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0f483-cf9a-4245-8878-63a05ca2eae0 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:50.469894 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0f483-cf9a-4245-8878-63a05ca2eae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:50.470242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0f483-cf9a-4245-8878-63a05ca2eae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:50.471585 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0f483-cf9a-4245-8878-63a05ca2eae0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:50.488219 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 459/895] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:50.489303 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0f483-cf9a-4245-8878-63a05ca2eae0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:50.536574 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536053db-b893-4849-8c40-79a6e94210c9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:50.576117 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50ed4d-117e-45e8-9b0c-ba870d3aab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:50.576900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50ed4d-117e-45e8-9b0c-ba870d3aab29 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:50.577254 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50ed4d-117e-45e8-9b0c-ba870d3aab29 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:50.577598 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50ed4d-117e-45e8-9b0c-ba870d3aab29 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:50.578381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50ed4d-117e-45e8-9b0c-ba870d3aab29 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:50.578854 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50ed4d-117e-45e8-9b0c-ba870d3aab29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:50.580229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50ed4d-117e-45e8-9b0c-ba870d3aab29 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:50.589515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 437/896] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:50:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:50.590723 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50ed4d-117e-45e8-9b0c-ba870d3aab29 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:50.601821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0f483-cf9a-4245-8878-63a05ca2eae0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:50.636208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c3fa1-ac7b-4cef-bd50-83d621dceddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:50.637099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c3fa1-ac7b-4cef-bd50-83d621dceddb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:50.637305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c3fa1-ac7b-4cef-bd50-83d621dceddb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:50.637539 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c3fa1-ac7b-4cef-bd50-83d621dceddb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:50.644578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c3fa1-ac7b-4cef-bd50-83d621dceddb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:50.645966 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c3fa1-ac7b-4cef-bd50-83d621dceddb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:50.660327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b48c3fa1-ac7b-4cef-bd50-83d621dceddb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:50.660327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:50.660327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:50.660327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:50.660327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:50.660327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:50.660327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:50.660327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:50.660327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:50.660327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:50.660327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:50.660327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:50.660327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:50.660327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:50.660327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:50.661232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:50.662111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:50.662111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:50.662111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:50.662111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:50.662111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:50.662111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:50.662111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:50.662111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:50.667136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 460/897] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:50.668037 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c3fa1-ac7b-4cef-bd50-83d621dceddb None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:50.700088 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50ed4d-117e-45e8-9b0c-ba870d3aab29 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:50.734505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0324f-20b2-4e53-ab8c-39a76d1e0593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:50.735588 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0324f-20b2-4e53-ab8c-39a76d1e0593 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:50.736070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0324f-20b2-4e53-ab8c-39a76d1e0593 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:50.736552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0324f-20b2-4e53-ab8c-39a76d1e0593 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:50.737448 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0324f-20b2-4e53-ab8c-39a76d1e0593 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:50.737959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0324f-20b2-4e53-ab8c-39a76d1e0593 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:50.739642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0324f-20b2-4e53-ab8c-39a76d1e0593 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:50.749648 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 438/898] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:50:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:50.750770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0324f-20b2-4e53-ab8c-39a76d1e0593 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:50.768380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c3fa1-ac7b-4cef-bd50-83d621dceddb None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:50.804117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d225d77-ac88-4607-a6a9-5e4972794e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:50.804869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d225d77-ac88-4607-a6a9-5e4972794e0b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:50.805151 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d225d77-ac88-4607-a6a9-5e4972794e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:50.805439 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d225d77-ac88-4607-a6a9-5e4972794e0b None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:50.806203 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d225d77-ac88-4607-a6a9-5e4972794e0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:50.806508 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d225d77-ac88-4607-a6a9-5e4972794e0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:50.807967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d225d77-ac88-4607-a6a9-5e4972794e0b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:50.825122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 461/899] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:50.831278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d225d77-ac88-4607-a6a9-5e4972794e0b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:50.854778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0324f-20b2-4e53-ab8c-39a76d1e0593 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:50.888299 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff66def-250c-4b4d-aa82-16fbe11f98b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:50.889254 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff66def-250c-4b4d-aa82-16fbe11f98b0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:50.889710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff66def-250c-4b4d-aa82-16fbe11f98b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:50.890177 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff66def-250c-4b4d-aa82-16fbe11f98b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:50.891159 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff66def-250c-4b4d-aa82-16fbe11f98b0 None admin] RBAC: Adding query filter params (interface=public, service_id=6f1c9e9820c9482b96f4c57f43ab6298, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:50.891667 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff66def-250c-4b4d-aa82-16fbe11f98b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:50.893200 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff66def-250c-4b4d-aa82-16fbe11f98b0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:50.904366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 439/900] 10.222.0.24 () {56 vars in 1251 bytes} [Tue May 17 21:50:50 2022] GET /identity/v3/endpoints?service_id=6f1c9e9820c9482b96f4c57f43ab6298&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:50.905607 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff66def-250c-4b4d-aa82-16fbe11f98b0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:50.927868 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d225d77-ac88-4607-a6a9-5e4972794e0b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:50.962841 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860d2c6-12d6-48ea-adfc-8127b81b1fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:50.963531 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860d2c6-12d6-48ea-adfc-8127b81b1fab None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:50.963816 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860d2c6-12d6-48ea-adfc-8127b81b1fab None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:50.964093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860d2c6-12d6-48ea-adfc-8127b81b1fab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:50.964963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860d2c6-12d6-48ea-adfc-8127b81b1fab None admin] RBAC: Adding query filter params (role.id=0b73cc84850242ada8c420aae30575ea, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=f6f7d26d4d434ad5a3abc45f8f05e4e9) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:50.965359 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860d2c6-12d6-48ea-adfc-8127b81b1fab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:50.967494 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860d2c6-12d6-48ea-adfc-8127b81b1fab None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:50.980149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 462/901] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:50:50 2022] GET /identity/v3/role_assignments?user.id=f6f7d26d4d434ad5a3abc45f8f05e4e9&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=0b73cc84850242ada8c420aae30575ea => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:51.013745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff66def-250c-4b4d-aa82-16fbe11f98b0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:51.052227 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ff5d6-53f8-4567-8936-220182e6f497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:51.053219 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ff5d6-53f8-4567-8936-220182e6f497 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:51.053676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ff5d6-53f8-4567-8936-220182e6f497 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:51.054145 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ff5d6-53f8-4567-8936-220182e6f497 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:51.055008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ff5d6-53f8-4567-8936-220182e6f497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:51.056618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ff5d6-53f8-4567-8936-220182e6f497 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:51.063547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 440/902] 10.222.0.24 () {56 vars in 1087 bytes} [Tue May 17 21:50:50 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 21:50:52.135611 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccf3c0-c3aa-432e-af65-baf416d3e858 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:52.136673 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccf3c0-c3aa-432e-af65-baf416d3e858 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:52.137205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccf3c0-c3aa-432e-af65-baf416d3e858 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:52.139180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 463/903] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:52.145002 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fc7cc-5ee9-4583-9c13-e41572996c1c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:52.145836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fc7cc-5ee9-4583-9c13-e41572996c1c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:52.146346 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fc7cc-5ee9-4583-9c13-e41572996c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:52.164133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3f6fc7cc-5ee9-4583-9c13-e41572996c1c None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:52.165784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3f6fc7cc-5ee9-4583-9c13-e41572996c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:52.203947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93602bf3-bcc8-4a0a-bd45-574fd36ff190 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:52.204566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93602bf3-bcc8-4a0a-bd45-574fd36ff190 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:52.205045 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93602bf3-bcc8-4a0a-bd45-574fd36ff190 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:52.206840 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 464/904] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:52.212228 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a644-f6cb-465b-8fc3-c5b250fa50f1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:52.212772 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a644-f6cb-465b-8fc3-c5b250fa50f1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:52.213256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a644-f6cb-465b-8fc3-c5b250fa50f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:52.230581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-90f5a644-f6cb-465b-8fc3-c5b250fa50f1 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:52.232143 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-90f5a644-f6cb-465b-8fc3-c5b250fa50f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:52.239626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 441/905] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:52.262451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fc7cc-5ee9-4583-9c13-e41572996c1c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:52.307366 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 465/906] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:52.324851 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5a644-f6cb-465b-8fc3-c5b250fa50f1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:52.365978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fc7cc-5ee9-4583-9c13-e41572996c1c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:52.400790 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e719481-a4ff-48ba-b3df-2eada24c189b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:52.401530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e719481-a4ff-48ba-b3df-2eada24c189b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:52.401814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e719481-a4ff-48ba-b3df-2eada24c189b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:52.402089 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e719481-a4ff-48ba-b3df-2eada24c189b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:52.402739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e719481-a4ff-48ba-b3df-2eada24c189b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:52.404310 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e719481-a4ff-48ba-b3df-2eada24c189b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1e719481-a4ff-48ba-b3df-2eada24c189b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:52.417055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:52.418149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:52.419001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:52.419001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:52.419001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:52.419001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:52.419001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:52.419001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:52.419001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:52.419001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:52.419001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:52.419001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:52.419001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:52.419001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:52.419001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:52.419001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 21:50:52.419001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:52.421533 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 442/907] 10.222.0.24 () {56 vars in 1132 bytes} [Tue May 17 21:50:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:52.427748 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e719481-a4ff-48ba-b3df-2eada24c189b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:52.434320 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5a644-f6cb-465b-8fc3-c5b250fa50f1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:52.475183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6cb00-a6e0-48c7-b5e8-ea391e6064e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:52.475883 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6cb00-a6e0-48c7-b5e8-ea391e6064e7 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:52.476221 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6cb00-a6e0-48c7-b5e8-ea391e6064e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:52.476785 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6cb00-a6e0-48c7-b5e8-ea391e6064e7 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:52.477509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6cb00-a6e0-48c7-b5e8-ea391e6064e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:52.479408 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6cb00-a6e0-48c7-b5e8-ea391e6064e7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:52.537736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e719481-a4ff-48ba-b3df-2eada24c189b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:52.567753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 466/908] 10.222.0.24 () {60 vars in 1141 bytes} [Tue May 17 21:50:52 2022] POST /identity/v3/services => generated 241 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:50:52.590758 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40fbd1-3422-4e41-ac8b-1c09044fa363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:52.591472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40fbd1-3422-4e41-ac8b-1c09044fa363 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:52.591756 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40fbd1-3422-4e41-ac8b-1c09044fa363 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:52.592033 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40fbd1-3422-4e41-ac8b-1c09044fa363 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:52.592756 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40fbd1-3422-4e41-ac8b-1c09044fa363 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:52.593065 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40fbd1-3422-4e41-ac8b-1c09044fa363 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:52.594652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40fbd1-3422-4e41-ac8b-1c09044fa363 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:52.600559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 443/909] 10.222.0.24 () {56 vars in 1126 bytes} [Tue May 17 21:50:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:52.606994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6cb00-a6e0-48c7-b5e8-ea391e6064e7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:52.720914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6cb00-a6e0-48c7-b5e8-ea391e6064e7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:52.758928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc73d46-b956-4344-8add-7092be1614a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:52.759643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc73d46-b956-4344-8add-7092be1614a1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:52.759929 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc73d46-b956-4344-8add-7092be1614a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:52.760206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc73d46-b956-4344-8add-7092be1614a1 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:52.760931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc73d46-b956-4344-8add-7092be1614a1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:52.761237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc73d46-b956-4344-8add-7092be1614a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:52.762629 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc73d46-b956-4344-8add-7092be1614a1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:52.768727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 467/910] 10.222.0.24 () {56 vars in 1126 bytes} [Tue May 17 21:50:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:52.775791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40fbd1-3422-4e41-ac8b-1c09044fa363 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:52.880699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40fbd1-3422-4e41-ac8b-1c09044fa363 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:52.916572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4adb1-e2d5-4f8a-9ad6-0970872a7e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:52.917302 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4adb1-e2d5-4f8a-9ad6-0970872a7e0b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:52.917591 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4adb1-e2d5-4f8a-9ad6-0970872a7e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:52.917869 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4adb1-e2d5-4f8a-9ad6-0970872a7e0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:52.918660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4adb1-e2d5-4f8a-9ad6-0970872a7e0b None admin] RBAC: Adding query filter params (interface=public, service_id=8551ef2bd8fb4a25ac32ad0da5319402, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:52.918974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4adb1-e2d5-4f8a-9ad6-0970872a7e0b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:52.920366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4adb1-e2d5-4f8a-9ad6-0970872a7e0b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:52.925996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 444/911] 10.222.0.24 () {56 vars in 1251 bytes} [Tue May 17 21:50:52 2022] GET /identity/v3/endpoints?service_id=8551ef2bd8fb4a25ac32ad0da5319402&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:52.931857 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc73d46-b956-4344-8add-7092be1614a1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:53.031390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc73d46-b956-4344-8add-7092be1614a1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:53.069462 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66809597-15e6-4837-85b3-bd9673beb07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:53.070663 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66809597-15e6-4837-85b3-bd9673beb07a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:53.070947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66809597-15e6-4837-85b3-bd9673beb07a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:53.071450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66809597-15e6-4837-85b3-bd9673beb07a None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:53.072270 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66809597-15e6-4837-85b3-bd9673beb07a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:53.073738 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66809597-15e6-4837-85b3-bd9673beb07a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:53.080821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 468/912] 10.222.0.24 () {56 vars in 1087 bytes} [Tue May 17 21:50:52 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 21:50:53.280149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f2c9d-8b6a-4751-a4b3-6532b5f6eed3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:53.281166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f2c9d-8b6a-4751-a4b3-6532b5f6eed3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:53.281724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f2c9d-8b6a-4751-a4b3-6532b5f6eed3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:53.283594 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 445/913] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:53.289287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b845a54-f1a9-40bd-91d6-85c8f9e2e23b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:53.289726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b845a54-f1a9-40bd-91d6-85c8f9e2e23b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:53.289922 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b845a54-f1a9-40bd-91d6-85c8f9e2e23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:53.307060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9627c-c100-474b-96d6-6e4c98aeb997 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:53.307446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9627c-c100-474b-96d6-6e4c98aeb997 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:53.307652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9627c-c100-474b-96d6-6e4c98aeb997 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:53.308505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4b845a54-f1a9-40bd-91d6-85c8f9e2e23b None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:53.309273 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 446/914] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:50:53.310178 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4b845a54-f1a9-40bd-91d6-85c8f9e2e23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:53.313993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07369b-fb8d-4dd6-9387-1acd00c5eff9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:53.314387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07369b-fb8d-4dd6-9387-1acd00c5eff9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:53.314769 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07369b-fb8d-4dd6-9387-1acd00c5eff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:53.331968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0d07369b-fb8d-4dd6-9387-1acd00c5eff9 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:53.333306 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0d07369b-fb8d-4dd6-9387-1acd00c5eff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:53.380064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 469/915] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:53.404594 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b845a54-f1a9-40bd-91d6-85c8f9e2e23b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:53.409034 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 447/916] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:50:53.434613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07369b-fb8d-4dd6-9387-1acd00c5eff9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:53.508529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b845a54-f1a9-40bd-91d6-85c8f9e2e23b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:53.537905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07369b-fb8d-4dd6-9387-1acd00c5eff9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:53.543650 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddaca5-8bc6-4e5a-aa0c-c9817a8c2c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:53.544460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddaca5-8bc6-4e5a-aa0c-c9817a8c2c60 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:53.544739 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddaca5-8bc6-4e5a-aa0c-c9817a8c2c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:53.545011 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddaca5-8bc6-4e5a-aa0c-c9817a8c2c60 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:53.555926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddaca5-8bc6-4e5a-aa0c-c9817a8c2c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-02ddaca5-8bc6-4e5a-aa0c-c9817a8c2c60 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:53.564088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:53.565012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:53.566233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:53.566233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:53.566233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:53.566233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:53.566233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:53.566233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:53.566233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:53.566233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:53.566233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:53.566233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:53.566233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 21:50:53.566233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:53.566233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 470/917] 10.222.0.24 () {56 vars in 1120 bytes} [Tue May 17 21:50:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:53.572025 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddaca5-8bc6-4e5a-aa0c-c9817a8c2c60 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:53.574722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fb106-738e-472f-a2c6-a09cc14146a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:53.575557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fb106-738e-472f-a2c6-a09cc14146a3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:53.575903 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fb106-738e-472f-a2c6-a09cc14146a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:53.576234 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fb106-738e-472f-a2c6-a09cc14146a3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:53.576901 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fb106-738e-472f-a2c6-a09cc14146a3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:53.578324 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fb106-738e-472f-a2c6-a09cc14146a3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d84fb106-738e-472f-a2c6-a09cc14146a3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:53.590968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:53.593363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:53.595478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:53.595478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:53.595478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:53.595478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:53.595478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:53.595478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:53.595478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:53.595478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:53.595478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:53.595478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:53.595478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:53.595478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:53.595478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 21:50:53.595478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:53.595478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 448/918] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:50:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:53.599515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fb106-738e-472f-a2c6-a09cc14146a3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:53.679966 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddaca5-8bc6-4e5a-aa0c-c9817a8c2c60 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:53.713141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e07f0-9181-45b2-ad43-77602d9001db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:53.713816 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e07f0-9181-45b2-ad43-77602d9001db None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:53.714097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e07f0-9181-45b2-ad43-77602d9001db None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:53.714371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e07f0-9181-45b2-ad43-77602d9001db None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:53.715150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e07f0-9181-45b2-ad43-77602d9001db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:53.715463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e07f0-9181-45b2-ad43-77602d9001db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:53.716055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fb106-738e-472f-a2c6-a09cc14146a3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:53.716899 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e07f0-9181-45b2-ad43-77602d9001db None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:53.725568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 471/919] 10.222.0.24 () {56 vars in 1115 bytes} [Tue May 17 21:50:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:53.732590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e07f0-9181-45b2-ad43-77602d9001db None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:53.755548 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78e86e-48c3-44a7-9508-7f6de0bffa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:53.756261 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78e86e-48c3-44a7-9508-7f6de0bffa9a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:53.756546 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78e86e-48c3-44a7-9508-7f6de0bffa9a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:53.756822 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78e86e-48c3-44a7-9508-7f6de0bffa9a None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:53.757575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78e86e-48c3-44a7-9508-7f6de0bffa9a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:53.757879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78e86e-48c3-44a7-9508-7f6de0bffa9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:53.759335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78e86e-48c3-44a7-9508-7f6de0bffa9a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:53.767483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 449/920] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:50:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:53.769769 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78e86e-48c3-44a7-9508-7f6de0bffa9a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:53.850061 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e07f0-9181-45b2-ad43-77602d9001db None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:53.882367 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78e86e-48c3-44a7-9508-7f6de0bffa9a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:53.894135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b211e-b217-4f3c-956d-e04b3d18ab44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:53.894135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b211e-b217-4f3c-956d-e04b3d18ab44 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:53.894135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b211e-b217-4f3c-956d-e04b3d18ab44 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:53.894135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b211e-b217-4f3c-956d-e04b3d18ab44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:53.902685 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b211e-b217-4f3c-956d-e04b3d18ab44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:53.904181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b211e-b217-4f3c-956d-e04b3d18ab44 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:53.917975 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77406de1-2baf-4049-b650-d26dc503e062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:53.918632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77406de1-2baf-4049-b650-d26dc503e062 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:53.918911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77406de1-2baf-4049-b650-d26dc503e062 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:53.919273 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77406de1-2baf-4049-b650-d26dc503e062 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:53.919986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77406de1-2baf-4049-b650-d26dc503e062 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:53.920287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77406de1-2baf-4049-b650-d26dc503e062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:53.921739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77406de1-2baf-4049-b650-d26dc503e062 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:53.923434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-6d8b211e-b217-4f3c-956d-e04b3d18ab44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:53.923434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:53.923434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:53.923434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:53.923434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:53.923434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:53.923434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:53.923434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:53.923434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:53.923434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:53.923434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:53.923434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:53.923434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:53.923434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:53.923434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:53.924487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:53.925584 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:53.925584 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:53.925584 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:53.925584 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:53.927312 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 450/921] 10.222.0.24 () {56 vars in 1114 bytes} [Tue May 17 21:50:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:53.927618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 472/922] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:53.938680 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b211e-b217-4f3c-956d-e04b3d18ab44 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:53.938944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77406de1-2baf-4049-b650-d26dc503e062 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:54.045940 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b211e-b217-4f3c-956d-e04b3d18ab44 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:54.058916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77406de1-2baf-4049-b650-d26dc503e062 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:54.084103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d79109-2a71-4703-8644-1bf9de71ae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:54.085019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d79109-2a71-4703-8644-1bf9de71ae71 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:54.085516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d79109-2a71-4703-8644-1bf9de71ae71 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:54.085974 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d79109-2a71-4703-8644-1bf9de71ae71 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:54.086860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d79109-2a71-4703-8644-1bf9de71ae71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:54.087371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d79109-2a71-4703-8644-1bf9de71ae71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:54.088935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d79109-2a71-4703-8644-1bf9de71ae71 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:54.093997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cf2a4-bd62-4bba-ac6f-7e52a387f300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:54.094851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cf2a4-bd62-4bba-ac6f-7e52a387f300 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:54.095321 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cf2a4-bd62-4bba-ac6f-7e52a387f300 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:54.095754 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cf2a4-bd62-4bba-ac6f-7e52a387f300 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:54.096723 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cf2a4-bd62-4bba-ac6f-7e52a387f300 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:54.098203 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cf2a4-bd62-4bba-ac6f-7e52a387f300 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:54.107056 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 473/923] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:54.108168 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d79109-2a71-4703-8644-1bf9de71ae71 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:54.196314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 451/924] 10.222.0.24 () {60 vars in 1144 bytes} [Tue May 17 21:50:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:50:54.217086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d79109-2a71-4703-8644-1bf9de71ae71 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:54.262435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcffde6-e908-4f52-bacd-dba2927ae777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:54.263287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcffde6-e908-4f52-bacd-dba2927ae777 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:54.263628 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcffde6-e908-4f52-bacd-dba2927ae777 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:54.263914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcffde6-e908-4f52-bacd-dba2927ae777 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:54.272157 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcffde6-e908-4f52-bacd-dba2927ae777 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:54.273753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcffde6-e908-4f52-bacd-dba2927ae777 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3dcffde6-e908-4f52-bacd-dba2927ae777 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:54.291563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:54.293032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:54.293957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:54.293957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:54.293957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:54.293957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:54.293957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:54.293957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:54.293957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:54.293957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:54.293957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 21:50:54.293957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:54.293957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 474/925] 10.222.0.24 () {56 vars in 1117 bytes} [Tue May 17 21:50:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:54.301427 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cf2a4-bd62-4bba-ac6f-7e52a387f300 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:54.419905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cf2a4-bd62-4bba-ac6f-7e52a387f300 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:54.458986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2f36b-11eb-4052-a315-c063200b8f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:54.460078 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2f36b-11eb-4052-a315-c063200b8f54 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:54.460628 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2f36b-11eb-4052-a315-c063200b8f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:54.461219 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2f36b-11eb-4052-a315-c063200b8f54 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:54.462271 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2f36b-11eb-4052-a315-c063200b8f54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:54.462797 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2f36b-11eb-4052-a315-c063200b8f54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:54.464502 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2f36b-11eb-4052-a315-c063200b8f54 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:54.483716 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 452/926] 10.222.0.24 () {56 vars in 1149 bytes} [Tue May 17 21:50:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:54.489475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcffde6-e908-4f52-bacd-dba2927ae777 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:54.592636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcffde6-e908-4f52-bacd-dba2927ae777 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:54.627507 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30849ff-b82f-4f28-b4e0-f65123ac3d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:54.628653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30849ff-b82f-4f28-b4e0-f65123ac3d73 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:54.629141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30849ff-b82f-4f28-b4e0-f65123ac3d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:54.629646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30849ff-b82f-4f28-b4e0-f65123ac3d73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:54.640166 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30849ff-b82f-4f28-b4e0-f65123ac3d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:54.641886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30849ff-b82f-4f28-b4e0-f65123ac3d73 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:54.660728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-c30849ff-b82f-4f28-b4e0-f65123ac3d73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:54.660728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:54.660728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:54.660728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:54.660728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:54.660728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:54.660728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:54.660728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:54.660728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:54.660728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:54.660728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:54.660728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:54.660728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:54.660728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:54.660728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:54.661718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:54.662603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:54.662603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:54.662603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:54.662603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:54.665297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 475/927] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:54.671203 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2f36b-11eb-4052-a315-c063200b8f54 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:54.777206 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2f36b-11eb-4052-a315-c063200b8f54 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:54.818353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440e238-e1d8-4fb8-82b3-e85feec1b7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:54.819030 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440e238-e1d8-4fb8-82b3-e85feec1b7be None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:54.819347 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440e238-e1d8-4fb8-82b3-e85feec1b7be None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:54.819686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440e238-e1d8-4fb8-82b3-e85feec1b7be None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:54.820486 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440e238-e1d8-4fb8-82b3-e85feec1b7be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:54.820799 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440e238-e1d8-4fb8-82b3-e85feec1b7be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:54.822171 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440e238-e1d8-4fb8-82b3-e85feec1b7be None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:54.836182 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 453/928] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:54.842111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30849ff-b82f-4f28-b4e0-f65123ac3d73 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:54.947953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a88cd2-48e2-454c-b397-14cba828c56f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:54.948150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a88cd2-48e2-454c-b397-14cba828c56f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:54.948428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a88cd2-48e2-454c-b397-14cba828c56f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:54.953859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 454/929] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:54.955623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fba32b-9300-445c-8017-f2a0ff8f25fb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:54.955917 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fba32b-9300-445c-8017-f2a0ff8f25fb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:54.956199 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fba32b-9300-445c-8017-f2a0ff8f25fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:54.959309 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30849ff-b82f-4f28-b4e0-f65123ac3d73 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:54.977945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d0fba32b-9300-445c-8017-f2a0ff8f25fb None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:54.979501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d0fba32b-9300-445c-8017-f2a0ff8f25fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:54.994097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea238df5-87d1-4fb6-8dac-5ee229a96d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:54.995210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea238df5-87d1-4fb6-8dac-5ee229a96d02 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:54.995210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea238df5-87d1-4fb6-8dac-5ee229a96d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:54.995506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea238df5-87d1-4fb6-8dac-5ee229a96d02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:55.002384 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea238df5-87d1-4fb6-8dac-5ee229a96d02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:55.003773 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea238df5-87d1-4fb6-8dac-5ee229a96d02 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:55.018295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ea238df5-87d1-4fb6-8dac-5ee229a96d02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:55.018295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:55.018295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:55.018295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:55.018295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:55.018295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:55.018295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:55.018295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:55.018295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:55.018295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:55.018295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:55.018295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:55.018295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:55.018295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:55.018295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:55.019264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:55.020148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:55.020148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:55.020148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:55.020148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:55.020148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:55.020148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:55.020148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:55.020148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:55.020148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 476/930] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:55.025409 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea238df5-87d1-4fb6-8dac-5ee229a96d02 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:55.057785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 455/931] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:55.080058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fba32b-9300-445c-8017-f2a0ff8f25fb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:55.129798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea238df5-87d1-4fb6-8dac-5ee229a96d02 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:55.164923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb7c57-debb-4214-8e16-7d2dd85b5de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:55.165947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb7c57-debb-4214-8e16-7d2dd85b5de1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:55.165947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb7c57-debb-4214-8e16-7d2dd85b5de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:55.166237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb7c57-debb-4214-8e16-7d2dd85b5de1 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:55.166960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb7c57-debb-4214-8e16-7d2dd85b5de1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:55.167301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb7c57-debb-4214-8e16-7d2dd85b5de1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:55.168818 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb7c57-debb-4214-8e16-7d2dd85b5de1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:55.186506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 477/932] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:50:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:55.187411 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb7c57-debb-4214-8e16-7d2dd85b5de1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:55.192647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fba32b-9300-445c-8017-f2a0ff8f25fb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:55.231945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62838da-de44-4428-9cf3-6010be7ec9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:55.234002 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62838da-de44-4428-9cf3-6010be7ec9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:55.234512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62838da-de44-4428-9cf3-6010be7ec9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:55.235008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62838da-de44-4428-9cf3-6010be7ec9c9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:55.235932 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62838da-de44-4428-9cf3-6010be7ec9c9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:55.237558 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62838da-de44-4428-9cf3-6010be7ec9c9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e62838da-de44-4428-9cf3-6010be7ec9c9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:55.250513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:55.251633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:55.252444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:55.252444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:55.252444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:55.252444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:55.252444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:55.252444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:55.252444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:55.252444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:55.252444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:55.252444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:55.252444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:55.252444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:55.252444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 21:50:55.252444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:55.255277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 456/933] 10.222.0.24 () {56 vars in 1126 bytes} [Tue May 17 21:50:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:55.267149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62838da-de44-4428-9cf3-6010be7ec9c9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:55.295740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb7c57-debb-4214-8e16-7d2dd85b5de1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:55.330801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfff29d-61ab-475a-8b70-58a9b8a6cdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:55.332004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfff29d-61ab-475a-8b70-58a9b8a6cdfd None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:55.332483 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfff29d-61ab-475a-8b70-58a9b8a6cdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:55.332902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfff29d-61ab-475a-8b70-58a9b8a6cdfd None admin] PATH_INFO: `/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/f6f7d26d4d434ad5a3abc45f8f05e4e9/roles/0b73cc84850242ada8c420aae30575ea` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:55.335428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfff29d-61ab-475a-8b70-58a9b8a6cdfd None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e90e91d3094e67b09b2b8137f210f4, user_id=f6f7d26d4d434ad5a3abc45f8f05e4e9, role_id=0b73cc84850242ada8c420aae30575ea)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:55.337055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfff29d-61ab-475a-8b70-58a9b8a6cdfd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:55.373928 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62838da-de44-4428-9cf3-6010be7ec9c9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:55.407147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba63e89-68ea-43df-a3eb-015d3970a62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:55.407825 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba63e89-68ea-43df-a3eb-015d3970a62b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:55.408106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba63e89-68ea-43df-a3eb-015d3970a62b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:55.408380 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba63e89-68ea-43df-a3eb-015d3970a62b None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:55.409079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba63e89-68ea-43df-a3eb-015d3970a62b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:55.409382 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba63e89-68ea-43df-a3eb-015d3970a62b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:55.415144 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba63e89-68ea-43df-a3eb-015d3970a62b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:55.415675 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 457/935] 10.222.0.24 () {56 vars in 1122 bytes} [Tue May 17 21:50:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:55.415921 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 478/935] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:50:55 2022] PUT /identity/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/f6f7d26d4d434ad5a3abc45f8f05e4e9/roles/0b73cc84850242ada8c420aae30575ea => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:50:55.416990 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4835a-79f4-42f1-876f-8ce0089e6704 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:55.417280 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4835a-79f4-42f1-876f-8ce0089e6704 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:55.417558 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4835a-79f4-42f1-876f-8ce0089e6704 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:55.419084 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 458/936] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:55.421704 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfff29d-61ab-475a-8b70-58a9b8a6cdfd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:55.426638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164e201-bf41-4f5e-94cc-3534841867ae None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:55.427383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164e201-bf41-4f5e-94cc-3534841867ae None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:55.427891 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164e201-bf41-4f5e-94cc-3534841867ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:55.447841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6164e201-bf41-4f5e-94cc-3534841867ae None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:55.449465 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6164e201-bf41-4f5e-94cc-3534841867ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:55.539258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 459/937] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:50:55.553826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfff29d-61ab-475a-8b70-58a9b8a6cdfd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:55.564097 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164e201-bf41-4f5e-94cc-3534841867ae None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:55.602556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeecf4b-d1f6-469c-80b2-187c5f6fae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:55.603697 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeecf4b-d1f6-469c-80b2-187c5f6fae75 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:55.605021 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeecf4b-d1f6-469c-80b2-187c5f6fae75 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:55.605477 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeecf4b-d1f6-469c-80b2-187c5f6fae75 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:55.606342 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeecf4b-d1f6-469c-80b2-187c5f6fae75 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:55.606803 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeecf4b-d1f6-469c-80b2-187c5f6fae75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:55.608361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeecf4b-d1f6-469c-80b2-187c5f6fae75 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:55.614509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 479/938] 10.222.0.24 () {56 vars in 1122 bytes} [Tue May 17 21:50:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:55.623065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeecf4b-d1f6-469c-80b2-187c5f6fae75 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:55.695612 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164e201-bf41-4f5e-94cc-3534841867ae None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:55.732881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad8312-cfba-4bd7-a26b-42a4b88cc712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:55.734089 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad8312-cfba-4bd7-a26b-42a4b88cc712 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:55.734597 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad8312-cfba-4bd7-a26b-42a4b88cc712 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:55.735092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad8312-cfba-4bd7-a26b-42a4b88cc712 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:55.736040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad8312-cfba-4bd7-a26b-42a4b88cc712 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:55.737634 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad8312-cfba-4bd7-a26b-42a4b88cc712 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:55.738066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeecf4b-d1f6-469c-80b2-187c5f6fae75 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e8ad8312-cfba-4bd7-a26b-42a4b88cc712 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:55.751473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:55.752452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:55.753279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:55.753279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:55.753279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:55.753279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:55.753279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:55.753279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:55.753279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:55.753279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:55.753279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:55.753279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:55.753279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:55.753279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:55.753279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:55.753279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 21:50:55.753279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:55.756745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 460/939] 10.222.0.24 () {56 vars in 1132 bytes} [Tue May 17 21:50:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:55.764677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad8312-cfba-4bd7-a26b-42a4b88cc712 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:55.778508 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282a9d5-e039-4b00-b182-26f5b25d7468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:55.779132 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282a9d5-e039-4b00-b182-26f5b25d7468 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:55.779431 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282a9d5-e039-4b00-b182-26f5b25d7468 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:55.779706 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282a9d5-e039-4b00-b182-26f5b25d7468 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:55.780494 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282a9d5-e039-4b00-b182-26f5b25d7468 None admin] RBAC: Adding query filter params (interface=public, service_id=7f23a28a0cc84eb79be7b97ab917c885, region_id=RegionOne) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:55.780803 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282a9d5-e039-4b00-b182-26f5b25d7468 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:55.782452 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282a9d5-e039-4b00-b182-26f5b25d7468 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:55.787595 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 480/940] 10.222.0.24 () {56 vars in 1251 bytes} [Tue May 17 21:50:55 2022] GET /identity/v3/endpoints?service_id=7f23a28a0cc84eb79be7b97ab917c885&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:55.793371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282a9d5-e039-4b00-b182-26f5b25d7468 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:55.878602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad8312-cfba-4bd7-a26b-42a4b88cc712 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:55.915007 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296e10b-b422-4c4c-8f47-a9755366c883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:55.915701 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296e10b-b422-4c4c-8f47-a9755366c883 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:55.915984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296e10b-b422-4c4c-8f47-a9755366c883 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:55.916255 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296e10b-b422-4c4c-8f47-a9755366c883 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:55.916958 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296e10b-b422-4c4c-8f47-a9755366c883 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:55.917263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296e10b-b422-4c4c-8f47-a9755366c883 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:55.918623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3296e10b-b422-4c4c-8f47-a9755366c883 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:55.927356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 461/941] 10.222.0.24 () {56 vars in 1126 bytes} [Tue May 17 21:50:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:55.929322 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282a9d5-e039-4b00-b182-26f5b25d7468 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:55.930340 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296e10b-b422-4c4c-8f47-a9755366c883 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:55.973397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfeb5f-b553-4190-be7b-8e147c551b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:55.974079 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfeb5f-b553-4190-be7b-8e147c551b6a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:55.974683 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfeb5f-b553-4190-be7b-8e147c551b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:55.974965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfeb5f-b553-4190-be7b-8e147c551b6a None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:55.976555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfeb5f-b553-4190-be7b-8e147c551b6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:55.978127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfeb5f-b553-4190-be7b-8e147c551b6a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:55.991333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 481/942] 10.222.0.24 () {56 vars in 1087 bytes} [Tue May 17 21:50:55 2022] GET /identity/v3/services => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 21:50:56.040642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296e10b-b422-4c4c-8f47-a9755366c883 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:56.077762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f798c-3ac0-45cc-a629-ced45e155d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:56.078355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f798c-3ac0-45cc-a629-ced45e155d70 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:56.078646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f798c-3ac0-45cc-a629-ced45e155d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:56.078921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f798c-3ac0-45cc-a629-ced45e155d70 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:56.079692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f798c-3ac0-45cc-a629-ced45e155d70 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:56.080001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f798c-3ac0-45cc-a629-ced45e155d70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:56.081388 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f798c-3ac0-45cc-a629-ced45e155d70 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:56.091546 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 462/943] 10.222.0.24 () {56 vars in 1126 bytes} [Tue May 17 21:50:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:56.093212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfeb5f-b553-4190-be7b-8e147c551b6a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:56.203221 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfeb5f-b553-4190-be7b-8e147c551b6a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:56.240394 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670ea89-5f1a-4ce0-b46e-b2be8d716642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:56.241055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ea89-5f1a-4ce0-b46e-b2be8d716642 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:56.241338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ea89-5f1a-4ce0-b46e-b2be8d716642 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:56.244037 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ea89-5f1a-4ce0-b46e-b2be8d716642 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:56.244812 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670ea89-5f1a-4ce0-b46e-b2be8d716642 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:56.246198 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670ea89-5f1a-4ce0-b46e-b2be8d716642 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:56.335692 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 482/944] 10.222.0.24 () {60 vars in 1144 bytes} [Tue May 17 21:50:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:50:56.674394 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbde13-6932-42dd-aba4-c3ae33c0a146 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:56.675063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbde13-6932-42dd-aba4-c3ae33c0a146 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:56.675063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbde13-6932-42dd-aba4-c3ae33c0a146 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:56.676794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 463/945] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:56.682526 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ea8d6-213f-4169-b433-dbe4bba1734c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:56.682823 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ea8d6-213f-4169-b433-dbe4bba1734c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:56.683125 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ea8d6-213f-4169-b433-dbe4bba1734c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:56.699854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-527ea8d6-213f-4169-b433-dbe4bba1734c None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:56.701026 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-527ea8d6-213f-4169-b433-dbe4bba1734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:56.775693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 483/946] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:56.799476 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbde13-6932-42dd-aba4-c3ae33c0a146 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:56.910963 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbde13-6932-42dd-aba4-c3ae33c0a146 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:56.945855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834762dd-9d64-428e-84bb-af409c340207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:56.946447 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834762dd-9d64-428e-84bb-af409c340207 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:56.946731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834762dd-9d64-428e-84bb-af409c340207 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:56.947002 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834762dd-9d64-428e-84bb-af409c340207 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:56.947753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834762dd-9d64-428e-84bb-af409c340207 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:56.949257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834762dd-9d64-428e-84bb-af409c340207 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:56.950626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: WARNING keystone.server.flask.common [None req-834762dd-9d64-428e-84bb-af409c340207 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 17 21:50:57.011505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.sql.core [None req-834762dd-9d64-428e-84bb-af409c340207 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 21:50:57.011505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 17 21:50:57.011505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [parameters: {'id': 'e5ae073e15d04a5c8ffb76bab926f47d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 17 21:50:57.011505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80135) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 21:50:57.029392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-834762dd-9d64-428e-84bb-af409c340207 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e5ae073e15d04a5c8ffb76bab926f47d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e5ae073e15d04a5c8ffb76bab926f47d. May 17 21:50:57.029392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:57.029392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 21:50:57.029392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 21:50:57.029392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 21:50:57.029392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 21:50:57.029392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 21:50:57.029392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) May 17 21:50:57.029392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 21:50:57.029392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) May 17 21:50:57.029392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 21:50:57.029392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 21:50:57.029392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 17 21:50:57.030202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return project_ref.to_dict() May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application yield resource May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.rollback() May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.force_reraise() May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise self.value May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application session.commit() May 17 21:50:57.031610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._prepare_impl() May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.flush() May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._flush(objects) May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application compat.raise_( May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application flush_context.execute() May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 21:50:57.034069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rec.execute(self) May 17 21:50:57.036450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 21:50:57.036450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 21:50:57.036450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 21:50:57.036450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 21:50:57.036450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 17 21:50:57.036450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application c = connection._execute_20( May 17 21:50:57.036450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 21:50:57.036450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 21:50:57.036450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 21:50:57.036450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 21:50:57.036450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 21:50:57.036450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 21:50:57.036450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 21:50:57.036450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 21:50:57.036450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 21:50:57.039072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 21:50:57.048187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 21:50:57.048187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 21:50:57.048187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 21:50:57.048187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 21:50:57.048187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 21:50:57.048187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 21:50:57.048187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 21:50:57.048187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 17 21:50:57.048187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [parameters: {'id': 'e5ae073e15d04a5c8ffb76bab926f47d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 17 21:50:57.048187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 21:50:57.048187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:57.048187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:57.048187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:57.048187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:57.048187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:57.049137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:57.050344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:57.050344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 17 21:50:57.050344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 17 21:50:57.050344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:57.050344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:57.050344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 17 21:50:57.050344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.Conflict( May 17 21:50:57.050344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e5ae073e15d04a5c8ffb76bab926f47d. May 17 21:50:57.050344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:57.050344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 464/947] 10.222.0.24 () {60 vars in 1140 bytes} [Tue May 17 21:50:56 2022] POST /identity/v3/projects => generated 262 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:57.051831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ea8d6-213f-4169-b433-dbe4bba1734c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:57.141403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ea8d6-213f-4169-b433-dbe4bba1734c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:57.177322 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25119d-bf8b-4c2c-a5bf-3fa58e63278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:57.178152 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25119d-bf8b-4c2c-a5bf-3fa58e63278e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:57.178431 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25119d-bf8b-4c2c-a5bf-3fa58e63278e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:57.178706 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25119d-bf8b-4c2c-a5bf-3fa58e63278e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:57.187402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25119d-bf8b-4c2c-a5bf-3fa58e63278e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:57.188898 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25119d-bf8b-4c2c-a5bf-3fa58e63278e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:57.204589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ad25119d-bf8b-4c2c-a5bf-3fa58e63278e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:57.204589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:57.204589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:57.204589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:57.204589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:57.204589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:57.204589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:57.204589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:57.204589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:57.204589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:57.204589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:57.204589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:57.204589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:50:57.204589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:50:57.204589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:57.206870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:57.208020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:50:57.208020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:50:57.208020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:50:57.208020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:50:57.208020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:50:57.208020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:50:57.208020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:50:57.208020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:57.208020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 484/948] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:57.212315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834762dd-9d64-428e-84bb-af409c340207 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:57.314941 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834762dd-9d64-428e-84bb-af409c340207 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:57.348553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359246bc-9f99-430f-82e4-578d8a24f091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:57.349224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359246bc-9f99-430f-82e4-578d8a24f091 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:57.349505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359246bc-9f99-430f-82e4-578d8a24f091 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:57.349779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359246bc-9f99-430f-82e4-578d8a24f091 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:57.350535 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359246bc-9f99-430f-82e4-578d8a24f091 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:57.351440 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359246bc-9f99-430f-82e4-578d8a24f091 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:57.353226 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359246bc-9f99-430f-82e4-578d8a24f091 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:57.373853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 465/949] 10.222.0.24 () {56 vars in 1112 bytes} [Tue May 17 21:50:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:57.833240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb2b69-85a4-4084-bec4-e586eef814cf None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:57.833240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb2b69-85a4-4084-bec4-e586eef814cf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:57.833240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb2b69-85a4-4084-bec4-e586eef814cf None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:57.833240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 485/950] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:57.844224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bcc2e-6f5e-439e-9a22-639af549deb4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:57.844224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bcc2e-6f5e-439e-9a22-639af549deb4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:57.844224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bcc2e-6f5e-439e-9a22-639af549deb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:57.865933 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4f4bcc2e-6f5e-439e-9a22-639af549deb4 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:57.869406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4f4bcc2e-6f5e-439e-9a22-639af549deb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:57.939196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 466/951] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:57.963721 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb2b69-85a4-4084-bec4-e586eef814cf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:58.087588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb2b69-85a4-4084-bec4-e586eef814cf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:58.126756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868e12-1a8a-4958-9840-bde4e03c6c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:58.128042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868e12-1a8a-4958-9840-bde4e03c6c73 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:58.128518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868e12-1a8a-4958-9840-bde4e03c6c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:58.128983 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868e12-1a8a-4958-9840-bde4e03c6c73 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:58.140030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82868e12-1a8a-4958-9840-bde4e03c6c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-82868e12-1a8a-4958-9840-bde4e03c6c73 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:50:58.149240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:58.150163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:58.151008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:58.151008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:58.151008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:58.151008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:58.151008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:50:58.151008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:50:58.151008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:50:58.151008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:50:58.151008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:50:58.151008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:50:58.151008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 21:50:58.151008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:58.158628 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 486/952] 10.222.0.24 () {56 vars in 1120 bytes} [Tue May 17 21:50:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:58.164676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bcc2e-6f5e-439e-9a22-639af549deb4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:58.272579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bcc2e-6f5e-439e-9a22-639af549deb4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:58.309773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd361e7-6477-46e1-9ad1-8abd2bb1cfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:58.310452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd361e7-6477-46e1-9ad1-8abd2bb1cfae None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:58.310726 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd361e7-6477-46e1-9ad1-8abd2bb1cfae None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:58.310988 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd361e7-6477-46e1-9ad1-8abd2bb1cfae None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:58.311784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd361e7-6477-46e1-9ad1-8abd2bb1cfae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:58.313274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd361e7-6477-46e1-9ad1-8abd2bb1cfae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:58.314675 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd361e7-6477-46e1-9ad1-8abd2bb1cfae None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:58.325326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 467/953] 10.222.0.24 () {56 vars in 1115 bytes} [Tue May 17 21:50:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:58.333844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868e12-1a8a-4958-9840-bde4e03c6c73 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:58.380366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218e92-9d93-4306-9b8b-6d92d777cb92 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:58.380618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218e92-9d93-4306-9b8b-6d92d777cb92 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:58.380952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89218e92-9d93-4306-9b8b-6d92d777cb92 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:58.383239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 468/954] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:50:58.388715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6ada6-8693-4eab-9cb7-972ed670f5a8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:58.389063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6ada6-8693-4eab-9cb7-972ed670f5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:58.389320 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6ada6-8693-4eab-9cb7-972ed670f5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:58.407359 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f3c6ada6-8693-4eab-9cb7-972ed670f5a8 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:58.408547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f3c6ada6-8693-4eab-9cb7-972ed670f5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:58.456366 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868e12-1a8a-4958-9840-bde4e03c6c73 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:58.494008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 469/955] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:50:58.498388 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05af93-c330-47b3-b06d-3ff4a16c3478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:58.499220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05af93-c330-47b3-b06d-3ff4a16c3478 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:58.499506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05af93-c330-47b3-b06d-3ff4a16c3478 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:58.499783 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05af93-c330-47b3-b06d-3ff4a16c3478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:58.515582 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05af93-c330-47b3-b06d-3ff4a16c3478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:58.517092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6ada6-8693-4eab-9cb7-972ed670f5a8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:58.517323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05af93-c330-47b3-b06d-3ff4a16c3478 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:58.537959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ae05af93-c330-47b3-b06d-3ff4a16c3478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:58.537959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:58.537959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:58.537959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:58.537959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:58.537959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:58.537959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:58.537959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:58.537959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:58.537959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:58.537959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:58.537959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:58.537959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:58.537959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:58.537959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:58.539008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:58.540500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:58.540500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:58.540500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:58.540500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:58.540500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 487/956] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:58.548760 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05af93-c330-47b3-b06d-3ff4a16c3478 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:58.648772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6ada6-8693-4eab-9cb7-972ed670f5a8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:58.680240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05af93-c330-47b3-b06d-3ff4a16c3478 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:58.689268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5195a13-0b36-4a85-9390-80d9de63b528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:58.690340 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5195a13-0b36-4a85-9390-80d9de63b528 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:58.690773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5195a13-0b36-4a85-9390-80d9de63b528 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:58.691240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5195a13-0b36-4a85-9390-80d9de63b528 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:58.692121 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5195a13-0b36-4a85-9390-80d9de63b528 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:58.693713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5195a13-0b36-4a85-9390-80d9de63b528 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d5195a13-0b36-4a85-9390-80d9de63b528 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:58.706654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:58.707736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:58.708567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:58.708567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:58.708567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:58.708567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:58.708567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:58.708567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:58.708567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:58.708567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:58.708567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:58.708567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:58.708567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:58.708567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:58.708567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 21:50:58.708567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:58.713203 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 470/957] 10.222.0.24 () {56 vars in 1126 bytes} [Tue May 17 21:50:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:58.719410 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5195a13-0b36-4a85-9390-80d9de63b528 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:58.733324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601d7ff-326b-447c-8728-fd72ce97d1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:58.734445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601d7ff-326b-447c-8728-fd72ce97d1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:58.734445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601d7ff-326b-447c-8728-fd72ce97d1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:58.734636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601d7ff-326b-447c-8728-fd72ce97d1a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:58.735278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601d7ff-326b-447c-8728-fd72ce97d1a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:58.735588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601d7ff-326b-447c-8728-fd72ce97d1a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:58.736975 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601d7ff-326b-447c-8728-fd72ce97d1a2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:58.754178 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 488/958] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:58.760581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601d7ff-326b-447c-8728-fd72ce97d1a2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:58.837038 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5195a13-0b36-4a85-9390-80d9de63b528 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:58.874216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bd97d-489c-4690-8b92-79a8cb303f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:58.874939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bd97d-489c-4690-8b92-79a8cb303f17 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:58.875263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bd97d-489c-4690-8b92-79a8cb303f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:58.875694 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bd97d-489c-4690-8b92-79a8cb303f17 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:58.877173 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bd97d-489c-4690-8b92-79a8cb303f17 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:58.877406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bd97d-489c-4690-8b92-79a8cb303f17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:58.878876 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bd97d-489c-4690-8b92-79a8cb303f17 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:58.879787 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601d7ff-326b-447c-8728-fd72ce97d1a2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:58.893125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 471/959] 10.222.0.24 () {56 vars in 1122 bytes} [Tue May 17 21:50:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:58.893125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5e7ec-896f-4410-8330-60906e77d8d1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:58.893125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5e7ec-896f-4410-8330-60906e77d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:58.893125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5e7ec-896f-4410-8330-60906e77d8d1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:58.893125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 472/960] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:58.893125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5e7ec-896f-4410-8330-60906e77d8d1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:58.930352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec509aa1-505f-4c92-a418-692738a27326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:58.931089 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec509aa1-505f-4c92-a418-692738a27326 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:58.931391 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec509aa1-505f-4c92-a418-692738a27326 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:58.931661 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec509aa1-505f-4c92-a418-692738a27326 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:58.942465 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec509aa1-505f-4c92-a418-692738a27326 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:58.943944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec509aa1-505f-4c92-a418-692738a27326 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ec509aa1-505f-4c92-a418-692738a27326 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:50:58.964649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:58.965634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:58.966541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:58.966541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:58.966541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:50:58.966541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:50:58.966541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:50:58.966541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:50:58.966541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:50:58.966541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:50:58.966541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 21:50:58.966541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:58.967061 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 489/961] 10.222.0.24 () {56 vars in 1117 bytes} [Tue May 17 21:50:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:50:58.968293 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246ec05-ac1b-4c5a-802c-d8842b9893d4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:58.968580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246ec05-ac1b-4c5a-802c-d8842b9893d4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:58.968854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246ec05-ac1b-4c5a-802c-d8842b9893d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:58.988533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5246ec05-ac1b-4c5a-802c-d8842b9893d4 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:58.989708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5246ec05-ac1b-4c5a-802c-d8842b9893d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:50:59.023294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5e7ec-896f-4410-8330-60906e77d8d1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:59.063829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a365b6a-f829-4244-b004-1ca6de14be40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:59.064179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 490/962] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:50:59.064496 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a365b6a-f829-4244-b004-1ca6de14be40 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:59.064781 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a365b6a-f829-4244-b004-1ca6de14be40 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:59.065138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a365b6a-f829-4244-b004-1ca6de14be40 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:59.065797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246ec05-ac1b-4c5a-802c-d8842b9893d4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:59.066114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a365b6a-f829-4244-b004-1ca6de14be40 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:59.066498 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a365b6a-f829-4244-b004-1ca6de14be40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:59.067939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a365b6a-f829-4244-b004-1ca6de14be40 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:59.077140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 473/963] 10.222.0.24 () {56 vars in 1122 bytes} [Tue May 17 21:50:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:50:59.082295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a365b6a-f829-4244-b004-1ca6de14be40 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:59.196907 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246ec05-ac1b-4c5a-802c-d8842b9893d4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:59.200006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a365b6a-f829-4244-b004-1ca6de14be40 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:59.234779 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08613628-813d-4343-a965-d8beca5ee17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:59.235476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08613628-813d-4343-a965-d8beca5ee17d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:59.235756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08613628-813d-4343-a965-d8beca5ee17d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:59.236027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08613628-813d-4343-a965-d8beca5ee17d None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:59.237079 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08613628-813d-4343-a965-d8beca5ee17d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:59.237365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08613628-813d-4343-a965-d8beca5ee17d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:59.238935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08613628-813d-4343-a965-d8beca5ee17d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:59.241436 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43728bed-06fc-496a-903d-739d9ee6f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:59.242616 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43728bed-06fc-496a-903d-739d9ee6f285 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:59.242895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43728bed-06fc-496a-903d-739d9ee6f285 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:59.243199 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43728bed-06fc-496a-903d-739d9ee6f285 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:59.243940 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43728bed-06fc-496a-903d-739d9ee6f285 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:59.245289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43728bed-06fc-496a-903d-739d9ee6f285 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:59.257945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 491/964] 10.222.0.24 () {56 vars in 1149 bytes} [Tue May 17 21:50:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:59.259637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08613628-813d-4343-a965-d8beca5ee17d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:59.343721 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 474/965] 10.222.0.24 () {60 vars in 1144 bytes} [Tue May 17 21:50:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:50:59.344627 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43728bed-06fc-496a-903d-739d9ee6f285 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:59.374752 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08613628-813d-4343-a965-d8beca5ee17d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:59.432255 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e89459-960f-45d6-8b61-dfd25acb0634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:59.433772 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e89459-960f-45d6-8b61-dfd25acb0634 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:59.434458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e89459-960f-45d6-8b61-dfd25acb0634 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:59.434959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e89459-960f-45d6-8b61-dfd25acb0634 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:59.436497 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e89459-960f-45d6-8b61-dfd25acb0634 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:59.438173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e89459-960f-45d6-8b61-dfd25acb0634 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-44e89459-960f-45d6-8b61-dfd25acb0634 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:59.454396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:59.455571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:59.456426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:59.456426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:50:59.456426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:59.456426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:59.456426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:59.456426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:59.456426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:59.456426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:59.456426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:59.456426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:59.456426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:50:59.456426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:50:59.456426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 21:50:59.456426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:50:59.463728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 492/966] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:50:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:59.464471 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e89459-960f-45d6-8b61-dfd25acb0634 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:59.493948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43728bed-06fc-496a-903d-739d9ee6f285 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:59.550776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcc800-e796-47f3-9b2f-de222c19a100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:59.552097 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcc800-e796-47f3-9b2f-de222c19a100 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:59.552582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcc800-e796-47f3-9b2f-de222c19a100 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:59.553052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcc800-e796-47f3-9b2f-de222c19a100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:59.595293 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e89459-960f-45d6-8b61-dfd25acb0634 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:59.631450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c6990-fe0c-4c68-8ad4-a43d83e200a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:59.632767 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c6990-fe0c-4c68-8ad4-a43d83e200a0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:59.633052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c6990-fe0c-4c68-8ad4-a43d83e200a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:59.633318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c6990-fe0c-4c68-8ad4-a43d83e200a0 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:59.634015 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c6990-fe0c-4c68-8ad4-a43d83e200a0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:59.634315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c6990-fe0c-4c68-8ad4-a43d83e200a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:59.636405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c6990-fe0c-4c68-8ad4-a43d83e200a0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:59.638778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcc800-e796-47f3-9b2f-de222c19a100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:59.640803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcc800-e796-47f3-9b2f-de222c19a100 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:59.646185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 493/967] 10.222.0.24 () {56 vars in 1112 bytes} [Tue May 17 21:50:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:59.648304 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c6990-fe0c-4c68-8ad4-a43d83e200a0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:59.754774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 475/968] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:50:59 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:50:59.755801 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcc800-e796-47f3-9b2f-de222c19a100 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:59.760554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c6990-fe0c-4c68-8ad4-a43d83e200a0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:59.798284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc329b-a14a-481c-b433-03ff35f49a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:59.799380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc329b-a14a-481c-b433-03ff35f49a3d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:59.799866 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc329b-a14a-481c-b433-03ff35f49a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:59.800340 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc329b-a14a-481c-b433-03ff35f49a3d None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:59.801508 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc329b-a14a-481c-b433-03ff35f49a3d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:50:59.802015 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc329b-a14a-481c-b433-03ff35f49a3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:59.803642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc329b-a14a-481c-b433-03ff35f49a3d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:59.815531 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 494/969] 10.222.0.24 () {56 vars in 1112 bytes} [Tue May 17 21:50:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:50:59.867537 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcc800-e796-47f3-9b2f-de222c19a100 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:50:59.906131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6fc2a-cba7-42dd-82f1-523d6d3623da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:50:59.906938 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6fc2a-cba7-42dd-82f1-523d6d3623da None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:59.907249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6fc2a-cba7-42dd-82f1-523d6d3623da None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:59.907521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6fc2a-cba7-42dd-82f1-523d6d3623da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:59.919926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6fc2a-cba7-42dd-82f1-523d6d3623da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:50:59.921391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6fc2a-cba7-42dd-82f1-523d6d3623da None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:50:59.952893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-69b6fc2a-cba7-42dd-82f1-523d6d3623da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:59.952893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:50:59.952893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:50:59.952893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:50:59.952893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:50:59.952893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:50:59.952893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:50:59.952893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:50:59.952893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:50:59.952893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:50:59.952893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:50:59.952893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:50:59.952893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:50:59.952893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:50:59.952893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:50:59.954006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:50:59.954951 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:50:59.954951 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:50:59.954951 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:50:59.954951 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:50:59.954951 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 476/970] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:50:59.961782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4502b-67f5-461b-8873-51d769e31ca4 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:59.962444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4502b-67f5-461b-8873-51d769e31ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:59.962444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4502b-67f5-461b-8873-51d769e31ca4 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:59.962779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6fc2a-cba7-42dd-82f1-523d6d3623da None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:50:59.964001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 495/971] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:50:59.969480 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35056480-b916-42f5-8053-3ecdee2aec5f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:50:59.969757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35056480-b916-42f5-8053-3ecdee2aec5f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:50:59.970035 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35056480-b916-42f5-8053-3ecdee2aec5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:50:59.987925 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-35056480-b916-42f5-8053-3ecdee2aec5f None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:50:59.989135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-35056480-b916-42f5-8053-3ecdee2aec5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:00.062878 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 496/972] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:50:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:51:00.085607 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6fc2a-cba7-42dd-82f1-523d6d3623da None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:00.090714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35056480-b916-42f5-8053-3ecdee2aec5f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:00.130037 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3469c-5087-42c4-bf65-4ffa98fb03ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:00.131704 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3469c-5087-42c4-bf65-4ffa98fb03ea None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:00.132202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3469c-5087-42c4-bf65-4ffa98fb03ea None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:00.132595 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3469c-5087-42c4-bf65-4ffa98fb03ea None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:00.133401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3469c-5087-42c4-bf65-4ffa98fb03ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:00.133715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3469c-5087-42c4-bf65-4ffa98fb03ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:00.135641 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3469c-5087-42c4-bf65-4ffa98fb03ea None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:00.155591 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 477/973] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:00.157333 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3469c-5087-42c4-bf65-4ffa98fb03ea None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:00.213275 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35056480-b916-42f5-8053-3ecdee2aec5f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:00.248012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898ae4f-d7ac-4764-8c8c-72f2c6b854b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:00.248806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898ae4f-d7ac-4764-8c8c-72f2c6b854b0 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:00.248993 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898ae4f-d7ac-4764-8c8c-72f2c6b854b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:00.249263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898ae4f-d7ac-4764-8c8c-72f2c6b854b0 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:00.249955 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898ae4f-d7ac-4764-8c8c-72f2c6b854b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:00.251445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898ae4f-d7ac-4764-8c8c-72f2c6b854b0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:00.252807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: WARNING keystone.server.flask.common [None req-4898ae4f-d7ac-4764-8c8c-72f2c6b854b0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 17 21:51:00.284713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3469c-5087-42c4-bf65-4ffa98fb03ea None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:00.302910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.sql.core [None req-4898ae4f-d7ac-4764-8c8c-72f2c6b854b0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 21:51:00.302910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 17 21:51:00.302910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [parameters: {'user_id': 'c16122de2f204317afcaeec4111ab077', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 17 21:51:00.302910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80134) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 21:51:00.314544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-4898ae4f-d7ac-4764-8c8c-72f2c6b854b0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 17 21:51:00.314544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:00.314544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 21:51:00.314544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 21:51:00.314544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 21:51:00.314544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 21:51:00.314544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 21:51:00.314544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application result = self._query(query) May 17 21:51:00.314544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 21:51:00.314544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application conn.query(q) May 17 21:51:00.314544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 21:51:00.314544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 21:51:00.314544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 21:51:00.314544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application result.read() May 17 21:51:00.314544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 21:51:00.315513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application next(self.gen) May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application yield resource May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application next(self.gen) May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self.session.rollback() May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self.force_reraise() May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise self.value May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application session.commit() May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 21:51:00.316509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._prepare_impl() May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self.session.flush() May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._flush(objects) May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application compat.raise_( May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application flush_context.execute() May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rec.execute(self) May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 21:51:00.317405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application result = connection._execute_20( May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 21:51:00.318421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application result = self._query(query) May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application conn.query(q) May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application result.read() May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 21:51:00.320906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 21:51:00.321761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 21:51:00.321761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 21:51:00.321761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 21:51:00.321761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 21:51:00.321761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 21:51:00.321761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 17 21:51:00.321761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c16122de2f204317afcaeec4111ab077', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 17 21:51:00.321761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 21:51:00.321761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:00.321761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:51:00.321761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:00.321761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:00.321761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:00.321761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:00.321761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 17 21:51:00.328505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 17 21:51:00.330707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 17 21:51:00.330707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 17 21:51:00.330707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 21:51:00.330707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 21:51:00.330707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 17 21:51:00.330707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:00.330707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 497/974] 10.222.0.24 () {60 vars in 1131 bytes} [Tue May 17 21:51:00 2022] POST /identity/v3/users => generated 160 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 17 21:51:00.330707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898ae4f-d7ac-4764-8c8c-72f2c6b854b0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:00.334049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac324cff-ec35-40b2-8a93-4a4e741b9e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:00.336546 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac324cff-ec35-40b2-8a93-4a4e741b9e27 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:00.336546 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac324cff-ec35-40b2-8a93-4a4e741b9e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:00.336910 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac324cff-ec35-40b2-8a93-4a4e741b9e27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:00.344533 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac324cff-ec35-40b2-8a93-4a4e741b9e27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:00.346014 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac324cff-ec35-40b2-8a93-4a4e741b9e27 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:00.361718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ac324cff-ec35-40b2-8a93-4a4e741b9e27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:51:00.361718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:00.361718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:00.361718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:00.361718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:00.361718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:00.361718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:00.361718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:00.361718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:00.361718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:00.361718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:00.361718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:00.361718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:51:00.361718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:51:00.361718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:00.362654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:00.363603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:51:00.363603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:51:00.363603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:51:00.363603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:51:00.363603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:51:00.363603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:51:00.363603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:51:00.363603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:00.363603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 478/975] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:00.369423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac324cff-ec35-40b2-8a93-4a4e741b9e27 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:00.445416 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898ae4f-d7ac-4764-8c8c-72f2c6b854b0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:00.479941 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c597e2d-beee-4666-9ef5-6159e5e67d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:00.480736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c597e2d-beee-4666-9ef5-6159e5e67d10 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:00.481016 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c597e2d-beee-4666-9ef5-6159e5e67d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:00.481284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c597e2d-beee-4666-9ef5-6159e5e67d10 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:00.482995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac324cff-ec35-40b2-8a93-4a4e741b9e27 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:00.488606 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c597e2d-beee-4666-9ef5-6159e5e67d10 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:00.490239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c597e2d-beee-4666-9ef5-6159e5e67d10 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-4c597e2d-beee-4666-9ef5-6159e5e67d10 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:51:00.505592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:00.506576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:00.508224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:00.508224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:00.508224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:51:00.508224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:51:00.508224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:51:00.508224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:51:00.508224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:51:00.508224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:51:00.508224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 21:51:00.508224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:00.508224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 498/976] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:51:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:00.514547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c597e2d-beee-4666-9ef5-6159e5e67d10 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:00.524716 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46182d-d777-472b-9be4-4ca158caced3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:00.525760 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46182d-d777-472b-9be4-4ca158caced3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:00.526241 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46182d-d777-472b-9be4-4ca158caced3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:00.526727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46182d-d777-472b-9be4-4ca158caced3 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:00.527756 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46182d-d777-472b-9be4-4ca158caced3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:00.528286 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46182d-d777-472b-9be4-4ca158caced3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:00.530104 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46182d-d777-472b-9be4-4ca158caced3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:00.549984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 479/977] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:51:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:00.551510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46182d-d777-472b-9be4-4ca158caced3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:00.618587 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c597e2d-beee-4666-9ef5-6159e5e67d10 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:00.653202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb67644-28d8-4f9e-8887-8baa06cf0909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:00.653903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb67644-28d8-4f9e-8887-8baa06cf0909 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:00.654186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb67644-28d8-4f9e-8887-8baa06cf0909 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:00.654460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb67644-28d8-4f9e-8887-8baa06cf0909 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:00.655360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb67644-28d8-4f9e-8887-8baa06cf0909 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:00.655591 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb67644-28d8-4f9e-8887-8baa06cf0909 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:00.657026 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb67644-28d8-4f9e-8887-8baa06cf0909 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:00.661426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46182d-d777-472b-9be4-4ca158caced3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:00.696249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 499/978] 10.222.0.24 () {56 vars in 1101 bytes} [Tue May 17 21:51:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:00.698695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd63c0-0a67-4da4-9f6a-65a9c03fe10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:00.707150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd63c0-0a67-4da4-9f6a-65a9c03fe10d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:00.707150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd63c0-0a67-4da4-9f6a-65a9c03fe10d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:00.707150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd63c0-0a67-4da4-9f6a-65a9c03fe10d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:00.707150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd63c0-0a67-4da4-9f6a-65a9c03fe10d None admin] RBAC: Adding query filter params (role.id=0b73cc84850242ada8c420aae30575ea, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=f6f7d26d4d434ad5a3abc45f8f05e4e9) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:00.707150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd63c0-0a67-4da4-9f6a-65a9c03fe10d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:00.707150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd63c0-0a67-4da4-9f6a-65a9c03fe10d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:00.719318 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 480/979] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:51:00 2022] GET /identity/v3/role_assignments?user.id=f6f7d26d4d434ad5a3abc45f8f05e4e9&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=0b73cc84850242ada8c420aae30575ea => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:01.642373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c1229-80fb-4cd1-a90a-0b63b16d84a1 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:01.642923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c1229-80fb-4cd1-a90a-0b63b16d84a1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:01.642923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c1229-80fb-4cd1-a90a-0b63b16d84a1 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:01.644569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 500/980] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:01.650022 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8ee99-f9e2-4e6e-bb05-70a7abe89c8c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:01.650415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8ee99-f9e2-4e6e-bb05-70a7abe89c8c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:01.650573 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8ee99-f9e2-4e6e-bb05-70a7abe89c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:01.666862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-62a8ee99-f9e2-4e6e-bb05-70a7abe89c8c None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:01.668057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-62a8ee99-f9e2-4e6e-bb05-70a7abe89c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:01.732512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 481/981] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:01.754629 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c1229-80fb-4cd1-a90a-0b63b16d84a1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:01.860340 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c1229-80fb-4cd1-a90a-0b63b16d84a1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:01.895016 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01420813-efbb-42db-972c-269530ca56b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:01.895802 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01420813-efbb-42db-972c-269530ca56b9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:01.896085 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01420813-efbb-42db-972c-269530ca56b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:01.896379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01420813-efbb-42db-972c-269530ca56b9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:01.897030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01420813-efbb-42db-972c-269530ca56b9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:01.898980 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01420813-efbb-42db-972c-269530ca56b9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-01420813-efbb-42db-972c-269530ca56b9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:01.911319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:01.912410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:01.913380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:01.913380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:51:01.913380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:01.913380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:01.913380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:01.913380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:01.913380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:01.913380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:01.913380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:01.913380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:01.913380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:51:01.913380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:51:01.913380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 21:51:01.913380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:01.913380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 501/982] 10.222.0.24 () {56 vars in 1126 bytes} [Tue May 17 21:51:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:01.920326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8ee99-f9e2-4e6e-bb05-70a7abe89c8c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:02.023777 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8ee99-f9e2-4e6e-bb05-70a7abe89c8c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:02.056500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996b811-71b1-494e-9c07-4f5767d979ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:02.057164 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996b811-71b1-494e-9c07-4f5767d979ff None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:02.057446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996b811-71b1-494e-9c07-4f5767d979ff None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:02.057719 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996b811-71b1-494e-9c07-4f5767d979ff None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:02.058418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996b811-71b1-494e-9c07-4f5767d979ff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:02.058720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996b811-71b1-494e-9c07-4f5767d979ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:02.060218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996b811-71b1-494e-9c07-4f5767d979ff None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:02.069098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 482/983] 10.222.0.24 () {56 vars in 1122 bytes} [Tue May 17 21:51:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:02.070957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01420813-efbb-42db-972c-269530ca56b9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:02.127297 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7746-daf6-4a43-99d7-e2c18e5c0f4b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:02.127829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7746-daf6-4a43-99d7-e2c18e5c0f4b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:02.128124 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7746-daf6-4a43-99d7-e2c18e5c0f4b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:02.129684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 483/984] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:02.135419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3bb3-a6cc-4384-8544-aafeacb9d587 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:02.135749 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3bb3-a6cc-4384-8544-aafeacb9d587 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:02.136045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3bb3-a6cc-4384-8544-aafeacb9d587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:02.154169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-568b3bb3-a6cc-4384-8544-aafeacb9d587 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:02.155283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-568b3bb3-a6cc-4384-8544-aafeacb9d587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:02.174098 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01420813-efbb-42db-972c-269530ca56b9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:02.208524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781b03-ebfb-4be1-828d-7ed39b36ef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:02.209185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781b03-ebfb-4be1-828d-7ed39b36ef1c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:02.209470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781b03-ebfb-4be1-828d-7ed39b36ef1c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:02.209746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781b03-ebfb-4be1-828d-7ed39b36ef1c None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:02.210500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b781b03-ebfb-4be1-828d-7ed39b36ef1c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:02.210813 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b781b03-ebfb-4be1-828d-7ed39b36ef1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:02.212210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b781b03-ebfb-4be1-828d-7ed39b36ef1c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:02.216928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 502/985] 10.222.0.24 () {56 vars in 1122 bytes} [Tue May 17 21:51:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:02.222517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781b03-ebfb-4be1-828d-7ed39b36ef1c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:02.225940 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 484/986] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:51:02.248937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3bb3-a6cc-4384-8544-aafeacb9d587 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:02.320370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781b03-ebfb-4be1-828d-7ed39b36ef1c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:02.346110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3bb3-a6cc-4384-8544-aafeacb9d587 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:02.353642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad054f6a-74c2-4d14-b3e5-b72055dd32c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:02.354303 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad054f6a-74c2-4d14-b3e5-b72055dd32c4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:02.354586 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad054f6a-74c2-4d14-b3e5-b72055dd32c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:02.354860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad054f6a-74c2-4d14-b3e5-b72055dd32c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:02.355685 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad054f6a-74c2-4d14-b3e5-b72055dd32c4 None admin] RBAC: Adding query filter params (interface=admin, service_id=7f23a28a0cc84eb79be7b97ab917c885, region_id=RegionOne) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:02.356000 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad054f6a-74c2-4d14-b3e5-b72055dd32c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:02.357354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad054f6a-74c2-4d14-b3e5-b72055dd32c4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:02.362553 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 503/987] 10.222.0.24 () {56 vars in 1249 bytes} [Tue May 17 21:51:02 2022] GET /identity/v3/endpoints?service_id=7f23a28a0cc84eb79be7b97ab917c885&interface=admin®ion_id=RegionOne => generated 193 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:02.368743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad054f6a-74c2-4d14-b3e5-b72055dd32c4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:02.380781 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9e4a9-744b-4768-aa0c-1e8d3f0403fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:02.381451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9e4a9-744b-4768-aa0c-1e8d3f0403fb None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:02.381769 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9e4a9-744b-4768-aa0c-1e8d3f0403fb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:02.382235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9e4a9-744b-4768-aa0c-1e8d3f0403fb None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:02.382994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9e4a9-744b-4768-aa0c-1e8d3f0403fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:02.384384 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9e4a9-744b-4768-aa0c-1e8d3f0403fb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:02.467726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad054f6a-74c2-4d14-b3e5-b72055dd32c4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:02.503137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 485/988] 10.222.0.24 () {60 vars in 1141 bytes} [Tue May 17 21:51:02 2022] POST /identity/v3/services => generated 242 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:51:02.510181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec0b27-9175-4f8e-9187-faf9c1815a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:02.510873 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec0b27-9175-4f8e-9187-faf9c1815a80 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:02.511183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec0b27-9175-4f8e-9187-faf9c1815a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:02.511461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec0b27-9175-4f8e-9187-faf9c1815a80 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:02.512154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec0b27-9175-4f8e-9187-faf9c1815a80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:02.513569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec0b27-9175-4f8e-9187-faf9c1815a80 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:02.520900 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 504/989] 10.222.0.24 () {56 vars in 1087 bytes} [Tue May 17 21:51:02 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 21:51:03.037386 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2af470-f617-4631-b5f1-32d93ecc822f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:03.037929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2af470-f617-4631-b5f1-32d93ecc822f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:03.037929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2af470-f617-4631-b5f1-32d93ecc822f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:03.043151 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 486/990] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:03.045627 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b632e7-7d2a-4a0a-ae9c-c5963588f194 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:03.046056 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b632e7-7d2a-4a0a-ae9c-c5963588f194 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:03.046251 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b632e7-7d2a-4a0a-ae9c-c5963588f194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:03.063667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a8b632e7-7d2a-4a0a-ae9c-c5963588f194 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:03.065159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a8b632e7-7d2a-4a0a-ae9c-c5963588f194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:03.132835 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 505/991] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:03.155174 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2af470-f617-4631-b5f1-32d93ecc822f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:03.252657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2af470-f617-4631-b5f1-32d93ecc822f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:03.285303 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4d179-013d-40cc-b867-1a98805bf1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:03.286094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4d179-013d-40cc-b867-1a98805bf1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:03.286377 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4d179-013d-40cc-b867-1a98805bf1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:03.286651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4d179-013d-40cc-b867-1a98805bf1b6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:03.287332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4d179-013d-40cc-b867-1a98805bf1b6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:03.289284 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4d179-013d-40cc-b867-1a98805bf1b6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-50a4d179-013d-40cc-b867-1a98805bf1b6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:03.300945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:03.302192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:03.303021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:03.303021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:03.303021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:03.303021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:03.303021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:03.303021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:03.303021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:03.303021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:03.303021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:03.303021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:03.303021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:51:03.303021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:51:03.303021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 21:51:03.303021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:03.303021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 487/992] 10.222.0.24 () {56 vars in 1105 bytes} [Tue May 17 21:51:03 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:03.310249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b632e7-7d2a-4a0a-ae9c-c5963588f194 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:03.406694 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b632e7-7d2a-4a0a-ae9c-c5963588f194 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:03.438251 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f840a1-5bd0-4485-b74b-038d9c397bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:03.438909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f840a1-5bd0-4485-b74b-038d9c397bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:03.439214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f840a1-5bd0-4485-b74b-038d9c397bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:03.439491 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f840a1-5bd0-4485-b74b-038d9c397bf9 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:03.440186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f840a1-5bd0-4485-b74b-038d9c397bf9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:03.440486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f840a1-5bd0-4485-b74b-038d9c397bf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:03.441840 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f840a1-5bd0-4485-b74b-038d9c397bf9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:03.451557 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 506/993] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:03.452745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4d179-013d-40cc-b867-1a98805bf1b6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:03.554877 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4d179-013d-40cc-b867-1a98805bf1b6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:03.589703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354a00b-7b06-4e95-bf24-db99899815b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:03.590368 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354a00b-7b06-4e95-bf24-db99899815b4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:03.590650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354a00b-7b06-4e95-bf24-db99899815b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:03.590924 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354a00b-7b06-4e95-bf24-db99899815b4 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:03.591659 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354a00b-7b06-4e95-bf24-db99899815b4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:03.591962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354a00b-7b06-4e95-bf24-db99899815b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:03.593313 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354a00b-7b06-4e95-bf24-db99899815b4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:03.599141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 488/994] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:04.812259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f495db3-02a6-4518-bbf4-f41e65f79122 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:04.812780 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f495db3-02a6-4518-bbf4-f41e65f79122 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:04.812780 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f495db3-02a6-4518-bbf4-f41e65f79122 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:04.814197 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 507/995] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:04.819931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826bd2f-eb85-4984-a4d4-c8a61b0bfc49 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:04.832378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826bd2f-eb85-4984-a4d4-c8a61b0bfc49 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:04.832378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826bd2f-eb85-4984-a4d4-c8a61b0bfc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:04.837550 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7826bd2f-eb85-4984-a4d4-c8a61b0bfc49 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:04.838712 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7826bd2f-eb85-4984-a4d4-c8a61b0bfc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:04.853438 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4e149-5e8f-4530-817a-abde9d35da0c None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:04.853722 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4e149-5e8f-4530-817a-abde9d35da0c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:04.853998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4e149-5e8f-4530-817a-abde9d35da0c None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:04.855598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 508/996] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:04.860345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5bd4b-2386-4d30-ac64-dcee12e800b3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:04.860633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5bd4b-2386-4d30-ac64-dcee12e800b3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:04.860963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5bd4b-2386-4d30-ac64-dcee12e800b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:04.877241 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4bb5bd4b-2386-4d30-ac64-dcee12e800b3 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:04.878408 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4bb5bd4b-2386-4d30-ac64-dcee12e800b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:04.911449 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 489/997] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:51:04.934851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826bd2f-eb85-4984-a4d4-c8a61b0bfc49 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:04.957492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 509/998] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:51:04.974926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5bd4b-2386-4d30-ac64-dcee12e800b3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:05.033816 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826bd2f-eb85-4984-a4d4-c8a61b0bfc49 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:05.070460 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e8d28-cc19-4bc3-98ad-1d19498e0d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:05.070860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5bd4b-2386-4d30-ac64-dcee12e800b3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:05.071228 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e8d28-cc19-4bc3-98ad-1d19498e0d61 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:05.071505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e8d28-cc19-4bc3-98ad-1d19498e0d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:05.071776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e8d28-cc19-4bc3-98ad-1d19498e0d61 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:05.072424 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e8d28-cc19-4bc3-98ad-1d19498e0d61 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:05.073781 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e8d28-cc19-4bc3-98ad-1d19498e0d61 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-281e8d28-cc19-4bc3-98ad-1d19498e0d61 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:05.085530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:05.086559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:05.087446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:05.087446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:05.087446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:05.087446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:05.087446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:05.087446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:05.087446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:05.087446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:05.087446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:05.087446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:05.087446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:51:05.087446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:51:05.087446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 21:51:05.087446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:05.087446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 490/999] 10.222.0.24 () {56 vars in 1126 bytes} [Tue May 17 21:51:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:51:05.092598 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e8d28-cc19-4bc3-98ad-1d19498e0d61 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:05.105679 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26318a62-1904-4be8-936e-d3442f2b4281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:05.106468 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26318a62-1904-4be8-936e-d3442f2b4281 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:05.106744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26318a62-1904-4be8-936e-d3442f2b4281 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:05.107029 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26318a62-1904-4be8-936e-d3442f2b4281 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:05.107680 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26318a62-1904-4be8-936e-d3442f2b4281 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:05.109029 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26318a62-1904-4be8-936e-d3442f2b4281 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-26318a62-1904-4be8-936e-d3442f2b4281 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:05.121240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:05.122274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:05.123161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:05.123161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:51:05.123161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:05.123161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:05.123161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:05.123161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:05.123161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:05.123161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:05.123161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:05.123161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:05.123161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:51:05.123161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:51:05.123161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 21:51:05.123161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:05.123161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 510/1000] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:51:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:51:05.128283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26318a62-1904-4be8-936e-d3442f2b4281 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:05.191998 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e8d28-cc19-4bc3-98ad-1d19498e0d61 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:05.225006 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26318a62-1904-4be8-936e-d3442f2b4281 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:05.225566 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527adac0-d854-4e19-93a3-d3b198564414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:05.226298 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527adac0-d854-4e19-93a3-d3b198564414 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:05.226577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527adac0-d854-4e19-93a3-d3b198564414 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:05.226850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527adac0-d854-4e19-93a3-d3b198564414 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:05.227583 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527adac0-d854-4e19-93a3-d3b198564414 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:05.227883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527adac0-d854-4e19-93a3-d3b198564414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:05.229224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527adac0-d854-4e19-93a3-d3b198564414 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:05.238593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 491/1001] 10.222.0.24 () {56 vars in 1122 bytes} [Tue May 17 21:51:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:05.239423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527adac0-d854-4e19-93a3-d3b198564414 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:05.259064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac733a0b-5307-4979-a635-59644ad08b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:05.259775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac733a0b-5307-4979-a635-59644ad08b04 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:05.260060 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac733a0b-5307-4979-a635-59644ad08b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:05.260339 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac733a0b-5307-4979-a635-59644ad08b04 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:05.261044 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac733a0b-5307-4979-a635-59644ad08b04 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:05.261359 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac733a0b-5307-4979-a635-59644ad08b04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:05.262725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac733a0b-5307-4979-a635-59644ad08b04 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:05.272090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 511/1002] 10.222.0.24 () {56 vars in 1112 bytes} [Tue May 17 21:51:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:05.273997 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac733a0b-5307-4979-a635-59644ad08b04 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:05.348514 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527adac0-d854-4e19-93a3-d3b198564414 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:05.374986 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac733a0b-5307-4979-a635-59644ad08b04 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:05.382482 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255022c5-4c41-4cf8-b283-ee7d8f5d25c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:05.383196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255022c5-4c41-4cf8-b283-ee7d8f5d25c3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:05.383486 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255022c5-4c41-4cf8-b283-ee7d8f5d25c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:05.383766 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255022c5-4c41-4cf8-b283-ee7d8f5d25c3 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:05.384470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255022c5-4c41-4cf8-b283-ee7d8f5d25c3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:05.384779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255022c5-4c41-4cf8-b283-ee7d8f5d25c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:05.386138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255022c5-4c41-4cf8-b283-ee7d8f5d25c3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:05.395511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 492/1003] 10.222.0.24 () {56 vars in 1122 bytes} [Tue May 17 21:51:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:05.396825 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255022c5-4c41-4cf8-b283-ee7d8f5d25c3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:05.408256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74d9cb-4089-4584-8093-d96608ba7888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:05.408919 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74d9cb-4089-4584-8093-d96608ba7888 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:05.409198 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74d9cb-4089-4584-8093-d96608ba7888 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:05.409468 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74d9cb-4089-4584-8093-d96608ba7888 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:05.410173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74d9cb-4089-4584-8093-d96608ba7888 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:05.410476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74d9cb-4089-4584-8093-d96608ba7888 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:05.411856 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74d9cb-4089-4584-8093-d96608ba7888 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:05.421447 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 512/1004] 10.222.0.24 () {56 vars in 1112 bytes} [Tue May 17 21:51:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:05.422437 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74d9cb-4089-4584-8093-d96608ba7888 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:05.504432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255022c5-4c41-4cf8-b283-ee7d8f5d25c3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:05.527874 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74d9cb-4089-4584-8093-d96608ba7888 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:05.537297 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f15b3-ab03-4178-84e9-0f6ae37a9dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:05.538563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f15b3-ab03-4178-84e9-0f6ae37a9dbc None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:05.538881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f15b3-ab03-4178-84e9-0f6ae37a9dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:05.539175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f15b3-ab03-4178-84e9-0f6ae37a9dbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:05.539904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f15b3-ab03-4178-84e9-0f6ae37a9dbc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:05.541249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f15b3-ab03-4178-84e9-0f6ae37a9dbc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:05.562081 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14fb7e-93ae-492d-a1a9-9c1c35ae2bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:05.564145 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14fb7e-93ae-492d-a1a9-9c1c35ae2bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:05.564145 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14fb7e-93ae-492d-a1a9-9c1c35ae2bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:05.564145 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14fb7e-93ae-492d-a1a9-9c1c35ae2bc4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:05.564145 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14fb7e-93ae-492d-a1a9-9c1c35ae2bc4 None admin] RBAC: Adding query filter params (interface=public, service_id=87ac9405e5274977b2cbee0b098bf048, region_id=RegionOne) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:05.564441 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14fb7e-93ae-492d-a1a9-9c1c35ae2bc4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:05.565708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14fb7e-93ae-492d-a1a9-9c1c35ae2bc4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:05.570734 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 513/1005] 10.222.0.24 () {56 vars in 1251 bytes} [Tue May 17 21:51:05 2022] GET /identity/v3/endpoints?service_id=87ac9405e5274977b2cbee0b098bf048&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:05.576131 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14fb7e-93ae-492d-a1a9-9c1c35ae2bc4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:05.646260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 493/1006] 10.222.0.24 () {60 vars in 1144 bytes} [Tue May 17 21:51:05 2022] POST /identity/v3/endpoints => generated 325 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:51:05.677749 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14fb7e-93ae-492d-a1a9-9c1c35ae2bc4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:05.724042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2cfe2-4835-41f4-b2a9-2730d1059948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:05.724717 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2cfe2-4835-41f4-b2a9-2730d1059948 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:05.725003 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2cfe2-4835-41f4-b2a9-2730d1059948 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:05.725277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2cfe2-4835-41f4-b2a9-2730d1059948 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:05.726983 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2cfe2-4835-41f4-b2a9-2730d1059948 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:05.728530 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2cfe2-4835-41f4-b2a9-2730d1059948 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:05.743194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 514/1007] 10.222.0.24 () {56 vars in 1087 bytes} [Tue May 17 21:51:05 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 21:51:05.874672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc427b2-55be-48bf-9af7-d02557adce9a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:05.875220 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc427b2-55be-48bf-9af7-d02557adce9a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:05.875300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc427b2-55be-48bf-9af7-d02557adce9a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:05.876697 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 494/1008] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:05.883289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5011a9-f35e-4779-a6f2-ced6cbd5a3e0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:05.883831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5011a9-f35e-4779-a6f2-ced6cbd5a3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:05.883831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5011a9-f35e-4779-a6f2-ced6cbd5a3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:05.902297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2d5011a9-f35e-4779-a6f2-ced6cbd5a3e0 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:05.903443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2d5011a9-f35e-4779-a6f2-ced6cbd5a3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:05.975010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 515/1009] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:05.997953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc427b2-55be-48bf-9af7-d02557adce9a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:06.098809 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc427b2-55be-48bf-9af7-d02557adce9a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:06.131415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2ceaf-3b3f-4b91-afb2-5ede13e79c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:06.132645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2ceaf-3b3f-4b91-afb2-5ede13e79c2b None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:06.132921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2ceaf-3b3f-4b91-afb2-5ede13e79c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:06.133187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2ceaf-3b3f-4b91-afb2-5ede13e79c2b None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:06.133909 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2ceaf-3b3f-4b91-afb2-5ede13e79c2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:06.135278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2ceaf-3b3f-4b91-afb2-5ede13e79c2b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:06.198057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 495/1010] 10.222.0.24 () {60 vars in 1141 bytes} [Tue May 17 21:51:05 2022] POST /identity/v3/services => generated 242 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:51:07.944917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601e0d-68db-404b-b1f9-700da74798cd None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:07.945461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601e0d-68db-404b-b1f9-700da74798cd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:07.945461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601e0d-68db-404b-b1f9-700da74798cd None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:07.946848 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 516/1011] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:07.952350 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65552d-ab79-40cc-9084-e429b0cacce5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:07.952768 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65552d-ab79-40cc-9084-e429b0cacce5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:07.952968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65552d-ab79-40cc-9084-e429b0cacce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:07.969552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0d65552d-ab79-40cc-9084-e429b0cacce5 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:07.970725 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0d65552d-ab79-40cc-9084-e429b0cacce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:07.986311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd688d-4811-4607-b49e-92c1449ca0c6 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:07.986611 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd688d-4811-4607-b49e-92c1449ca0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:07.986871 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd688d-4811-4607-b49e-92c1449ca0c6 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:07.988276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 517/1012] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:07.993934 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a26c03-72f2-492b-a0db-a9a9339afa2b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:07.994220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a26c03-72f2-492b-a0db-a9a9339afa2b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:07.994499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a26c03-72f2-492b-a0db-a9a9339afa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:08.011767 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a7a26c03-72f2-492b-a0db-a9a9339afa2b None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:08.012931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a7a26c03-72f2-492b-a0db-a9a9339afa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:08.051396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 496/1013] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:07 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:08.071775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65552d-ab79-40cc-9084-e429b0cacce5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:08.078217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 518/1014] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:07 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:51:08.101277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a26c03-72f2-492b-a0db-a9a9339afa2b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:08.171927 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65552d-ab79-40cc-9084-e429b0cacce5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:08.199512 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a26c03-72f2-492b-a0db-a9a9339afa2b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:08.207139 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f37ed7-a3b7-4a60-920e-71b164673022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:08.207922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f37ed7-a3b7-4a60-920e-71b164673022 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:08.208204 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f37ed7-a3b7-4a60-920e-71b164673022 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:08.208478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f37ed7-a3b7-4a60-920e-71b164673022 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:08.209785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f37ed7-a3b7-4a60-920e-71b164673022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:08.211418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f37ed7-a3b7-4a60-920e-71b164673022 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:08.217666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 497/1015] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:08.218659 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f37ed7-a3b7-4a60-920e-71b164673022 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:08.233576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73141ece-85e5-414b-84f0-4bac1a56136b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:08.234377 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73141ece-85e5-414b-84f0-4bac1a56136b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:08.234659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73141ece-85e5-414b-84f0-4bac1a56136b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:08.234947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73141ece-85e5-414b-84f0-4bac1a56136b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:08.235630 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73141ece-85e5-414b-84f0-4bac1a56136b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:08.237024 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73141ece-85e5-414b-84f0-4bac1a56136b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-73141ece-85e5-414b-84f0-4bac1a56136b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:08.250097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:08.251215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:08.252062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:08.252062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:51:08.252062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:08.252062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:08.252062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:08.252062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:08.252062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:08.252062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:08.252062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:08.252062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:08.252062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:51:08.252062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:51:08.252062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 21:51:08.252062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:08.252062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 519/1016] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:51:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:51:08.258458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73141ece-85e5-414b-84f0-4bac1a56136b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:08.323921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f37ed7-a3b7-4a60-920e-71b164673022 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:08.357578 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82563fa-3871-4bfa-a35d-34e976546399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:08.358238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82563fa-3871-4bfa-a35d-34e976546399 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:08.358521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82563fa-3871-4bfa-a35d-34e976546399 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:08.358798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82563fa-3871-4bfa-a35d-34e976546399 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:08.359535 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82563fa-3871-4bfa-a35d-34e976546399 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:08.360035 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73141ece-85e5-414b-84f0-4bac1a56136b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:08.360954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82563fa-3871-4bfa-a35d-34e976546399 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:08.393358 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2733af-ee02-4c9a-ad21-da44a3e64dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:08.398879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2733af-ee02-4c9a-ad21-da44a3e64dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:08.398879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2733af-ee02-4c9a-ad21-da44a3e64dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:08.398879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2733af-ee02-4c9a-ad21-da44a3e64dd1 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:08.398879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2733af-ee02-4c9a-ad21-da44a3e64dd1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:08.398879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2733af-ee02-4c9a-ad21-da44a3e64dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:08.398879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2733af-ee02-4c9a-ad21-da44a3e64dd1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:08.402460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 520/1017] 10.222.0.24 () {56 vars in 1112 bytes} [Tue May 17 21:51:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:08.407975 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2733af-ee02-4c9a-ad21-da44a3e64dd1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:08.492390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 498/1018] 10.222.0.24 () {60 vars in 1141 bytes} [Tue May 17 21:51:08 2022] POST /identity/v3/projects => generated 311 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:51:08.492390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fd02c-8820-4d2d-99b1-72d1d5285200 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:08.492390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fd02c-8820-4d2d-99b1-72d1d5285200 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:08.492390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fd02c-8820-4d2d-99b1-72d1d5285200 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:08.492390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 499/1019] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:08.492390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a22d1-7e78-4add-b7fb-565f9eb840fe None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:08.492390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a22d1-7e78-4add-b7fb-565f9eb840fe None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:08.493006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a22d1-7e78-4add-b7fb-565f9eb840fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:08.507803 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2733af-ee02-4c9a-ad21-da44a3e64dd1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:08.509308 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7b1a22d1-7e78-4add-b7fb-565f9eb840fe None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:08.510519 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7b1a22d1-7e78-4add-b7fb-565f9eb840fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:08.544863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b70206-6691-479b-bf09-52a0d48f208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:08.545963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b70206-6691-479b-bf09-52a0d48f208f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:08.546478 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b70206-6691-479b-bf09-52a0d48f208f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:08.546964 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b70206-6691-479b-bf09-52a0d48f208f None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:08.547966 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b70206-6691-479b-bf09-52a0d48f208f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:08.548366 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b70206-6691-479b-bf09-52a0d48f208f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:08.549791 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b70206-6691-479b-bf09-52a0d48f208f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:08.555790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 521/1020] 10.222.0.24 () {56 vars in 1112 bytes} [Tue May 17 21:51:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:08.561575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b70206-6691-479b-bf09-52a0d48f208f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:08.581777 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 500/1021] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:08 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:51:08.605563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a22d1-7e78-4add-b7fb-565f9eb840fe None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:08.666412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b70206-6691-479b-bf09-52a0d48f208f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:08.702006 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd96ce-567c-434a-91f2-d8a413d310c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:08.702669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd96ce-567c-434a-91f2-d8a413d310c0 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:08.702947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd96ce-567c-434a-91f2-d8a413d310c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:08.703659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd96ce-567c-434a-91f2-d8a413d310c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:08.703989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd96ce-567c-434a-91f2-d8a413d310c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:08.705349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd96ce-567c-434a-91f2-d8a413d310c0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:08.716269 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a22d1-7e78-4add-b7fb-565f9eb840fe None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:08.750794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d800df3-b983-414a-9413-9c369309018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:08.751544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d800df3-b983-414a-9413-9c369309018d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:08.751830 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d800df3-b983-414a-9413-9c369309018d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:08.752104 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d800df3-b983-414a-9413-9c369309018d None admin] PATH_INFO: `/v3/services/image` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:08.752756 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d800df3-b983-414a-9413-9c369309018d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:08.754164 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d800df3-b983-414a-9413-9c369309018d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8d800df3-b983-414a-9413-9c369309018d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:08.765706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:08.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:08.767741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:08.767741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:08.767741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:08.767741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:08.767741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:08.767741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:08.767741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:08.767741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:08.767741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:08.767741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:08.767741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:51:08.767741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:51:08.767741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 21:51:08.767741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:08.772056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 501/1023] 10.222.0.24 () {56 vars in 1105 bytes} [Tue May 17 21:51:08 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:08.772898 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d800df3-b983-414a-9413-9c369309018d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:08.775230 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 522/1023] 10.222.0.24 () {60 vars in 1144 bytes} [Tue May 17 21:51:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:51:08.881721 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d800df3-b983-414a-9413-9c369309018d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:08.924425 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43749f57-a5f0-461e-bc32-6f3e5d17f992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:08.925094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43749f57-a5f0-461e-bc32-6f3e5d17f992 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:08.925370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43749f57-a5f0-461e-bc32-6f3e5d17f992 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:08.925640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43749f57-a5f0-461e-bc32-6f3e5d17f992 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:08.926613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43749f57-a5f0-461e-bc32-6f3e5d17f992 None admin] RBAC: Adding query filter params (name=image) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:08.926916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43749f57-a5f0-461e-bc32-6f3e5d17f992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:08.928333 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43749f57-a5f0-461e-bc32-6f3e5d17f992 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:08.939781 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 502/1024] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:08.941052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd96ce-567c-434a-91f2-d8a413d310c0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:09.050289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd96ce-567c-434a-91f2-d8a413d310c0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:09.086963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51a208-ffc5-48de-9684-1067c45539ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:09.087697 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51a208-ffc5-48de-9684-1067c45539ac None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:09.087977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51a208-ffc5-48de-9684-1067c45539ac None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:09.088249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51a208-ffc5-48de-9684-1067c45539ac None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:09.088953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51a208-ffc5-48de-9684-1067c45539ac None admin] RBAC: Adding query filter params (type=image) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:09.089250 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51a208-ffc5-48de-9684-1067c45539ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:09.090609 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51a208-ffc5-48de-9684-1067c45539ac None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:09.095702 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 523/1025] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:09.101540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43749f57-a5f0-461e-bc32-6f3e5d17f992 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:09.200246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43749f57-a5f0-461e-bc32-6f3e5d17f992 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:09.235726 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda8e95-7907-44dd-93b8-d0829fc57559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:09.236381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8e95-7907-44dd-93b8-d0829fc57559 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:09.236658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8e95-7907-44dd-93b8-d0829fc57559 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:09.236927 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8e95-7907-44dd-93b8-d0829fc57559 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:09.237709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda8e95-7907-44dd-93b8-d0829fc57559 None admin] RBAC: Adding query filter params (interface=public, service_id=eb0e40de5c804c88b6fbb334ccb55d69, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:09.238067 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda8e95-7907-44dd-93b8-d0829fc57559 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:09.239443 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda8e95-7907-44dd-93b8-d0829fc57559 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:09.245539 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 503/1026] 10.222.0.24 () {56 vars in 1251 bytes} [Tue May 17 21:51:09 2022] GET /identity/v3/endpoints?service_id=eb0e40de5c804c88b6fbb334ccb55d69&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:09.251612 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51a208-ffc5-48de-9684-1067c45539ac None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:09.353116 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51a208-ffc5-48de-9684-1067c45539ac None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:09.386097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb6be4-f218-4c34-9a0e-7a37869fdd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:09.386763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb6be4-f218-4c34-9a0e-7a37869fdd74 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:09.387044 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb6be4-f218-4c34-9a0e-7a37869fdd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:09.387346 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb6be4-f218-4c34-9a0e-7a37869fdd74 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:09.388025 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb6be4-f218-4c34-9a0e-7a37869fdd74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:09.389391 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb6be4-f218-4c34-9a0e-7a37869fdd74 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:09.395844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 524/1027] 10.222.0.24 () {56 vars in 1087 bytes} [Tue May 17 21:51:09 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 21:51:10.788414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed3f0d-f54c-453f-ab42-b4d7e9d98191 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:10.788938 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed3f0d-f54c-453f-ab42-b4d7e9d98191 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:10.789043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed3f0d-f54c-453f-ab42-b4d7e9d98191 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:10.790477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 504/1028] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:10.795476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce1097-dc08-4fd6-b6f0-e8a890fa1c26 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:10.795870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce1097-dc08-4fd6-b6f0-e8a890fa1c26 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:10.796047 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce1097-dc08-4fd6-b6f0-e8a890fa1c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:10.813007 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6bce1097-dc08-4fd6-b6f0-e8a890fa1c26 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:10.814158 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6bce1097-dc08-4fd6-b6f0-e8a890fa1c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:10.880074 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 525/1029] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:10.905366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed3f0d-f54c-453f-ab42-b4d7e9d98191 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:11.011929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed3f0d-f54c-453f-ab42-b4d7e9d98191 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:11.044988 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d583846-a517-4405-9f8f-a31ba2a690dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:11.045690 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d583846-a517-4405-9f8f-a31ba2a690dd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:11.045969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d583846-a517-4405-9f8f-a31ba2a690dd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:11.046240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d583846-a517-4405-9f8f-a31ba2a690dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:11.047420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d583846-a517-4405-9f8f-a31ba2a690dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:11.048827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d583846-a517-4405-9f8f-a31ba2a690dd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:11.055929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 505/1030] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:11.057037 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce1097-dc08-4fd6-b6f0-e8a890fa1c26 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:11.111853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08159dc-d5ee-46a2-b401-cdaa8dd3cb77 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:11.112178 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08159dc-d5ee-46a2-b401-cdaa8dd3cb77 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:11.112411 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08159dc-d5ee-46a2-b401-cdaa8dd3cb77 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:11.113900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 506/1031] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:51:11.119577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f73d9-8518-402b-b41b-0c676bd2acec None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:11.119870 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f73d9-8518-402b-b41b-0c676bd2acec None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:11.120154 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f73d9-8518-402b-b41b-0c676bd2acec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:11.137168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7d4f73d9-8518-402b-b41b-0c676bd2acec None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:11.138326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7d4f73d9-8518-402b-b41b-0c676bd2acec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:11.155647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce1097-dc08-4fd6-b6f0-e8a890fa1c26 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:11.193374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625bd91-e0fb-4ad7-9e41-142389bdb4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:11.194202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625bd91-e0fb-4ad7-9e41-142389bdb4cb None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:11.195214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625bd91-e0fb-4ad7-9e41-142389bdb4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:11.195515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625bd91-e0fb-4ad7-9e41-142389bdb4cb None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:11.196282 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625bd91-e0fb-4ad7-9e41-142389bdb4cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:11.197716 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625bd91-e0fb-4ad7-9e41-142389bdb4cb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:11.213444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 507/1032] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:11.237052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f73d9-8518-402b-b41b-0c676bd2acec None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:11.309150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 526/1033] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:51:11 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:51:11.336214 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f73d9-8518-402b-b41b-0c676bd2acec None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:11.373814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae1d64-a56c-4b10-bcde-f9e5b4c19184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:11.374651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae1d64-a56c-4b10-bcde-f9e5b4c19184 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:11.374933 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae1d64-a56c-4b10-bcde-f9e5b4c19184 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:11.375238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae1d64-a56c-4b10-bcde-f9e5b4c19184 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:11.386886 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae1d64-a56c-4b10-bcde-f9e5b4c19184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-81ae1d64-a56c-4b10-bcde-f9e5b4c19184 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:51:11.395374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:11.396366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:11.397862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:11.397862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:11.397862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:11.397862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:11.397862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:51:11.397862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:51:11.397862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:51:11.397862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:51:11.397862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:51:11.397862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:51:11.397862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 21:51:11.397862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:11.397862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 508/1034] 10.222.0.24 () {56 vars in 1120 bytes} [Tue May 17 21:51:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:51:11.403632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625bd91-e0fb-4ad7-9e41-142389bdb4cb None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:11.516050 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625bd91-e0fb-4ad7-9e41-142389bdb4cb None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:11.549949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207ed41-0db1-4b26-970f-1a825fa06806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:11.550617 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207ed41-0db1-4b26-970f-1a825fa06806 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:11.550897 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207ed41-0db1-4b26-970f-1a825fa06806 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:11.551468 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207ed41-0db1-4b26-970f-1a825fa06806 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:11.552218 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207ed41-0db1-4b26-970f-1a825fa06806 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:11.552529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207ed41-0db1-4b26-970f-1a825fa06806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:11.553912 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207ed41-0db1-4b26-970f-1a825fa06806 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:11.563596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 527/1035] 10.222.0.24 () {56 vars in 1115 bytes} [Tue May 17 21:51:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:11.568658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae1d64-a56c-4b10-bcde-f9e5b4c19184 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:11.646750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bee0f-a51e-4988-b6de-c847bab33d66 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:11.647154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bee0f-a51e-4988-b6de-c847bab33d66 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:11.647412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bee0f-a51e-4988-b6de-c847bab33d66 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:11.648909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 528/1036] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:11.653689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decedd28-37e0-4f55-8cc1-0637e3a2dd73 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:11.653969 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decedd28-37e0-4f55-8cc1-0637e3a2dd73 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:11.654244 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decedd28-37e0-4f55-8cc1-0637e3a2dd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:11.668832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae1d64-a56c-4b10-bcde-f9e5b4c19184 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:11.671186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-decedd28-37e0-4f55-8cc1-0637e3a2dd73 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:11.672348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-decedd28-37e0-4f55-8cc1-0637e3a2dd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:11.702792 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23f486-554d-4b3b-b132-98ab3ff7ba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:11.703664 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23f486-554d-4b3b-b132-98ab3ff7ba04 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:11.703959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23f486-554d-4b3b-b132-98ab3ff7ba04 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:11.704227 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23f486-554d-4b3b-b132-98ab3ff7ba04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:11.714765 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23f486-554d-4b3b-b132-98ab3ff7ba04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:11.716237 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23f486-554d-4b3b-b132-98ab3ff7ba04 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:11.733629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0e23f486-554d-4b3b-b132-98ab3ff7ba04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:51:11.733629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:11.733629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:11.733629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:11.733629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:11.733629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:11.733629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:11.733629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:11.733629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:11.733629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:11.733629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:11.733629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:11.733629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:51:11.733629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:51:11.733629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:11.734784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:11.735902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:51:11.735902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:51:11.735902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:51:11.735902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:11.735902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 509/1037] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:11.743144 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 529/1038] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:51:11.743318 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23f486-554d-4b3b-b132-98ab3ff7ba04 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:11.763145 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decedd28-37e0-4f55-8cc1-0637e3a2dd73 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:11.843683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23f486-554d-4b3b-b132-98ab3ff7ba04 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:11.863333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decedd28-37e0-4f55-8cc1-0637e3a2dd73 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:11.879399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9235b9-4c68-49b4-83c1-d82d3bbe7c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:11.880069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9235b9-4c68-49b4-83c1-d82d3bbe7c7f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:11.880352 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9235b9-4c68-49b4-83c1-d82d3bbe7c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:11.880625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9235b9-4c68-49b4-83c1-d82d3bbe7c7f None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:11.881377 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9235b9-4c68-49b4-83c1-d82d3bbe7c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:11.882401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9235b9-4c68-49b4-83c1-d82d3bbe7c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:11.883923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9235b9-4c68-49b4-83c1-d82d3bbe7c7f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:11.897841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 510/1039] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:11.903257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9235b9-4c68-49b4-83c1-d82d3bbe7c7f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:11.905151 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ce09f-bf6f-4bf0-bea9-6e2f5ca3b002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:11.905946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce09f-bf6f-4bf0-bea9-6e2f5ca3b002 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:11.906223 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce09f-bf6f-4bf0-bea9-6e2f5ca3b002 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:11.906480 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce09f-bf6f-4bf0-bea9-6e2f5ca3b002 None admin] PATH_INFO: `/v3/services/image` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:11.907376 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ce09f-bf6f-4bf0-bea9-6e2f5ca3b002 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:11.908825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ce09f-bf6f-4bf0-bea9-6e2f5ca3b002 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-523ce09f-bf6f-4bf0-bea9-6e2f5ca3b002 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:11.920538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:11.921536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:11.922504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:11.922504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:51:11.922504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:11.922504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:11.922504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:11.922504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:11.922504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:11.922504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:11.922504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:11.922504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:11.922504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:51:11.922504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:51:11.922504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 21:51:11.922504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:11.922504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 530/1040] 10.222.0.24 () {56 vars in 1105 bytes} [Tue May 17 21:51:11 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:51:11.927922 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ce09f-bf6f-4bf0-bea9-6e2f5ca3b002 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:12.013867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9235b9-4c68-49b4-83c1-d82d3bbe7c7f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:12.042202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ce09f-bf6f-4bf0-bea9-6e2f5ca3b002 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:12.050655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec7371-5bfe-47af-9750-96a75c84b9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:12.051752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec7371-5bfe-47af-9750-96a75c84b9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:12.052036 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec7371-5bfe-47af-9750-96a75c84b9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:12.052312 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec7371-5bfe-47af-9750-96a75c84b9c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:12.059507 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec7371-5bfe-47af-9750-96a75c84b9c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:12.060975 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec7371-5bfe-47af-9750-96a75c84b9c4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-00ec7371-5bfe-47af-9750-96a75c84b9c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:51:12.075401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:12.076376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:12.077391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:12.077391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:12.077391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:51:12.077391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:51:12.077391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:51:12.077391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:51:12.077391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:51:12.077391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:51:12.077391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 21:51:12.077391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:12.077391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 511/1041] 10.222.0.24 () {56 vars in 1093 bytes} [Tue May 17 21:51:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:51:12.078926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa4300-c9a0-4f82-bcac-72bd6225cb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:12.079618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa4300-c9a0-4f82-bcac-72bd6225cb81 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:12.079901 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa4300-c9a0-4f82-bcac-72bd6225cb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:12.080176 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa4300-c9a0-4f82-bcac-72bd6225cb81 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:12.080883 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa4300-c9a0-4f82-bcac-72bd6225cb81 None admin] RBAC: Adding query filter params (name=image) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:12.081188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa4300-c9a0-4f82-bcac-72bd6225cb81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:12.082110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec7371-5bfe-47af-9750-96a75c84b9c4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:12.083759 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa4300-c9a0-4f82-bcac-72bd6225cb81 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:12.094858 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 531/1042] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:12.095693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa4300-c9a0-4f82-bcac-72bd6225cb81 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:12.179983 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec7371-5bfe-47af-9750-96a75c84b9c4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:12.196722 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa4300-c9a0-4f82-bcac-72bd6225cb81 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:12.215356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd7295-4417-4448-a84f-1893ea7fe69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:12.216022 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd7295-4417-4448-a84f-1893ea7fe69c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:12.216306 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd7295-4417-4448-a84f-1893ea7fe69c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:12.216570 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd7295-4417-4448-a84f-1893ea7fe69c None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:12.217404 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd7295-4417-4448-a84f-1893ea7fe69c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:12.217709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd7295-4417-4448-a84f-1893ea7fe69c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:12.219203 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd7295-4417-4448-a84f-1893ea7fe69c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:12.231152 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea80455-275c-4296-873f-e9c2b43f79ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:12.232096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea80455-275c-4296-873f-e9c2b43f79ba None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:12.232576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea80455-275c-4296-873f-e9c2b43f79ba None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:12.233041 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea80455-275c-4296-873f-e9c2b43f79ba None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:12.233922 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea80455-275c-4296-873f-e9c2b43f79ba None admin] RBAC: Adding query filter params (type=image) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:12.234403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea80455-275c-4296-873f-e9c2b43f79ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:12.235974 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea80455-275c-4296-873f-e9c2b43f79ba None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:12.236880 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 512/1043] 10.222.0.24 () {56 vars in 1133 bytes} [Tue May 17 21:51:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:12.242530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd7295-4417-4448-a84f-1893ea7fe69c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:12.245895 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 532/1044] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:12.251210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea80455-275c-4296-873f-e9c2b43f79ba None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:12.342301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd7295-4417-4448-a84f-1893ea7fe69c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:12.347341 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea80455-275c-4296-873f-e9c2b43f79ba None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:12.376222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429798a-3751-4867-8ede-0ea0f8c1a422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:12.377170 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429798a-3751-4867-8ede-0ea0f8c1a422 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:12.377626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429798a-3751-4867-8ede-0ea0f8c1a422 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:12.378073 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429798a-3751-4867-8ede-0ea0f8c1a422 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:12.379845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c15f-1c55-4d9a-b036-eca1f0990e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:12.380492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c15f-1c55-4d9a-b036-eca1f0990e5a None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:12.380771 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c15f-1c55-4d9a-b036-eca1f0990e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:12.381042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c15f-1c55-4d9a-b036-eca1f0990e5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:12.383083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7c15f-1c55-4d9a-b036-eca1f0990e5a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:12.383690 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7c15f-1c55-4d9a-b036-eca1f0990e5a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:12.443289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429798a-3751-4867-8ede-0ea0f8c1a422 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:12.445318 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429798a-3751-4867-8ede-0ea0f8c1a422 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:12.465238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 533/1045] 10.222.0.24 () {60 vars in 1144 bytes} [Tue May 17 21:51:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:51:12.561954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 513/1046] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:51:12 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 21:51:12.568150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c15f-1c55-4d9a-b036-eca1f0990e5a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:12.681774 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c15f-1c55-4d9a-b036-eca1f0990e5a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:12.714907 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992de17-efc0-40e0-84f2-ae7a8bf1b01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:12.715720 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992de17-efc0-40e0-84f2-ae7a8bf1b01c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:12.715996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992de17-efc0-40e0-84f2-ae7a8bf1b01c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:12.716265 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992de17-efc0-40e0-84f2-ae7a8bf1b01c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:12.726111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992de17-efc0-40e0-84f2-ae7a8bf1b01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:12.727571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992de17-efc0-40e0-84f2-ae7a8bf1b01c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:12.745205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3992de17-efc0-40e0-84f2-ae7a8bf1b01c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:51:12.745205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:12.745205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:12.745205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:12.745205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:12.745205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:12.745205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:12.745205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:12.745205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:12.745205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:12.745205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:12.745205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:12.745205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:51:12.745205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:51:12.745205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:12.746107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:12.751817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:51:12.751817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:51:12.751817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:51:12.751817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:12.751817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 534/1047] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:12.753497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429798a-3751-4867-8ede-0ea0f8c1a422 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:12.849976 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429798a-3751-4867-8ede-0ea0f8c1a422 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:12.883415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da027462-56c6-4db6-924e-8eb6d70765f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:12.884084 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da027462-56c6-4db6-924e-8eb6d70765f9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:12.884367 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da027462-56c6-4db6-924e-8eb6d70765f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:12.884642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da027462-56c6-4db6-924e-8eb6d70765f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:12.885364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da027462-56c6-4db6-924e-8eb6d70765f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:12.885670 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da027462-56c6-4db6-924e-8eb6d70765f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:12.887025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da027462-56c6-4db6-924e-8eb6d70765f9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:12.903744 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 514/1048] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:12.904902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992de17-efc0-40e0-84f2-ae7a8bf1b01c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:13.005433 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992de17-efc0-40e0-84f2-ae7a8bf1b01c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:13.040355 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c521af-f9d4-4b79-bb52-376ed60179ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:13.041151 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c521af-f9d4-4b79-bb52-376ed60179ab None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:13.041433 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c521af-f9d4-4b79-bb52-376ed60179ab None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:13.041762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c521af-f9d4-4b79-bb52-376ed60179ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:13.048378 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c521af-f9d4-4b79-bb52-376ed60179ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:13.049827 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c521af-f9d4-4b79-bb52-376ed60179ab None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:13.063642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-07c521af-f9d4-4b79-bb52-376ed60179ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:51:13.063642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:13.063642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:13.063642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:13.063642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:13.063642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:13.063642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:13.063642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:13.063642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:13.063642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:13.063642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:13.063642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:13.063642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:51:13.063642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:51:13.063642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:13.064568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:13.071472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:51:13.071472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:51:13.071472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:51:13.071472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:51:13.071472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:51:13.071472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:51:13.071472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:51:13.071472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:13.071472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 535/1049] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:51:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:51:13.071990 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da027462-56c6-4db6-924e-8eb6d70765f9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:13.168674 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da027462-56c6-4db6-924e-8eb6d70765f9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:13.201994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e177892-dbb0-4d73-88dc-03dc786735c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:13.202660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e177892-dbb0-4d73-88dc-03dc786735c6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:13.202942 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e177892-dbb0-4d73-88dc-03dc786735c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:13.203329 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e177892-dbb0-4d73-88dc-03dc786735c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:13.204117 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e177892-dbb0-4d73-88dc-03dc786735c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:13.204442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e177892-dbb0-4d73-88dc-03dc786735c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:13.205843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e177892-dbb0-4d73-88dc-03dc786735c6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:13.222611 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 515/1050] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:51:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:13.223863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c521af-f9d4-4b79-bb52-376ed60179ab None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:13.338274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c521af-f9d4-4b79-bb52-376ed60179ab None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:13.381057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e258b49-fb67-4698-9662-2717894745e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:13.381755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e258b49-fb67-4698-9662-2717894745e8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:13.382038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e258b49-fb67-4698-9662-2717894745e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:13.382312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e258b49-fb67-4698-9662-2717894745e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:13.383162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e258b49-fb67-4698-9662-2717894745e8 None admin] RBAC: Adding query filter params (role.id=0b73cc84850242ada8c420aae30575ea, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=8d06113649924eae83d04bc22337bd6d) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:13.383477 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e258b49-fb67-4698-9662-2717894745e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:13.384905 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e258b49-fb67-4698-9662-2717894745e8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:13.395432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 536/1051] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:51:13 2022] GET /identity/v3/role_assignments?user.id=8d06113649924eae83d04bc22337bd6d&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=0b73cc84850242ada8c420aae30575ea => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:13.634342 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2941b-4f0d-4d54-85c2-084d55d89572 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:13.634637 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2941b-4f0d-4d54-85c2-084d55d89572 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:13.634828 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2941b-4f0d-4d54-85c2-084d55d89572 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:13.636373 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 516/1052] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:13.641392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d9f37-3903-4e56-b02a-c7a2209e77c9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:13.641690 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d9f37-3903-4e56-b02a-c7a2209e77c9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:13.641964 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d9f37-3903-4e56-b02a-c7a2209e77c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:13.659620 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6d8d9f37-3903-4e56-b02a-c7a2209e77c9 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:13.660821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6d8d9f37-3903-4e56-b02a-c7a2209e77c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:13.732338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 537/1053] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:13.755146 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2941b-4f0d-4d54-85c2-084d55d89572 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:13.853937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2941b-4f0d-4d54-85c2-084d55d89572 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:13.890432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790c4d6-83d9-4983-89bb-f7389bb97008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:13.890432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790c4d6-83d9-4983-89bb-f7389bb97008 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:13.890432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790c4d6-83d9-4983-89bb-f7389bb97008 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:13.890432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790c4d6-83d9-4983-89bb-f7389bb97008 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:13.901756 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790c4d6-83d9-4983-89bb-f7389bb97008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3790c4d6-83d9-4983-89bb-f7389bb97008 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:51:13.909355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:13.910264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:13.911101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:13.911101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:13.911101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:13.911101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:13.911101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:51:13.911101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:51:13.911101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:51:13.911101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:51:13.911101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:51:13.911101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:51:13.911101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:51:13.911101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:13.911101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 517/1054] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:51:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:13.916580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d9f37-3903-4e56-b02a-c7a2209e77c9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:14.020716 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d9f37-3903-4e56-b02a-c7a2209e77c9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:14.053769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03102d-84ea-4536-8062-bc63e6c5bfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:14.054396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03102d-84ea-4536-8062-bc63e6c5bfcd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:14.054674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03102d-84ea-4536-8062-bc63e6c5bfcd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:14.054943 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03102d-84ea-4536-8062-bc63e6c5bfcd None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:14.055726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03102d-84ea-4536-8062-bc63e6c5bfcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:14.056027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03102d-84ea-4536-8062-bc63e6c5bfcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:14.057390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03102d-84ea-4536-8062-bc63e6c5bfcd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:14.073386 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 538/1055] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:51:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:14.076269 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790c4d6-83d9-4983-89bb-f7389bb97008 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:14.173558 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790c4d6-83d9-4983-89bb-f7389bb97008 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:14.206668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11891e6a-3781-465b-a764-65bfb97bd30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:14.207903 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11891e6a-3781-465b-a764-65bfb97bd30f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:14.208371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11891e6a-3781-465b-a764-65bfb97bd30f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:14.208842 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11891e6a-3781-465b-a764-65bfb97bd30f None admin] PATH_INFO: `/v3/users/9947a2b056374b63b75faae2194dc17f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:14.223095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11891e6a-3781-465b-a764-65bfb97bd30f None admin] RBAC: Authorizing `identity:get_user(user_id=9947a2b056374b63b75faae2194dc17f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:14.224791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11891e6a-3781-465b-a764-65bfb97bd30f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:14.227043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 518/1056] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:51:14 2022] GET /identity/v3/users/9947a2b056374b63b75faae2194dc17f => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:14.232321 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03102d-84ea-4536-8062-bc63e6c5bfcd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:14.328959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03102d-84ea-4536-8062-bc63e6c5bfcd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:14.361100 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f83cc1-2492-46fc-89bd-62219cd9a7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:14.361754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f83cc1-2492-46fc-89bd-62219cd9a7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:14.362020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f83cc1-2492-46fc-89bd-62219cd9a7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:14.362289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f83cc1-2492-46fc-89bd-62219cd9a7c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:14.426402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f83cc1-2492-46fc-89bd-62219cd9a7c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:14.427788 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f83cc1-2492-46fc-89bd-62219cd9a7c1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:14.528553 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 539/1057] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:51:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:51:14.530024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11891e6a-3781-465b-a764-65bfb97bd30f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:14.631957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11891e6a-3781-465b-a764-65bfb97bd30f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:14.664065 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c208f-f137-46e6-988b-aa9092e1ce8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:14.664974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c208f-f137-46e6-988b-aa9092e1ce8d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:14.665355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c208f-f137-46e6-988b-aa9092e1ce8d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:14.665627 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c208f-f137-46e6-988b-aa9092e1ce8d None admin] PATH_INFO: `/v3/projects/690a587e919e42dea7f011cb69ab07ae` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:14.666785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c208f-f137-46e6-988b-aa9092e1ce8d None admin] RBAC: Authorizing `identity:get_project(project_id=690a587e919e42dea7f011cb69ab07ae)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:14.668215 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c208f-f137-46e6-988b-aa9092e1ce8d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:14.674906 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 519/1058] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:51:14 2022] GET /identity/v3/projects/690a587e919e42dea7f011cb69ab07ae => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:14.675862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f83cc1-2492-46fc-89bd-62219cd9a7c1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:14.729828 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9ba7a-fc7e-48f4-a4db-f68b7c45d243 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:14.730119 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9ba7a-fc7e-48f4-a4db-f68b7c45d243 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:14.730305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9ba7a-fc7e-48f4-a4db-f68b7c45d243 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:14.731684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 520/1059] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:14.736488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a0ea9-4a51-4de7-92f6-28344ca90336 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:14.736776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a0ea9-4a51-4de7-92f6-28344ca90336 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:14.737049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a0ea9-4a51-4de7-92f6-28344ca90336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:14.753593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8f6a0ea9-4a51-4de7-92f6-28344ca90336 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:14.754758 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8f6a0ea9-4a51-4de7-92f6-28344ca90336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:14.774509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f83cc1-2492-46fc-89bd-62219cd9a7c1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:14.809586 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3c153-beab-4b34-85ec-ffeca95d1d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:14.810268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3c153-beab-4b34-85ec-ffeca95d1d61 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:14.810552 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3c153-beab-4b34-85ec-ffeca95d1d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:14.810824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3c153-beab-4b34-85ec-ffeca95d1d61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:14.811686 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3c153-beab-4b34-85ec-ffeca95d1d61 None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=690a587e919e42dea7f011cb69ab07ae, user.id=9947a2b056374b63b75faae2194dc17f) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:14.811993 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3c153-beab-4b34-85ec-ffeca95d1d61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:14.813412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3c153-beab-4b34-85ec-ffeca95d1d61 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:14.827140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 540/1060] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:51:14 2022] GET /identity/v3/role_assignments?user.id=9947a2b056374b63b75faae2194dc17f&scope.project.id=690a587e919e42dea7f011cb69ab07ae&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:14.829733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 521/1061] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:51:14.853118 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3c153-beab-4b34-85ec-ffeca95d1d61 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:14.960910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3c153-beab-4b34-85ec-ffeca95d1d61 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:15.001728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137910f-37c5-4ec8-a62b-ae27578a1819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:15.002310 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137910f-37c5-4ec8-a62b-ae27578a1819 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:15.002592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137910f-37c5-4ec8-a62b-ae27578a1819 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:15.002869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137910f-37c5-4ec8-a62b-ae27578a1819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:15.070184 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137910f-37c5-4ec8-a62b-ae27578a1819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:15.071656 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137910f-37c5-4ec8-a62b-ae27578a1819 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:15.166600 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 541/1062] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:51:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:51:15.172197 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a0ea9-4a51-4de7-92f6-28344ca90336 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:15.276200 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a0ea9-4a51-4de7-92f6-28344ca90336 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:15.308179 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c3fb9-4cd6-4445-87ad-e3be08372749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:15.308968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c3fb9-4cd6-4445-87ad-e3be08372749 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:15.309243 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c3fb9-4cd6-4445-87ad-e3be08372749 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:15.309513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c3fb9-4cd6-4445-87ad-e3be08372749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:15.320317 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c3fb9-4cd6-4445-87ad-e3be08372749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:15.321752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c3fb9-4cd6-4445-87ad-e3be08372749 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:15.344488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-739c3fb9-4cd6-4445-87ad-e3be08372749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:51:15.344488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:15.344488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:15.344488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:15.344488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:15.344488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:15.344488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:15.344488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:15.344488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:15.344488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:15.344488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:15.344488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:15.344488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:51:15.344488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:51:15.344488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:15.345528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:15.346478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:51:15.346478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:51:15.346478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:51:15.346478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:15.351153 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 522/1063] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:15.351895 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137910f-37c5-4ec8-a62b-ae27578a1819 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:15.456993 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137910f-37c5-4ec8-a62b-ae27578a1819 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:15.490438 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd93db-0092-4f08-be0c-3525a703696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:15.491100 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd93db-0092-4f08-be0c-3525a703696f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:15.491430 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd93db-0092-4f08-be0c-3525a703696f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:15.491681 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd93db-0092-4f08-be0c-3525a703696f None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:15.492395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd93db-0092-4f08-be0c-3525a703696f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:15.492700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd93db-0092-4f08-be0c-3525a703696f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:15.494065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd93db-0092-4f08-be0c-3525a703696f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:15.511151 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 542/1064] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:15.611582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2685c7-7397-4def-8519-96176b4139d3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:15.611937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2685c7-7397-4def-8519-96176b4139d3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:15.612145 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2685c7-7397-4def-8519-96176b4139d3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:15.613701 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 523/1065] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:15.620264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e609c-b1c4-4c36-ba53-b94f707783c5 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:15.620569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e609c-b1c4-4c36-ba53-b94f707783c5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:15.620834 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e609c-b1c4-4c36-ba53-b94f707783c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:15.638807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1b7e609c-b1c4-4c36-ba53-b94f707783c5 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:15.640033 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1b7e609c-b1c4-4c36-ba53-b94f707783c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:15.712578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 543/1066] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:15.734731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2685c7-7397-4def-8519-96176b4139d3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:15.839306 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2685c7-7397-4def-8519-96176b4139d3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:15.872188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d83e4b-9af1-4769-82b2-2bc1225f25e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:15.872918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d83e4b-9af1-4769-82b2-2bc1225f25e4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:15.873194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d83e4b-9af1-4769-82b2-2bc1225f25e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:15.873464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d83e4b-9af1-4769-82b2-2bc1225f25e4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:15.883526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d83e4b-9af1-4769-82b2-2bc1225f25e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-50d83e4b-9af1-4769-82b2-2bc1225f25e4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:51:15.891596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:15.892590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:15.893944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:15.893944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:15.893944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:15.893944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:15.893944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:51:15.893944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:51:15.893944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:51:15.893944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:51:15.893944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:51:15.893944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:51:15.893944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 21:51:15.893944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:15.893944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 524/1067] 10.222.0.24 () {56 vars in 1120 bytes} [Tue May 17 21:51:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:15.899817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e609c-b1c4-4c36-ba53-b94f707783c5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:15.996884 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e609c-b1c4-4c36-ba53-b94f707783c5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:16.037871 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd2a95-bf80-4f84-aeba-aa807f983cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:16.038602 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2a95-bf80-4f84-aeba-aa807f983cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:16.038886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2a95-bf80-4f84-aeba-aa807f983cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:16.039184 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2a95-bf80-4f84-aeba-aa807f983cc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:16.039924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd2a95-bf80-4f84-aeba-aa807f983cc8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:16.040224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd2a95-bf80-4f84-aeba-aa807f983cc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:16.041581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd2a95-bf80-4f84-aeba-aa807f983cc8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:16.049559 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 544/1068] 10.222.0.24 () {56 vars in 1115 bytes} [Tue May 17 21:51:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:16.056289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d83e4b-9af1-4769-82b2-2bc1225f25e4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:16.155335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d83e4b-9af1-4769-82b2-2bc1225f25e4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:16.187372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa995-aca5-41ab-99d7-38600602eed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:16.188149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa995-aca5-41ab-99d7-38600602eed3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:16.188426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa995-aca5-41ab-99d7-38600602eed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:16.188693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa995-aca5-41ab-99d7-38600602eed3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:16.199534 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fa995-aca5-41ab-99d7-38600602eed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:16.200954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fa995-aca5-41ab-99d7-38600602eed3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:16.217987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-794fa995-aca5-41ab-99d7-38600602eed3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:51:16.217987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:16.217987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:16.217987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:16.217987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:16.217987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:16.217987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:16.217987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:16.217987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:16.217987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:16.217987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:16.217987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:16.217987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:51:16.217987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:51:16.217987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:16.218918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:16.220059 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:51:16.220059 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:51:16.220059 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:51:16.220059 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:16.220059 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 525/1069] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:16.224789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd2a95-bf80-4f84-aeba-aa807f983cc8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:16.317519 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd2a95-bf80-4f84-aeba-aa807f983cc8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:16.349196 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf34c04-1f33-498c-9faa-b8d060303119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:16.349836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf34c04-1f33-498c-9faa-b8d060303119 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:16.350142 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf34c04-1f33-498c-9faa-b8d060303119 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:16.350409 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf34c04-1f33-498c-9faa-b8d060303119 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:16.351127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf34c04-1f33-498c-9faa-b8d060303119 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:16.351450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf34c04-1f33-498c-9faa-b8d060303119 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:16.352794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf34c04-1f33-498c-9faa-b8d060303119 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:16.369374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 545/1070] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:16.374851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa995-aca5-41ab-99d7-38600602eed3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:16.471074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa995-aca5-41ab-99d7-38600602eed3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:16.502951 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857acbb5-da3f-49e2-aa7c-31ce5e55a066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:16.503765 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857acbb5-da3f-49e2-aa7c-31ce5e55a066 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:16.504044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857acbb5-da3f-49e2-aa7c-31ce5e55a066 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:16.504312 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857acbb5-da3f-49e2-aa7c-31ce5e55a066 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:16.511907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857acbb5-da3f-49e2-aa7c-31ce5e55a066 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:16.513332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857acbb5-da3f-49e2-aa7c-31ce5e55a066 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-857acbb5-da3f-49e2-aa7c-31ce5e55a066 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:51:16.527623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:16.528724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:16.529683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:16.529683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:16.529683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:51:16.529683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:51:16.529683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:51:16.529683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:51:16.529683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:51:16.529683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:51:16.529683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 21:51:16.529683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:16.529683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 526/1071] 10.222.0.24 () {56 vars in 1093 bytes} [Tue May 17 21:51:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:16.534649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf34c04-1f33-498c-9faa-b8d060303119 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:16.629597 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf34c04-1f33-498c-9faa-b8d060303119 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:16.661712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ece62f-85d5-4ad5-933d-ede74f7cb187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:16.662390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ece62f-85d5-4ad5-933d-ede74f7cb187 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:16.663578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ece62f-85d5-4ad5-933d-ede74f7cb187 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:16.663578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ece62f-85d5-4ad5-933d-ede74f7cb187 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:16.664359 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ece62f-85d5-4ad5-933d-ede74f7cb187 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:16.664658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ece62f-85d5-4ad5-933d-ede74f7cb187 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:16.666126 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ece62f-85d5-4ad5-933d-ede74f7cb187 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:16.682897 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 546/1072] 10.222.0.24 () {56 vars in 1133 bytes} [Tue May 17 21:51:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:16.688548 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857acbb5-da3f-49e2-aa7c-31ce5e55a066 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:16.784505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857acbb5-da3f-49e2-aa7c-31ce5e55a066 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:16.816562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d56d0-56fe-4c1d-acfc-7ba25b7be7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:16.817349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d56d0-56fe-4c1d-acfc-7ba25b7be7cc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:16.817629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d56d0-56fe-4c1d-acfc-7ba25b7be7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:16.817901 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d56d0-56fe-4c1d-acfc-7ba25b7be7cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:16.828684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d56d0-56fe-4c1d-acfc-7ba25b7be7cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:16.830105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d56d0-56fe-4c1d-acfc-7ba25b7be7cc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:16.847167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-476d56d0-56fe-4c1d-acfc-7ba25b7be7cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:51:16.847167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:16.847167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:16.847167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:16.847167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:16.847167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:16.847167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:16.847167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:16.847167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:16.847167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:16.847167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:16.847167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:16.847167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:51:16.847167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:51:16.847167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:16.848110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:16.848980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:51:16.848980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:51:16.848980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:51:16.848980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:16.848980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 527/1073] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:51:16.854073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ece62f-85d5-4ad5-933d-ede74f7cb187 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:16.953801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ece62f-85d5-4ad5-933d-ede74f7cb187 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:16.986548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a709e7c-c866-49c2-a5d5-24ddee04d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:16.987237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a709e7c-c866-49c2-a5d5-24ddee04d8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:16.987525 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a709e7c-c866-49c2-a5d5-24ddee04d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:16.987800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a709e7c-c866-49c2-a5d5-24ddee04d8b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:16.988505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a709e7c-c866-49c2-a5d5-24ddee04d8b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:16.988805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a709e7c-c866-49c2-a5d5-24ddee04d8b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:16.990158 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a709e7c-c866-49c2-a5d5-24ddee04d8b7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:17.001202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 547/1074] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:17.007188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d56d0-56fe-4c1d-acfc-7ba25b7be7cc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:17.070735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29200081-621c-4c5e-aba0-80a1ccd6c07a None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:17.071029 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29200081-621c-4c5e-aba0-80a1ccd6c07a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:17.071334 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29200081-621c-4c5e-aba0-80a1ccd6c07a None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:17.072701 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 548/1075] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:51:17.077986 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9ecf8-c3e4-4bf2-8a02-5877975f753b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:17.078275 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9ecf8-c3e4-4bf2-8a02-5877975f753b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:17.078555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9ecf8-c3e4-4bf2-8a02-5877975f753b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:17.095250 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9ba9ecf8-c3e4-4bf2-8a02-5877975f753b None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:17.096463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9ba9ecf8-c3e4-4bf2-8a02-5877975f753b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:17.104232 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d56d0-56fe-4c1d-acfc-7ba25b7be7cc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:17.136225 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff486f05-ea8a-4a38-b209-8227902be21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:17.137006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff486f05-ea8a-4a38-b209-8227902be21d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:17.137287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff486f05-ea8a-4a38-b209-8227902be21d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:17.137560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff486f05-ea8a-4a38-b209-8227902be21d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:17.144023 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff486f05-ea8a-4a38-b209-8227902be21d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:17.145441 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff486f05-ea8a-4a38-b209-8227902be21d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:17.159810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ff486f05-ea8a-4a38-b209-8227902be21d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:51:17.159810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:17.159810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:17.159810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:17.159810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:17.159810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:17.159810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:17.159810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:17.159810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:17.159810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:17.159810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:17.159810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:17.159810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:51:17.159810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:51:17.159810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:17.160855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:17.161937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:51:17.161937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:51:17.161937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:51:17.161937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:51:17.161937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:51:17.161937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:51:17.161937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:51:17.161937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:17.163087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 549/1076] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:51:17.163205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 528/1077] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:51:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:17.167201 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9ecf8-c3e4-4bf2-8a02-5877975f753b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:17.185638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff486f05-ea8a-4a38-b209-8227902be21d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:17.261671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9ecf8-c3e4-4bf2-8a02-5877975f753b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:17.280185 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff486f05-ea8a-4a38-b209-8227902be21d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:17.294783 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17cda0-659c-4ece-9a74-4822717ed8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:17.295466 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17cda0-659c-4ece-9a74-4822717ed8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:17.295740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17cda0-659c-4ece-9a74-4822717ed8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:17.296008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17cda0-659c-4ece-9a74-4822717ed8c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:17.296783 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17cda0-659c-4ece-9a74-4822717ed8c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:17.297082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17cda0-659c-4ece-9a74-4822717ed8c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:17.298533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17cda0-659c-4ece-9a74-4822717ed8c9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:17.310575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 550/1078] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:51:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:17.314323 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03c1de-922c-4112-a4b6-c9e9188de27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:17.315122 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03c1de-922c-4112-a4b6-c9e9188de27d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:17.315545 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03c1de-922c-4112-a4b6-c9e9188de27d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:17.315822 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03c1de-922c-4112-a4b6-c9e9188de27d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:17.316300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17cda0-659c-4ece-9a74-4822717ed8c9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:17.326385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03c1de-922c-4112-a4b6-c9e9188de27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ec03c1de-922c-4112-a4b6-c9e9188de27d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:51:17.333952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:17.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:17.341074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:17.341074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:17.341074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:17.341074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:17.341074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:51:17.341074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:51:17.341074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:51:17.341074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:51:17.341074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:51:17.341074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:51:17.341074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:51:17.341074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:17.341074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 529/1079] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:51:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:51:17.341074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03c1de-922c-4112-a4b6-c9e9188de27d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:17.416440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17cda0-659c-4ece-9a74-4822717ed8c9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:17.441945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03c1de-922c-4112-a4b6-c9e9188de27d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:17.449215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb90ed7-3b2c-4488-b7a8-37d96f811885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:17.450095 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb90ed7-3b2c-4488-b7a8-37d96f811885 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:17.450374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb90ed7-3b2c-4488-b7a8-37d96f811885 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:17.450645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb90ed7-3b2c-4488-b7a8-37d96f811885 None admin] PATH_INFO: `/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/8d06113649924eae83d04bc22337bd6d/roles/0b73cc84850242ada8c420aae30575ea` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:17.452880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb90ed7-3b2c-4488-b7a8-37d96f811885 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e90e91d3094e67b09b2b8137f210f4, user_id=8d06113649924eae83d04bc22337bd6d, role_id=0b73cc84850242ada8c420aae30575ea)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:17.454315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb90ed7-3b2c-4488-b7a8-37d96f811885 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:17.476344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a192de7-2418-4366-a3e6-edb11429f91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:17.477001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a192de7-2418-4366-a3e6-edb11429f91a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:17.477772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a192de7-2418-4366-a3e6-edb11429f91a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:17.477772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a192de7-2418-4366-a3e6-edb11429f91a None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:17.478250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a192de7-2418-4366-a3e6-edb11429f91a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:17.478549 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a192de7-2418-4366-a3e6-edb11429f91a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:17.479944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a192de7-2418-4366-a3e6-edb11429f91a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:17.487713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 530/1080] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:51:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:17.493415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a192de7-2418-4366-a3e6-edb11429f91a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:17.539165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 551/1081] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:51:17 2022] PUT /identity/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/8d06113649924eae83d04bc22337bd6d/roles/0b73cc84850242ada8c420aae30575ea => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 21:51:17.594257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a192de7-2418-4366-a3e6-edb11429f91a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:17.628626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772ab8e-3474-4ba9-a260-5314d393984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:17.629514 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772ab8e-3474-4ba9-a260-5314d393984a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:17.629798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772ab8e-3474-4ba9-a260-5314d393984a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:17.630073 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772ab8e-3474-4ba9-a260-5314d393984a None admin] PATH_INFO: `/v3/users/9947a2b056374b63b75faae2194dc17f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:17.631939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772ab8e-3474-4ba9-a260-5314d393984a None admin] RBAC: Authorizing `identity:get_user(user_id=9947a2b056374b63b75faae2194dc17f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:17.633379 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772ab8e-3474-4ba9-a260-5314d393984a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:17.635065 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 531/1082] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:51:17 2022] GET /identity/v3/users/9947a2b056374b63b75faae2194dc17f => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:17.640954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb90ed7-3b2c-4488-b7a8-37d96f811885 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:17.751016 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb90ed7-3b2c-4488-b7a8-37d96f811885 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:17.783895 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82076a7-3782-4d09-9a97-0f941eb6f6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:17.784744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82076a7-3782-4d09-9a97-0f941eb6f6fc None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:17.785018 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82076a7-3782-4d09-9a97-0f941eb6f6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:17.785288 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82076a7-3782-4d09-9a97-0f941eb6f6fc None admin] PATH_INFO: `/v3/projects/690a587e919e42dea7f011cb69ab07ae` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:17.786435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82076a7-3782-4d09-9a97-0f941eb6f6fc None admin] RBAC: Authorizing `identity:get_project(project_id=690a587e919e42dea7f011cb69ab07ae)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:17.787919 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82076a7-3782-4d09-9a97-0f941eb6f6fc None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:17.789582 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 552/1083] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:51:17 2022] GET /identity/v3/projects/690a587e919e42dea7f011cb69ab07ae => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:17.795321 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772ab8e-3474-4ba9-a260-5314d393984a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:17.891222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772ab8e-3474-4ba9-a260-5314d393984a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:17.923930 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596eb21-141b-4a6a-a2e7-f83c017b47ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:17.924807 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596eb21-141b-4a6a-a2e7-f83c017b47ff None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:17.925083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596eb21-141b-4a6a-a2e7-f83c017b47ff None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:17.925351 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596eb21-141b-4a6a-a2e7-f83c017b47ff None admin] PATH_INFO: `/v3/projects/690a587e919e42dea7f011cb69ab07ae/users/9947a2b056374b63b75faae2194dc17f/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:17.927555 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596eb21-141b-4a6a-a2e7-f83c017b47ff None admin] RBAC: Authorizing `identity:create_grant(project_id=690a587e919e42dea7f011cb69ab07ae, user_id=9947a2b056374b63b75faae2194dc17f, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:17.929200 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596eb21-141b-4a6a-a2e7-f83c017b47ff None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:18.002335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 532/1084] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:51:17 2022] PUT /identity/v3/projects/690a587e919e42dea7f011cb69ab07ae/users/9947a2b056374b63b75faae2194dc17f/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:51:19.838110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2ca00-9cb9-462d-8093-004f96e8cde7 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:19.838646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2ca00-9cb9-462d-8093-004f96e8cde7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:19.838646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2ca00-9cb9-462d-8093-004f96e8cde7 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:19.840092 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 553/1085] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:19.845440 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b838654-bae8-4059-b717-e65c9fde1253 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:19.845863 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b838654-bae8-4059-b717-e65c9fde1253 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:19.845992 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b838654-bae8-4059-b717-e65c9fde1253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:19.862451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1b838654-bae8-4059-b717-e65c9fde1253 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:19.863658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1b838654-bae8-4059-b717-e65c9fde1253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:19.929636 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 533/1086] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:19.952600 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2ca00-9cb9-462d-8093-004f96e8cde7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:20.070634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2ca00-9cb9-462d-8093-004f96e8cde7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:20.104277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e82dda-6091-4882-84fb-4a49af4afc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:20.105006 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e82dda-6091-4882-84fb-4a49af4afc98 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:20.105289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e82dda-6091-4882-84fb-4a49af4afc98 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:20.105565 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e82dda-6091-4882-84fb-4a49af4afc98 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:20.115267 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e82dda-6091-4882-84fb-4a49af4afc98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-39e82dda-6091-4882-84fb-4a49af4afc98 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:51:20.126852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:20.128765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:20.130862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:20.130862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:20.130862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:20.130862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:20.130862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:51:20.130862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:51:20.130862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:51:20.130862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:51:20.130862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:51:20.130862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:51:20.130862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 21:51:20.130862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:20.130862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 554/1087] 10.222.0.24 () {56 vars in 1120 bytes} [Tue May 17 21:51:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:20.136369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b838654-bae8-4059-b717-e65c9fde1253 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:20.215593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9331ccf-0201-4819-8937-d79343035c94 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:20.215878 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9331ccf-0201-4819-8937-d79343035c94 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:20.216157 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9331ccf-0201-4819-8937-d79343035c94 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:20.217655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 555/1088] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:51:20.222421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b2068-0f2a-43b4-b67e-63d40c225754 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:20.222705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b2068-0f2a-43b4-b67e-63d40c225754 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:20.222979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b2068-0f2a-43b4-b67e-63d40c225754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:20.232737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b838654-bae8-4059-b717-e65c9fde1253 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:20.239198 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c19b2068-0f2a-43b4-b67e-63d40c225754 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:20.240351 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c19b2068-0f2a-43b4-b67e-63d40c225754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:20.265464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4e393-2620-45ef-ab55-e2891feb8b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:20.266142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4e393-2620-45ef-ab55-e2891feb8b7c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:20.266420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4e393-2620-45ef-ab55-e2891feb8b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:20.266692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4e393-2620-45ef-ab55-e2891feb8b7c None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:20.267467 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4e393-2620-45ef-ab55-e2891feb8b7c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:20.267776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4e393-2620-45ef-ab55-e2891feb8b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:20.269132 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4e393-2620-45ef-ab55-e2891feb8b7c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:20.277392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 534/1089] 10.222.0.24 () {56 vars in 1115 bytes} [Tue May 17 21:51:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:20.282969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4e393-2620-45ef-ab55-e2891feb8b7c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:20.305563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 556/1090] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:51:20.328698 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b2068-0f2a-43b4-b67e-63d40c225754 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:20.377631 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4e393-2620-45ef-ab55-e2891feb8b7c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:20.409210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3951c-0e04-4eff-9e98-4b1676d44016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:20.410013 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3951c-0e04-4eff-9e98-4b1676d44016 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:20.410293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3951c-0e04-4eff-9e98-4b1676d44016 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:20.410563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3951c-0e04-4eff-9e98-4b1676d44016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:20.420606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3951c-0e04-4eff-9e98-4b1676d44016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:20.421664 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b2068-0f2a-43b4-b67e-63d40c225754 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:20.422025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3951c-0e04-4eff-9e98-4b1676d44016 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:20.439136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-41a3951c-0e04-4eff-9e98-4b1676d44016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:51:20.439136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:20.439136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:20.439136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:20.439136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:20.439136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:20.439136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:20.439136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:20.439136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:20.439136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:20.439136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:20.439136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:20.439136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:51:20.439136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:51:20.439136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:20.440114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:20.441040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:51:20.441040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:51:20.441040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:51:20.441040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:20.441040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 535/1091] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:51:20.446823 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3951c-0e04-4eff-9e98-4b1676d44016 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:20.455081 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5383767-8777-40f6-b41b-1cdc5b6d16b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:20.455890 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5383767-8777-40f6-b41b-1cdc5b6d16b8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:20.456167 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5383767-8777-40f6-b41b-1cdc5b6d16b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:20.456436 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5383767-8777-40f6-b41b-1cdc5b6d16b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:20.466235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5383767-8777-40f6-b41b-1cdc5b6d16b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b5383767-8777-40f6-b41b-1cdc5b6d16b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:51:20.473669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:20.474638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:20.476732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:20.476732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:20.476732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:20.476732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:20.476732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:51:20.476732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:51:20.476732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:51:20.476732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:51:20.476732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:51:20.476732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:51:20.476732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:51:20.476732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:20.476732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 557/1092] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:51:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:51:20.481140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5383767-8777-40f6-b41b-1cdc5b6d16b8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:20.543062 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3951c-0e04-4eff-9e98-4b1676d44016 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:20.575007 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5383767-8777-40f6-b41b-1cdc5b6d16b8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:20.575317 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c92e1d-94da-4442-87d6-c86aa8298342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:20.575974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c92e1d-94da-4442-87d6-c86aa8298342 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:20.576257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c92e1d-94da-4442-87d6-c86aa8298342 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:20.576531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c92e1d-94da-4442-87d6-c86aa8298342 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:20.577251 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c92e1d-94da-4442-87d6-c86aa8298342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:20.577550 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c92e1d-94da-4442-87d6-c86aa8298342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:20.578904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c92e1d-94da-4442-87d6-c86aa8298342 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:20.590212 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 536/1093] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:20.595589 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c92e1d-94da-4442-87d6-c86aa8298342 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:20.607170 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2f18c-923f-4d1f-90f3-67691057303b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:20.607826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2f18c-923f-4d1f-90f3-67691057303b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:20.608105 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2f18c-923f-4d1f-90f3-67691057303b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:20.608377 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2f18c-923f-4d1f-90f3-67691057303b None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:20.609109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2f18c-923f-4d1f-90f3-67691057303b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:20.609410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2f18c-923f-4d1f-90f3-67691057303b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:20.610755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2f18c-923f-4d1f-90f3-67691057303b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:20.619263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 558/1094] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:51:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:20.624698 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2f18c-923f-4d1f-90f3-67691057303b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:20.688934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c92e1d-94da-4442-87d6-c86aa8298342 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:20.717779 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2f18c-923f-4d1f-90f3-67691057303b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:20.721472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880da0c8-71f2-4558-aa74-ec928cfcf9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:20.722251 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880da0c8-71f2-4558-aa74-ec928cfcf9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:20.722531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880da0c8-71f2-4558-aa74-ec928cfcf9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:20.722803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880da0c8-71f2-4558-aa74-ec928cfcf9c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:20.729873 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880da0c8-71f2-4558-aa74-ec928cfcf9c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:20.731319 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880da0c8-71f2-4558-aa74-ec928cfcf9c3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-880da0c8-71f2-4558-aa74-ec928cfcf9c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:51:20.745355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:20.746353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:20.747332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:20.747332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:20.747332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:51:20.747332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:51:20.747332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:51:20.747332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:51:20.747332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:51:20.747332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:51:20.747332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 21:51:20.747332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:20.747332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 537/1095] 10.222.0.24 () {56 vars in 1093 bytes} [Tue May 17 21:51:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:51:20.749464 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1566c4c-dab3-431a-9bc5-cb4a689bdd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:20.750320 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1566c4c-dab3-431a-9bc5-cb4a689bdd1a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:20.750599 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1566c4c-dab3-431a-9bc5-cb4a689bdd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:20.750872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1566c4c-dab3-431a-9bc5-cb4a689bdd1a None admin] PATH_INFO: `/v3/users/9947a2b056374b63b75faae2194dc17f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:20.752088 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880da0c8-71f2-4558-aa74-ec928cfcf9c3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:20.752230 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1566c4c-dab3-431a-9bc5-cb4a689bdd1a None admin] RBAC: Authorizing `identity:get_user(user_id=9947a2b056374b63b75faae2194dc17f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:20.753651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1566c4c-dab3-431a-9bc5-cb4a689bdd1a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:20.755397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 559/1096] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:51:20 2022] GET /identity/v3/users/9947a2b056374b63b75faae2194dc17f => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:20.761166 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1566c4c-dab3-431a-9bc5-cb4a689bdd1a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:20.847476 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880da0c8-71f2-4558-aa74-ec928cfcf9c3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:20.855369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1566c4c-dab3-431a-9bc5-cb4a689bdd1a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:20.880510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e49bc-db27-4ebb-9af5-1221880b65e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:20.881773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e49bc-db27-4ebb-9af5-1221880b65e3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:20.882055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e49bc-db27-4ebb-9af5-1221880b65e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:20.882328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e49bc-db27-4ebb-9af5-1221880b65e3 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:20.883198 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e49bc-db27-4ebb-9af5-1221880b65e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:20.883510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e49bc-db27-4ebb-9af5-1221880b65e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:20.884933 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e49bc-db27-4ebb-9af5-1221880b65e3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:20.888075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e705e-84d0-40a9-b89d-b5709dc7d085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:20.888709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e705e-84d0-40a9-b89d-b5709dc7d085 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:20.888984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e705e-84d0-40a9-b89d-b5709dc7d085 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:20.889253 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e705e-84d0-40a9-b89d-b5709dc7d085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:20.901834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 538/1097] 10.222.0.24 () {56 vars in 1133 bytes} [Tue May 17 21:51:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:20.907402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e49bc-db27-4ebb-9af5-1221880b65e3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:20.954601 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e705e-84d0-40a9-b89d-b5709dc7d085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:20.955995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e705e-84d0-40a9-b89d-b5709dc7d085 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:21.002066 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e49bc-db27-4ebb-9af5-1221880b65e3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:21.034363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46634f-8cf3-42c8-a62a-3c0bcf5f6ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:21.035002 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46634f-8cf3-42c8-a62a-3c0bcf5f6ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:21.035314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46634f-8cf3-42c8-a62a-3c0bcf5f6ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:21.035592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46634f-8cf3-42c8-a62a-3c0bcf5f6ef7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:21.054028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 560/1098] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:51:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 21:51:21.055287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e705e-84d0-40a9-b89d-b5709dc7d085 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:21.100649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46634f-8cf3-42c8-a62a-3c0bcf5f6ef7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:21.102087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46634f-8cf3-42c8-a62a-3c0bcf5f6ef7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:21.147378 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e705e-84d0-40a9-b89d-b5709dc7d085 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:21.179657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3c757-8d19-4083-926a-20a38adccd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:21.180505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3c757-8d19-4083-926a-20a38adccd10 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:21.180783 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3c757-8d19-4083-926a-20a38adccd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:21.181054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3c757-8d19-4083-926a-20a38adccd10 None admin] PATH_INFO: `/v3/projects/690a587e919e42dea7f011cb69ab07ae` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:21.182243 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3c757-8d19-4083-926a-20a38adccd10 None admin] RBAC: Authorizing `identity:get_project(project_id=690a587e919e42dea7f011cb69ab07ae)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:21.183737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3c757-8d19-4083-926a-20a38adccd10 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:21.190396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 561/1099] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:51:21 2022] GET /identity/v3/projects/690a587e919e42dea7f011cb69ab07ae => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:21.191265 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3c757-8d19-4083-926a-20a38adccd10 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:21.200278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 539/1100] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:51:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 21:51:21.201254 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46634f-8cf3-42c8-a62a-3c0bcf5f6ef7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:21.285875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3c757-8d19-4083-926a-20a38adccd10 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:21.294065 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46634f-8cf3-42c8-a62a-3c0bcf5f6ef7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:21.320032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ea120-193b-46b9-8aab-77a1db722288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:21.320676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ea120-193b-46b9-8aab-77a1db722288 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:21.320959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ea120-193b-46b9-8aab-77a1db722288 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:21.321232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ea120-193b-46b9-8aab-77a1db722288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:21.322047 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ea120-193b-46b9-8aab-77a1db722288 None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=690a587e919e42dea7f011cb69ab07ae, user.id=9947a2b056374b63b75faae2194dc17f) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:21.322358 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ea120-193b-46b9-8aab-77a1db722288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:21.323818 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ea120-193b-46b9-8aab-77a1db722288 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:21.326970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd78a36-6ceb-4a19-a809-eabffc17d9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:21.327785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd78a36-6ceb-4a19-a809-eabffc17d9fd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:21.328067 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd78a36-6ceb-4a19-a809-eabffc17d9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:21.328340 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd78a36-6ceb-4a19-a809-eabffc17d9fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:21.329505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 562/1101] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:51:21 2022] GET /identity/v3/role_assignments?user.id=9947a2b056374b63b75faae2194dc17f&scope.project.id=690a587e919e42dea7f011cb69ab07ae&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:21.338895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd78a36-6ceb-4a19-a809-eabffc17d9fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:21.340412 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd78a36-6ceb-4a19-a809-eabffc17d9fd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:21.359693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9fd78a36-6ceb-4a19-a809-eabffc17d9fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:51:21.359693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:21.359693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:21.359693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:21.359693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:21.359693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:21.359693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:21.359693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:21.359693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:21.359693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:21.359693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:21.359693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:21.359693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:51:21.359693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:51:21.359693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:21.360677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:21.366993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:51:21.366993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:51:21.366993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:51:21.366993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:21.366993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 540/1102] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:21.367757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ea120-193b-46b9-8aab-77a1db722288 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:21.471276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ea120-193b-46b9-8aab-77a1db722288 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:21.507789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05006c6a-4e0f-4373-9c56-e011bdb29cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:21.508451 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05006c6a-4e0f-4373-9c56-e011bdb29cbd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:21.508734 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05006c6a-4e0f-4373-9c56-e011bdb29cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:21.509015 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05006c6a-4e0f-4373-9c56-e011bdb29cbd None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:21.509726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05006c6a-4e0f-4373-9c56-e011bdb29cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:21.510030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05006c6a-4e0f-4373-9c56-e011bdb29cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:21.511452 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05006c6a-4e0f-4373-9c56-e011bdb29cbd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:21.523332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 563/1103] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:21.529212 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd78a36-6ceb-4a19-a809-eabffc17d9fd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:21.626104 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd78a36-6ceb-4a19-a809-eabffc17d9fd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:21.658756 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f365536-4575-4865-84a8-f29e6cdf4e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:21.659577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f365536-4575-4865-84a8-f29e6cdf4e6d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:21.659860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f365536-4575-4865-84a8-f29e6cdf4e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:21.660133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f365536-4575-4865-84a8-f29e6cdf4e6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:21.667443 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f365536-4575-4865-84a8-f29e6cdf4e6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:21.668872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f365536-4575-4865-84a8-f29e6cdf4e6d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:21.682396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2f365536-4575-4865-84a8-f29e6cdf4e6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:51:21.682396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:21.682396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:21.682396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:21.682396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:21.682396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:21.682396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:21.682396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:21.682396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:21.682396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:21.682396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:21.682396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:21.682396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:51:21.682396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:51:21.682396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:21.683390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:21.684450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:51:21.684450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:51:21.684450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:51:21.684450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:51:21.684450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:51:21.684450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:51:21.684450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:51:21.684450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:21.684450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 541/1104] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:51:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:21.689284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05006c6a-4e0f-4373-9c56-e011bdb29cbd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:21.784798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05006c6a-4e0f-4373-9c56-e011bdb29cbd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:21.818177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dc2a8-b34e-4065-b2bf-ab9eefaa88f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:21.819043 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dc2a8-b34e-4065-b2bf-ab9eefaa88f6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:21.819355 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dc2a8-b34e-4065-b2bf-ab9eefaa88f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:21.819630 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dc2a8-b34e-4065-b2bf-ab9eefaa88f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:21.831675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20dc2a8-b34e-4065-b2bf-ab9eefaa88f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:21.831675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20dc2a8-b34e-4065-b2bf-ab9eefaa88f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:21.831675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20dc2a8-b34e-4065-b2bf-ab9eefaa88f6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:21.833395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 564/1105] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:51:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:21.840025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f365536-4575-4865-84a8-f29e6cdf4e6d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:21.937692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f365536-4575-4865-84a8-f29e6cdf4e6d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:21.969971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33d821-d724-4b15-9869-def18c18e97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:21.970625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33d821-d724-4b15-9869-def18c18e97f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:21.970913 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33d821-d724-4b15-9869-def18c18e97f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:21.971213 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33d821-d724-4b15-9869-def18c18e97f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:21.972042 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33d821-d724-4b15-9869-def18c18e97f None admin] RBAC: Adding query filter params (role.id=0b73cc84850242ada8c420aae30575ea, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=8d06113649924eae83d04bc22337bd6d) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:21.972355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33d821-d724-4b15-9869-def18c18e97f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:21.973768 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33d821-d724-4b15-9869-def18c18e97f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:21.980042 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 542/1106] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:51:21 2022] GET /identity/v3/role_assignments?user.id=8d06113649924eae83d04bc22337bd6d&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=0b73cc84850242ada8c420aae30575ea => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:23.554011 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7204482-d7d3-483c-982a-af8c3280ebe6 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:23.554542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7204482-d7d3-483c-982a-af8c3280ebe6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:23.554542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7204482-d7d3-483c-982a-af8c3280ebe6 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:23.555939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 565/1107] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:23.561895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5f996-5af3-4284-ac8c-3bf11b061cfc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:23.562265 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5f996-5af3-4284-ac8c-3bf11b061cfc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:23.562454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5f996-5af3-4284-ac8c-3bf11b061cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:23.578986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6df5f996-5af3-4284-ac8c-3bf11b061cfc None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:23.580185 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6df5f996-5af3-4284-ac8c-3bf11b061cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:23.644323 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 543/1108] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:23.669496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7204482-d7d3-483c-982a-af8c3280ebe6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:23.765633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7204482-d7d3-483c-982a-af8c3280ebe6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:23.797383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50276cd9-08cd-434f-be5f-88c200b63694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:23.798147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50276cd9-08cd-434f-be5f-88c200b63694 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:23.798422 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50276cd9-08cd-434f-be5f-88c200b63694 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:23.798689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50276cd9-08cd-434f-be5f-88c200b63694 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:23.799910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50276cd9-08cd-434f-be5f-88c200b63694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:23.801583 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50276cd9-08cd-434f-be5f-88c200b63694 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:23.803581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 566/1109] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:23.809135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5f996-5af3-4284-ac8c-3bf11b061cfc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:23.903228 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5f996-5af3-4284-ac8c-3bf11b061cfc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:23.936456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439edf28-600d-4845-a045-9de0c0844826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:23.937115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439edf28-600d-4845-a045-9de0c0844826 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:23.937396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439edf28-600d-4845-a045-9de0c0844826 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:23.937667 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439edf28-600d-4845-a045-9de0c0844826 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:23.938367 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439edf28-600d-4845-a045-9de0c0844826 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:23.939811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439edf28-600d-4845-a045-9de0c0844826 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:24.016426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 544/1110] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:51:23 2022] POST /identity/v3/users => generated 286 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:51:26.265945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f15210-e1b7-4759-92f4-e72dde6f2b02 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:26.266460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f15210-e1b7-4759-92f4-e72dde6f2b02 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:26.266460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f15210-e1b7-4759-92f4-e72dde6f2b02 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:26.267821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 567/1111] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:26.273147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc6f9d-a553-4bfa-8380-3d2d46907143 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:26.273564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc6f9d-a553-4bfa-8380-3d2d46907143 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:26.273698 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc6f9d-a553-4bfa-8380-3d2d46907143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:26.289791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-42cc6f9d-a553-4bfa-8380-3d2d46907143 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:26.290942 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-42cc6f9d-a553-4bfa-8380-3d2d46907143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:26.354135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 545/1112] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:51:26.377696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f15210-e1b7-4759-92f4-e72dde6f2b02 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:26.473347 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f15210-e1b7-4759-92f4-e72dde6f2b02 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:26.506182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43f1ef-abf5-43fc-a0df-f7e2cacf65c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:26.507184 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43f1ef-abf5-43fc-a0df-f7e2cacf65c4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:26.507460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43f1ef-abf5-43fc-a0df-f7e2cacf65c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:26.507727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43f1ef-abf5-43fc-a0df-f7e2cacf65c4 None admin] PATH_INFO: `/v3/roles/e5fee74fe53d429897caab84ecf4e5d9` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:26.509164 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43f1ef-abf5-43fc-a0df-f7e2cacf65c4 None admin] RBAC: Authorizing `identity:get_role(role_id=e5fee74fe53d429897caab84ecf4e5d9)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:26.510525 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43f1ef-abf5-43fc-a0df-f7e2cacf65c4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:26.511888 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 568/1113] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:51:26 2022] GET /identity/v3/roles/e5fee74fe53d429897caab84ecf4e5d9 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:26.517612 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc6f9d-a553-4bfa-8380-3d2d46907143 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:26.609911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc6f9d-a553-4bfa-8380-3d2d46907143 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:26.641423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79865965-c6fd-4b01-974d-9d10ba11c035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:26.642273 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79865965-c6fd-4b01-974d-9d10ba11c035 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:26.642557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79865965-c6fd-4b01-974d-9d10ba11c035 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:26.642826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79865965-c6fd-4b01-974d-9d10ba11c035 None admin] PATH_INFO: `/v3/users/be52edd3f73c4d869c0e87fc07b77a40` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:26.655038 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79865965-c6fd-4b01-974d-9d10ba11c035 None admin] RBAC: Authorizing `identity:get_user(user_id=be52edd3f73c4d869c0e87fc07b77a40)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:26.656482 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79865965-c6fd-4b01-974d-9d10ba11c035 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:26.658087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 546/1114] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:51:26 2022] GET /identity/v3/users/be52edd3f73c4d869c0e87fc07b77a40 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:26.664220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43f1ef-abf5-43fc-a0df-f7e2cacf65c4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:26.759767 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43f1ef-abf5-43fc-a0df-f7e2cacf65c4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:26.790918 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104e21c-8e82-40d4-b789-94fd8319c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:26.791567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104e21c-8e82-40d4-b789-94fd8319c131 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:26.791846 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104e21c-8e82-40d4-b789-94fd8319c131 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:26.792116 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104e21c-8e82-40d4-b789-94fd8319c131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:26.855755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104e21c-8e82-40d4-b789-94fd8319c131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:26.857187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104e21c-8e82-40d4-b789-94fd8319c131 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:26.951219 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 569/1115] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:51:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:51:26.957218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79865965-c6fd-4b01-974d-9d10ba11c035 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:27.094812 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79865965-c6fd-4b01-974d-9d10ba11c035 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:27.126726 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67764a30-bffb-4f71-b3e4-7fde1c92207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:27.127604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67764a30-bffb-4f71-b3e4-7fde1c92207d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:27.127889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67764a30-bffb-4f71-b3e4-7fde1c92207d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:27.128168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67764a30-bffb-4f71-b3e4-7fde1c92207d None admin] PATH_INFO: `/v3/projects/690a587e919e42dea7f011cb69ab07ae` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:27.129336 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67764a30-bffb-4f71-b3e4-7fde1c92207d None admin] RBAC: Authorizing `identity:get_project(project_id=690a587e919e42dea7f011cb69ab07ae)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:27.131407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67764a30-bffb-4f71-b3e4-7fde1c92207d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:27.133073 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 547/1116] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:51:26 2022] GET /identity/v3/projects/690a587e919e42dea7f011cb69ab07ae => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:27.138997 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104e21c-8e82-40d4-b789-94fd8319c131 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:27.232862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104e21c-8e82-40d4-b789-94fd8319c131 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:27.265275 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af9f2b-1710-489c-9128-a6707d09f532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:27.265904 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af9f2b-1710-489c-9128-a6707d09f532 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:27.266182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af9f2b-1710-489c-9128-a6707d09f532 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:27.266724 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af9f2b-1710-489c-9128-a6707d09f532 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:27.267283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af9f2b-1710-489c-9128-a6707d09f532 None admin] RBAC: Adding query filter params (role.id=e5fee74fe53d429897caab84ecf4e5d9, scope.project.id=690a587e919e42dea7f011cb69ab07ae, user.id=be52edd3f73c4d869c0e87fc07b77a40) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:27.267592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af9f2b-1710-489c-9128-a6707d09f532 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:27.268992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af9f2b-1710-489c-9128-a6707d09f532 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:27.274222 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 570/1117] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:51:27 2022] GET /identity/v3/role_assignments?user.id=be52edd3f73c4d869c0e87fc07b77a40&scope.project.id=690a587e919e42dea7f011cb69ab07ae&role.id=e5fee74fe53d429897caab84ecf4e5d9 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:29.441600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceec69-05e4-4819-a656-c4141df3a3bf None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:29.442131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceec69-05e4-4819-a656-c4141df3a3bf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:29.442131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceec69-05e4-4819-a656-c4141df3a3bf None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:29.443696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 548/1118] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:29.448925 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a160910-95f5-491a-8cf3-1e005a28c444 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:29.449337 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a160910-95f5-491a-8cf3-1e005a28c444 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:29.449539 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a160910-95f5-491a-8cf3-1e005a28c444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:29.466350 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5a160910-95f5-491a-8cf3-1e005a28c444 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:29.467560 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5a160910-95f5-491a-8cf3-1e005a28c444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:29.531120 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 571/1119] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:29.554357 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceec69-05e4-4819-a656-c4141df3a3bf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:29.652143 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceec69-05e4-4819-a656-c4141df3a3bf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:29.684216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1bd73-6273-423f-823f-195cf01e6c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:29.685058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1bd73-6273-423f-823f-195cf01e6c2c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:29.685344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1bd73-6273-423f-823f-195cf01e6c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:29.685622 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1bd73-6273-423f-823f-195cf01e6c2c None admin] PATH_INFO: `/v3/roles/e5fee74fe53d429897caab84ecf4e5d9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:29.687080 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1bd73-6273-423f-823f-195cf01e6c2c None admin] RBAC: Authorizing `identity:get_role(role_id=e5fee74fe53d429897caab84ecf4e5d9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:29.688469 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1bd73-6273-423f-823f-195cf01e6c2c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:29.689829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 549/1120] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:51:29 2022] GET /identity/v3/roles/e5fee74fe53d429897caab84ecf4e5d9 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:29.696233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a160910-95f5-491a-8cf3-1e005a28c444 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:29.790173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a160910-95f5-491a-8cf3-1e005a28c444 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:29.822204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b8805-a144-46cb-90c4-f86fb9471276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:29.823057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b8805-a144-46cb-90c4-f86fb9471276 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:29.823369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b8805-a144-46cb-90c4-f86fb9471276 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:29.823640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b8805-a144-46cb-90c4-f86fb9471276 None admin] PATH_INFO: `/v3/users/be52edd3f73c4d869c0e87fc07b77a40` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:29.824796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b8805-a144-46cb-90c4-f86fb9471276 None admin] RBAC: Authorizing `identity:get_user(user_id=be52edd3f73c4d869c0e87fc07b77a40)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:29.826208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b8805-a144-46cb-90c4-f86fb9471276 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:29.827842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 572/1121] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:51:29 2022] GET /identity/v3/users/be52edd3f73c4d869c0e87fc07b77a40 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:29.833497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1bd73-6273-423f-823f-195cf01e6c2c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:29.929062 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1bd73-6273-423f-823f-195cf01e6c2c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:29.961738 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c761b-f25e-4eed-8807-1969f73d0d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:29.962523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c761b-f25e-4eed-8807-1969f73d0d11 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:29.962805 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c761b-f25e-4eed-8807-1969f73d0d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:29.963082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c761b-f25e-4eed-8807-1969f73d0d11 None admin] PATH_INFO: `/v3/projects/690a587e919e42dea7f011cb69ab07ae` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:29.964279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c761b-f25e-4eed-8807-1969f73d0d11 None admin] RBAC: Authorizing `identity:get_project(project_id=690a587e919e42dea7f011cb69ab07ae)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:29.965692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c761b-f25e-4eed-8807-1969f73d0d11 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:29.967414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 550/1122] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:51:29 2022] GET /identity/v3/projects/690a587e919e42dea7f011cb69ab07ae => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:29.973164 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b8805-a144-46cb-90c4-f86fb9471276 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:30.068774 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b8805-a144-46cb-90c4-f86fb9471276 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:30.102335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546588cd-6687-442c-a9d8-4e0ab77632ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:30.103537 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546588cd-6687-442c-a9d8-4e0ab77632ec None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:30.103825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546588cd-6687-442c-a9d8-4e0ab77632ec None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:30.104106 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546588cd-6687-442c-a9d8-4e0ab77632ec None admin] PATH_INFO: `/v3/projects/690a587e919e42dea7f011cb69ab07ae/users/be52edd3f73c4d869c0e87fc07b77a40/roles/e5fee74fe53d429897caab84ecf4e5d9` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:30.107127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546588cd-6687-442c-a9d8-4e0ab77632ec None admin] RBAC: Authorizing `identity:create_grant(project_id=690a587e919e42dea7f011cb69ab07ae, user_id=be52edd3f73c4d869c0e87fc07b77a40, role_id=e5fee74fe53d429897caab84ecf4e5d9)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:30.109060 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546588cd-6687-442c-a9d8-4e0ab77632ec None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:30.218593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 573/1123] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:51:29 2022] PUT /identity/v3/projects/690a587e919e42dea7f011cb69ab07ae/users/be52edd3f73c4d869c0e87fc07b77a40/roles/e5fee74fe53d429897caab84ecf4e5d9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:51:32.395852 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57dda7-84db-409a-8ed0-ec9c957272e2 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:32.396886 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57dda7-84db-409a-8ed0-ec9c957272e2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:32.396993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57dda7-84db-409a-8ed0-ec9c957272e2 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:32.398275 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 551/1124] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:32.403569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96dca7-de11-4bce-b5d4-594de49ea081 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:32.403990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96dca7-de11-4bce-b5d4-594de49ea081 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:32.404118 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96dca7-de11-4bce-b5d4-594de49ea081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:32.421914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-dd96dca7-de11-4bce-b5d4-594de49ea081 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:32.423056 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dd96dca7-de11-4bce-b5d4-594de49ea081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:32.487297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 574/1125] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:32.511042 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57dda7-84db-409a-8ed0-ec9c957272e2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:32.607392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57dda7-84db-409a-8ed0-ec9c957272e2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:32.639019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd6abe-21e7-441c-841c-46fe8f4b3e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:32.639878 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd6abe-21e7-441c-841c-46fe8f4b3e7f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:32.640158 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd6abe-21e7-441c-841c-46fe8f4b3e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:32.640430 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd6abe-21e7-441c-841c-46fe8f4b3e7f None admin] PATH_INFO: `/v3/roles/e5fee74fe53d429897caab84ecf4e5d9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:32.641877 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd6abe-21e7-441c-841c-46fe8f4b3e7f None admin] RBAC: Authorizing `identity:get_role(role_id=e5fee74fe53d429897caab84ecf4e5d9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:32.643256 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd6abe-21e7-441c-841c-46fe8f4b3e7f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:32.644591 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 552/1126] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:51:32 2022] GET /identity/v3/roles/e5fee74fe53d429897caab84ecf4e5d9 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:32.650319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96dca7-de11-4bce-b5d4-594de49ea081 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:32.742434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96dca7-de11-4bce-b5d4-594de49ea081 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:32.774991 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10e291-67e4-49a3-bb4f-bd3d2c6597d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:32.775872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10e291-67e4-49a3-bb4f-bd3d2c6597d3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:32.776150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10e291-67e4-49a3-bb4f-bd3d2c6597d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:32.776419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10e291-67e4-49a3-bb4f-bd3d2c6597d3 None admin] PATH_INFO: `/v3/users/be52edd3f73c4d869c0e87fc07b77a40` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:32.777577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10e291-67e4-49a3-bb4f-bd3d2c6597d3 None admin] RBAC: Authorizing `identity:get_user(user_id=be52edd3f73c4d869c0e87fc07b77a40)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:32.778994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10e291-67e4-49a3-bb4f-bd3d2c6597d3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:32.780636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 575/1127] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:51:32 2022] GET /identity/v3/users/be52edd3f73c4d869c0e87fc07b77a40 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:32.786454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd6abe-21e7-441c-841c-46fe8f4b3e7f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:32.881155 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd6abe-21e7-441c-841c-46fe8f4b3e7f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:32.915038 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ba487-af5b-460d-ba4e-a356e0c5f7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:32.915710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ba487-af5b-460d-ba4e-a356e0c5f7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:32.915992 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ba487-af5b-460d-ba4e-a356e0c5f7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:32.916265 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ba487-af5b-460d-ba4e-a356e0c5f7c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:32.980570 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ba487-af5b-460d-ba4e-a356e0c5f7c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:32.981999 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ba487-af5b-460d-ba4e-a356e0c5f7c8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:33.075420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 553/1128] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:51:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:51:33.081270 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10e291-67e4-49a3-bb4f-bd3d2c6597d3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:33.178211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10e291-67e4-49a3-bb4f-bd3d2c6597d3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:33.210304 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f444d03-e47c-4b89-b016-ab269056f762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:33.211160 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f444d03-e47c-4b89-b016-ab269056f762 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:33.211440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f444d03-e47c-4b89-b016-ab269056f762 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:33.211709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f444d03-e47c-4b89-b016-ab269056f762 None admin] PATH_INFO: `/v3/projects/690a587e919e42dea7f011cb69ab07ae` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:33.212850 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f444d03-e47c-4b89-b016-ab269056f762 None admin] RBAC: Authorizing `identity:get_project(project_id=690a587e919e42dea7f011cb69ab07ae)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:33.214263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f444d03-e47c-4b89-b016-ab269056f762 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:33.215935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 576/1129] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:51:33 2022] GET /identity/v3/projects/690a587e919e42dea7f011cb69ab07ae => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:33.221928 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ba487-af5b-460d-ba4e-a356e0c5f7c8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:33.315728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ba487-af5b-460d-ba4e-a356e0c5f7c8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:33.347917 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6853d3c-ac04-4599-906f-47a5e31c6901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:33.348557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6853d3c-ac04-4599-906f-47a5e31c6901 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:33.348836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6853d3c-ac04-4599-906f-47a5e31c6901 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:33.349108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6853d3c-ac04-4599-906f-47a5e31c6901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:33.350456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6853d3c-ac04-4599-906f-47a5e31c6901 None admin] RBAC: Adding query filter params (role.id=e5fee74fe53d429897caab84ecf4e5d9, scope.project.id=690a587e919e42dea7f011cb69ab07ae, user.id=be52edd3f73c4d869c0e87fc07b77a40) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:33.350763 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6853d3c-ac04-4599-906f-47a5e31c6901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:33.352194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6853d3c-ac04-4599-906f-47a5e31c6901 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:33.357767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 554/1130] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:51:33 2022] GET /identity/v3/role_assignments?user.id=be52edd3f73c4d869c0e87fc07b77a40&scope.project.id=690a587e919e42dea7f011cb69ab07ae&role.id=e5fee74fe53d429897caab84ecf4e5d9 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:35.602620 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b4c48-c6d8-43dd-a1bd-523329b3f5e4 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:35.603280 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b4c48-c6d8-43dd-a1bd-523329b3f5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:35.603280 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b4c48-c6d8-43dd-a1bd-523329b3f5e4 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:35.604562 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 577/1131] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:35.609701 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192cc1b-5505-470a-aed6-d5c328767c0a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:35.610071 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192cc1b-5505-470a-aed6-d5c328767c0a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:35.610249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192cc1b-5505-470a-aed6-d5c328767c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:35.627291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1192cc1b-5505-470a-aed6-d5c328767c0a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:35.628452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1192cc1b-5505-470a-aed6-d5c328767c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:35.691400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 555/1132] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:35.714376 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b4c48-c6d8-43dd-a1bd-523329b3f5e4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:35.811599 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b4c48-c6d8-43dd-a1bd-523329b3f5e4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:35.843497 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43842e22-9883-4ad7-8232-4eebfc902b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:35.844262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43842e22-9883-4ad7-8232-4eebfc902b7e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:35.844541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43842e22-9883-4ad7-8232-4eebfc902b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:35.844817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43842e22-9883-4ad7-8232-4eebfc902b7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:35.845956 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43842e22-9883-4ad7-8232-4eebfc902b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:35.847398 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43842e22-9883-4ad7-8232-4eebfc902b7e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:35.848982 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 578/1133] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:35.855446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192cc1b-5505-470a-aed6-d5c328767c0a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:35.949720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192cc1b-5505-470a-aed6-d5c328767c0a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:35.983249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27c300-75c4-48a1-ab62-12026e1f56ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:35.983897 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27c300-75c4-48a1-ab62-12026e1f56ff None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:35.984182 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27c300-75c4-48a1-ab62-12026e1f56ff None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:35.984455 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27c300-75c4-48a1-ab62-12026e1f56ff None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:35.985167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27c300-75c4-48a1-ab62-12026e1f56ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:35.986578 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27c300-75c4-48a1-ab62-12026e1f56ff None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:36.074518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 556/1134] 10.222.0.24 () {60 vars in 1141 bytes} [Tue May 17 21:51:35 2022] POST /identity/v3/projects => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:51:38.311302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e558a-3f2f-48e0-87a1-2ee53e2b2c38 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:38.311855 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e558a-3f2f-48e0-87a1-2ee53e2b2c38 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:38.311855 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e558a-3f2f-48e0-87a1-2ee53e2b2c38 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:38.313210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 579/1135] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:38.318396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b05c25-fcdc-434e-858b-fd9a0efdc256 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:38.318815 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b05c25-fcdc-434e-858b-fd9a0efdc256 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:38.318950 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b05c25-fcdc-434e-858b-fd9a0efdc256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:38.335667 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d3b05c25-fcdc-434e-858b-fd9a0efdc256 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:38.336835 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d3b05c25-fcdc-434e-858b-fd9a0efdc256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:38.399532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 557/1136] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:38.423826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e558a-3f2f-48e0-87a1-2ee53e2b2c38 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:38.520054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e558a-3f2f-48e0-87a1-2ee53e2b2c38 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:38.551995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562fc5a-9dd9-4c5a-8a88-a9219a56a67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:38.553084 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562fc5a-9dd9-4c5a-8a88-a9219a56a67c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:38.553363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562fc5a-9dd9-4c5a-8a88-a9219a56a67c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:38.553630 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562fc5a-9dd9-4c5a-8a88-a9219a56a67c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:38.554775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562fc5a-9dd9-4c5a-8a88-a9219a56a67c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:38.556226 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562fc5a-9dd9-4c5a-8a88-a9219a56a67c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:38.557792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 580/1137] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:51:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:38.563580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b05c25-fcdc-434e-858b-fd9a0efdc256 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:38.656733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b05c25-fcdc-434e-858b-fd9a0efdc256 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:38.688583 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bb401-cacb-4e57-88dd-5e2f06a7c6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:38.689238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bb401-cacb-4e57-88dd-5e2f06a7c6ae None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:38.689522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bb401-cacb-4e57-88dd-5e2f06a7c6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:38.689799 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bb401-cacb-4e57-88dd-5e2f06a7c6ae None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:38.690505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15bb401-cacb-4e57-88dd-5e2f06a7c6ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:38.691949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15bb401-cacb-4e57-88dd-5e2f06a7c6ae None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:38.812490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 558/1138] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:51:38 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:51:41.075805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ae3c3-b14b-41d3-8097-753f5c4e927e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:41.076357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ae3c3-b14b-41d3-8097-753f5c4e927e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:41.076357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ae3c3-b14b-41d3-8097-753f5c4e927e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:41.077734 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 581/1139] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:41.082914 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7a20-009f-4757-bbc3-fa0fbe494ae8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:41.083900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7a20-009f-4757-bbc3-fa0fbe494ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:41.084267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7a20-009f-4757-bbc3-fa0fbe494ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:41.101155 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-642f7a20-009f-4757-bbc3-fa0fbe494ae8 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:41.102327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-642f7a20-009f-4757-bbc3-fa0fbe494ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:41.165276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 559/1140] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:51:41.188640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ae3c3-b14b-41d3-8097-753f5c4e927e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:41.285032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ae3c3-b14b-41d3-8097-753f5c4e927e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:41.317037 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aef426-60e1-405b-baea-6702aac3078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:41.318084 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aef426-60e1-405b-baea-6702aac3078c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:41.318450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aef426-60e1-405b-baea-6702aac3078c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:41.318725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aef426-60e1-405b-baea-6702aac3078c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:41.328180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aef426-60e1-405b-baea-6702aac3078c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-37aef426-60e1-405b-baea-6702aac3078c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:51:41.336412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:41.337505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:41.338370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:41.338370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:41.338370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:41.338370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:41.338370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:51:41.338370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:51:41.338370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:51:41.338370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:51:41.338370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:51:41.338370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:51:41.338370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:51:41.338370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:41.338370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 582/1141] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:51:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:41.343455 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f7a20-009f-4757-bbc3-fa0fbe494ae8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:41.437637 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f7a20-009f-4757-bbc3-fa0fbe494ae8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:41.469202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04502d23-a89d-4f52-83c8-4425b3f21694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:41.469850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04502d23-a89d-4f52-83c8-4425b3f21694 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:41.470128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04502d23-a89d-4f52-83c8-4425b3f21694 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:41.470399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04502d23-a89d-4f52-83c8-4425b3f21694 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:41.471152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04502d23-a89d-4f52-83c8-4425b3f21694 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:41.471459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04502d23-a89d-4f52-83c8-4425b3f21694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:41.472796 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04502d23-a89d-4f52-83c8-4425b3f21694 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:41.481479 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 560/1142] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:51:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:41.487035 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aef426-60e1-405b-baea-6702aac3078c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:41.582802 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aef426-60e1-405b-baea-6702aac3078c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:41.614258 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95799e6-2722-4982-a6fd-a9270b98f5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:41.615258 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95799e6-2722-4982-a6fd-a9270b98f5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:41.615541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95799e6-2722-4982-a6fd-a9270b98f5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:41.615817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95799e6-2722-4982-a6fd-a9270b98f5c8 None admin] PATH_INFO: `/v3/users/f096b6b75f964cbd9d80d605a249edd2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:41.628268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95799e6-2722-4982-a6fd-a9270b98f5c8 None admin] RBAC: Authorizing `identity:get_user(user_id=f096b6b75f964cbd9d80d605a249edd2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:41.629695 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95799e6-2722-4982-a6fd-a9270b98f5c8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:41.632053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 583/1143] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:51:41 2022] GET /identity/v3/users/f096b6b75f964cbd9d80d605a249edd2 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:41.637768 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04502d23-a89d-4f52-83c8-4425b3f21694 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:41.732423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04502d23-a89d-4f52-83c8-4425b3f21694 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:41.764152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517df848-ae6d-41d3-a09a-4c1e95000919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:41.764793 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df848-ae6d-41d3-a09a-4c1e95000919 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:41.765076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df848-ae6d-41d3-a09a-4c1e95000919 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:41.765350 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df848-ae6d-41d3-a09a-4c1e95000919 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:41.828704 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517df848-ae6d-41d3-a09a-4c1e95000919 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:41.830132 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517df848-ae6d-41d3-a09a-4c1e95000919 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:41.923610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 561/1144] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:51:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:51:41.930286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95799e6-2722-4982-a6fd-a9270b98f5c8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:42.026652 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95799e6-2722-4982-a6fd-a9270b98f5c8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:42.058953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ff41f-e442-4bd5-b387-11aa8a01464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:42.059822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ff41f-e442-4bd5-b387-11aa8a01464b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:42.060104 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ff41f-e442-4bd5-b387-11aa8a01464b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:42.060378 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ff41f-e442-4bd5-b387-11aa8a01464b None admin] PATH_INFO: `/v3/projects/8e7a58a6229443f5a601a46237b32d26` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:42.061527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ff41f-e442-4bd5-b387-11aa8a01464b None admin] RBAC: Authorizing `identity:get_project(project_id=8e7a58a6229443f5a601a46237b32d26)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:42.062938 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ff41f-e442-4bd5-b387-11aa8a01464b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:42.064642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 584/1145] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:51:41 2022] GET /identity/v3/projects/8e7a58a6229443f5a601a46237b32d26 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:42.070914 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517df848-ae6d-41d3-a09a-4c1e95000919 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:42.163577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517df848-ae6d-41d3-a09a-4c1e95000919 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:42.195663 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1d952-1404-48db-8484-75e1a9a48637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:42.196304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1d952-1404-48db-8484-75e1a9a48637 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:42.196585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1d952-1404-48db-8484-75e1a9a48637 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:42.196859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1d952-1404-48db-8484-75e1a9a48637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:42.197682 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1d952-1404-48db-8484-75e1a9a48637 None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=8e7a58a6229443f5a601a46237b32d26, user.id=f096b6b75f964cbd9d80d605a249edd2) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:42.197987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1d952-1404-48db-8484-75e1a9a48637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:42.199419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1d952-1404-48db-8484-75e1a9a48637 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:42.204635 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 562/1146] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:51:42 2022] GET /identity/v3/role_assignments?user.id=f096b6b75f964cbd9d80d605a249edd2&scope.project.id=8e7a58a6229443f5a601a46237b32d26&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:44.411455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953369-671b-4341-a632-eb0f42ce03e7 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:44.412016 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953369-671b-4341-a632-eb0f42ce03e7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:44.412016 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953369-671b-4341-a632-eb0f42ce03e7 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:44.413352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 585/1147] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:44.418569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e8a18-dc7d-4dd2-ab0a-701e670aed4f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:44.418963 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e8a18-dc7d-4dd2-ab0a-701e670aed4f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:44.419139 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e8a18-dc7d-4dd2-ab0a-701e670aed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:44.435971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4b6e8a18-dc7d-4dd2-ab0a-701e670aed4f None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:44.437131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4b6e8a18-dc7d-4dd2-ab0a-701e670aed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:44.500302 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 563/1148] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:44.522235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953369-671b-4341-a632-eb0f42ce03e7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:44.617766 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953369-671b-4341-a632-eb0f42ce03e7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:44.648588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7aaf2-e257-4ca8-a3c7-7ae6f49ee7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:44.649344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7aaf2-e257-4ca8-a3c7-7ae6f49ee7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:44.649619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7aaf2-e257-4ca8-a3c7-7ae6f49ee7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:44.649910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7aaf2-e257-4ca8-a3c7-7ae6f49ee7a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:44.659363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7aaf2-e257-4ca8-a3c7-7ae6f49ee7a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-85f7aaf2-e257-4ca8-a3c7-7ae6f49ee7a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:51:44.667475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:44.669179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:44.670786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:44.670786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:44.670786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:44.670786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:44.670786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:51:44.670786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:51:44.670786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:51:44.670786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:51:44.670786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:51:44.670786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:51:44.670786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:51:44.670786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:44.670786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 586/1149] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:51:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:44.674568 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e8a18-dc7d-4dd2-ab0a-701e670aed4f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:44.765825 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e8a18-dc7d-4dd2-ab0a-701e670aed4f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:44.797334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd641708-d244-4302-aac2-edd791bb281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:44.797977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd641708-d244-4302-aac2-edd791bb281c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:44.798257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd641708-d244-4302-aac2-edd791bb281c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:44.798531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd641708-d244-4302-aac2-edd791bb281c None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:44.799291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd641708-d244-4302-aac2-edd791bb281c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:44.799596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd641708-d244-4302-aac2-edd791bb281c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:44.800941 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd641708-d244-4302-aac2-edd791bb281c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:44.809008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 564/1150] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:51:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:44.814845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7aaf2-e257-4ca8-a3c7-7ae6f49ee7a6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:44.910903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7aaf2-e257-4ca8-a3c7-7ae6f49ee7a6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:44.944308 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63afa0-a8eb-4994-bddf-948127da0553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:44.945097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63afa0-a8eb-4994-bddf-948127da0553 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:44.945375 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63afa0-a8eb-4994-bddf-948127da0553 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:44.945647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63afa0-a8eb-4994-bddf-948127da0553 None admin] PATH_INFO: `/v3/users/f096b6b75f964cbd9d80d605a249edd2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:44.946807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63afa0-a8eb-4994-bddf-948127da0553 None admin] RBAC: Authorizing `identity:get_user(user_id=f096b6b75f964cbd9d80d605a249edd2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:44.948282 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63afa0-a8eb-4994-bddf-948127da0553 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:44.949887 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 587/1151] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:51:44 2022] GET /identity/v3/users/f096b6b75f964cbd9d80d605a249edd2 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:44.955601 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd641708-d244-4302-aac2-edd791bb281c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:45.051969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd641708-d244-4302-aac2-edd791bb281c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:45.083558 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1efa9-e46a-4e99-a588-c467dc9d30f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:45.084423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1efa9-e46a-4e99-a588-c467dc9d30f7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:45.084704 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1efa9-e46a-4e99-a588-c467dc9d30f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:45.084978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1efa9-e46a-4e99-a588-c467dc9d30f7 None admin] PATH_INFO: `/v3/projects/8e7a58a6229443f5a601a46237b32d26` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:45.086142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1efa9-e46a-4e99-a588-c467dc9d30f7 None admin] RBAC: Authorizing `identity:get_project(project_id=8e7a58a6229443f5a601a46237b32d26)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:45.087584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1efa9-e46a-4e99-a588-c467dc9d30f7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:45.089245 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 565/1152] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:51:44 2022] GET /identity/v3/projects/8e7a58a6229443f5a601a46237b32d26 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:45.095190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63afa0-a8eb-4994-bddf-948127da0553 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:45.189642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63afa0-a8eb-4994-bddf-948127da0553 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:45.221613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e7688-c6ab-4167-a395-beb6500763a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:45.222428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e7688-c6ab-4167-a395-beb6500763a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:45.222707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e7688-c6ab-4167-a395-beb6500763a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:45.222979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e7688-c6ab-4167-a395-beb6500763a8 None admin] PATH_INFO: `/v3/projects/8e7a58a6229443f5a601a46237b32d26/users/f096b6b75f964cbd9d80d605a249edd2/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:45.225637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e7688-c6ab-4167-a395-beb6500763a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e7a58a6229443f5a601a46237b32d26, user_id=f096b6b75f964cbd9d80d605a249edd2, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:45.227058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e7688-c6ab-4167-a395-beb6500763a8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:45.304049 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 588/1153] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:51:45 2022] PUT /identity/v3/projects/8e7a58a6229443f5a601a46237b32d26/users/f096b6b75f964cbd9d80d605a249edd2/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:51:47.468954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8edbb7-6674-41bb-b175-c2d5d5b4d83d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:47.469546 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8edbb7-6674-41bb-b175-c2d5d5b4d83d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:47.469546 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8edbb7-6674-41bb-b175-c2d5d5b4d83d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:47.470868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 566/1154] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:47.476728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eaca8-c3c1-40fb-877f-2100532bdf50 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:47.477164 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eaca8-c3c1-40fb-877f-2100532bdf50 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:47.477267 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eaca8-c3c1-40fb-877f-2100532bdf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:47.493291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f03eaca8-c3c1-40fb-877f-2100532bdf50 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:47.494436 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f03eaca8-c3c1-40fb-877f-2100532bdf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:47.558734 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 589/1155] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:47.582278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8edbb7-6674-41bb-b175-c2d5d5b4d83d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:47.678394 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8edbb7-6674-41bb-b175-c2d5d5b4d83d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:47.709064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4abb5-5a79-483b-9ff2-27c8bf5f8fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:47.709831 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4abb5-5a79-483b-9ff2-27c8bf5f8fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:47.710112 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4abb5-5a79-483b-9ff2-27c8bf5f8fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:47.710388 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4abb5-5a79-483b-9ff2-27c8bf5f8fd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:47.721076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4abb5-5a79-483b-9ff2-27c8bf5f8fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-44c4abb5-5a79-483b-9ff2-27c8bf5f8fd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:51:47.729111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:47.730268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:47.731406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:47.731406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:47.731406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:47.731406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:47.731406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:51:47.731406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:51:47.731406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:51:47.731406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:51:47.731406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:51:47.731406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:51:47.731406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:51:47.731406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:51:47.731406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 567/1156] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:51:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:47.736094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03eaca8-c3c1-40fb-877f-2100532bdf50 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:47.827416 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03eaca8-c3c1-40fb-877f-2100532bdf50 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:47.858928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cb7b1-13a2-4923-8550-ec772bec266e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:47.859595 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cb7b1-13a2-4923-8550-ec772bec266e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:47.859872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cb7b1-13a2-4923-8550-ec772bec266e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:47.860140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cb7b1-13a2-4923-8550-ec772bec266e None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:47.860869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cb7b1-13a2-4923-8550-ec772bec266e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:47.861165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cb7b1-13a2-4923-8550-ec772bec266e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:47.862497 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cb7b1-13a2-4923-8550-ec772bec266e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:47.870757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 590/1157] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:51:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:51:47.876426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4abb5-5a79-483b-9ff2-27c8bf5f8fd3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:47.971052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4abb5-5a79-483b-9ff2-27c8bf5f8fd3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:48.003495 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c9e4c-4617-4f90-b864-5b12a570a32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:48.004291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c9e4c-4617-4f90-b864-5b12a570a32e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:48.004568 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c9e4c-4617-4f90-b864-5b12a570a32e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:48.005409 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c9e4c-4617-4f90-b864-5b12a570a32e None admin] PATH_INFO: `/v3/users/f096b6b75f964cbd9d80d605a249edd2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:48.006861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c9e4c-4617-4f90-b864-5b12a570a32e None admin] RBAC: Authorizing `identity:get_user(user_id=f096b6b75f964cbd9d80d605a249edd2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:48.008300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c9e4c-4617-4f90-b864-5b12a570a32e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:48.009900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 568/1158] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:51:47 2022] GET /identity/v3/users/f096b6b75f964cbd9d80d605a249edd2 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:48.015732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cb7b1-13a2-4923-8550-ec772bec266e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:48.110765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cb7b1-13a2-4923-8550-ec772bec266e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:48.141556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fc9ea-5e52-4f72-9272-53b51789ecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:48.142186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fc9ea-5e52-4f72-9272-53b51789ecc1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:48.142462 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fc9ea-5e52-4f72-9272-53b51789ecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:48.142732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fc9ea-5e52-4f72-9272-53b51789ecc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:48.205567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fc9ea-5e52-4f72-9272-53b51789ecc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:48.206992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fc9ea-5e52-4f72-9272-53b51789ecc1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:48.298967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 591/1159] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:51:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:51:48.306087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c9e4c-4617-4f90-b864-5b12a570a32e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:48.401808 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c9e4c-4617-4f90-b864-5b12a570a32e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:48.434544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272379b1-cb23-4a8a-9097-5fd57a9ea156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:48.435403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272379b1-cb23-4a8a-9097-5fd57a9ea156 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:48.435680 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272379b1-cb23-4a8a-9097-5fd57a9ea156 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:48.435945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272379b1-cb23-4a8a-9097-5fd57a9ea156 None admin] PATH_INFO: `/v3/projects/8e7a58a6229443f5a601a46237b32d26` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:48.437093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272379b1-cb23-4a8a-9097-5fd57a9ea156 None admin] RBAC: Authorizing `identity:get_project(project_id=8e7a58a6229443f5a601a46237b32d26)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:48.438495 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272379b1-cb23-4a8a-9097-5fd57a9ea156 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:48.440190 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 569/1160] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:51:48 2022] GET /identity/v3/projects/8e7a58a6229443f5a601a46237b32d26 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:48.446513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fc9ea-5e52-4f72-9272-53b51789ecc1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:48.539263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fc9ea-5e52-4f72-9272-53b51789ecc1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:48.571317 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca33fcc-bd0c-40eb-af13-a2587ba539a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:48.571893 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca33fcc-bd0c-40eb-af13-a2587ba539a4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:48.572191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca33fcc-bd0c-40eb-af13-a2587ba539a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:48.572467 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca33fcc-bd0c-40eb-af13-a2587ba539a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:48.573282 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca33fcc-bd0c-40eb-af13-a2587ba539a4 None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=8e7a58a6229443f5a601a46237b32d26, user.id=f096b6b75f964cbd9d80d605a249edd2) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:48.573589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca33fcc-bd0c-40eb-af13-a2587ba539a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:48.574992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca33fcc-bd0c-40eb-af13-a2587ba539a4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:48.580570 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 592/1161] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:51:48 2022] GET /identity/v3/role_assignments?user.id=f096b6b75f964cbd9d80d605a249edd2&scope.project.id=8e7a58a6229443f5a601a46237b32d26&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:50.820561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf2c7c-ea02-497b-bec7-d1bce8b84799 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:50.821110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf2c7c-ea02-497b-bec7-d1bce8b84799 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:50.821110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf2c7c-ea02-497b-bec7-d1bce8b84799 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:50.822458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 570/1162] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:50.827702 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c78b4-77fa-44f9-abde-c19931d6e820 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:50.828139 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c78b4-77fa-44f9-abde-c19931d6e820 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:50.828250 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c78b4-77fa-44f9-abde-c19931d6e820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:50.845013 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-fc9c78b4-77fa-44f9-abde-c19931d6e820 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:50.846174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fc9c78b4-77fa-44f9-abde-c19931d6e820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:50.909174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 593/1163] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:50.931957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf2c7c-ea02-497b-bec7-d1bce8b84799 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:51.029418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf2c7c-ea02-497b-bec7-d1bce8b84799 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:51.061974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682e397-19a4-4fe9-9a40-25fdf31b715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:51.062601 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682e397-19a4-4fe9-9a40-25fdf31b715f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:51.062880 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682e397-19a4-4fe9-9a40-25fdf31b715f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:51.063176 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682e397-19a4-4fe9-9a40-25fdf31b715f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:51.126566 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682e397-19a4-4fe9-9a40-25fdf31b715f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:51.127945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682e397-19a4-4fe9-9a40-25fdf31b715f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:51.220073 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 571/1164] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:51:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:51:51.226591 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c78b4-77fa-44f9-abde-c19931d6e820 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:51.319230 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c78b4-77fa-44f9-abde-c19931d6e820 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:51.351381 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9896608-357e-4db1-86b1-2341e03fc3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:51.352166 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9896608-357e-4db1-86b1-2341e03fc3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:51.352448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9896608-357e-4db1-86b1-2341e03fc3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:51.352724 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9896608-357e-4db1-86b1-2341e03fc3c0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:51.359279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9896608-357e-4db1-86b1-2341e03fc3c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:51.360742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9896608-357e-4db1-86b1-2341e03fc3c0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e9896608-357e-4db1-86b1-2341e03fc3c0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:51:51.375549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:51:51.376797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:51:51.377657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:51:51.377657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:51:51.377657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:51:51.377657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:51:51.377657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:51:51.377657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:51:51.377657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:51:51.377657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:51:51.377657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:51:51.377657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:51:51.377657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 17 21:51:51.377657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:51:51.377657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 17 21:51:51.377657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:51:51.377657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 594/1165] 10.222.0.24 () {56 vars in 1117 bytes} [Tue May 17 21:51:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:51:51.382855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682e397-19a4-4fe9-9a40-25fdf31b715f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:51.475959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682e397-19a4-4fe9-9a40-25fdf31b715f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:51.507741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446516d4-1799-4475-a843-cd361d6a7956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:51.508384 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446516d4-1799-4475-a843-cd361d6a7956 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:51.508664 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446516d4-1799-4475-a843-cd361d6a7956 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:51.508935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446516d4-1799-4475-a843-cd361d6a7956 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:51.509643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446516d4-1799-4475-a843-cd361d6a7956 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:51:51.509945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446516d4-1799-4475-a843-cd361d6a7956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:51.511307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446516d4-1799-4475-a843-cd361d6a7956 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:51.518140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 572/1166] 10.222.0.24 () {56 vars in 1115 bytes} [Tue May 17 21:51:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:53.709189 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80686-cd1c-4e1a-8fcf-729eb43244b2 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:53.709749 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80686-cd1c-4e1a-8fcf-729eb43244b2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:53.709749 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80686-cd1c-4e1a-8fcf-729eb43244b2 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:53.711089 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 595/1167] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:53.716297 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba80bad-665d-4ead-b853-c7533a77aabc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:53.716708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba80bad-665d-4ead-b853-c7533a77aabc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:53.716871 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba80bad-665d-4ead-b853-c7533a77aabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:53.734250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-dba80bad-665d-4ead-b853-c7533a77aabc None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:53.735433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dba80bad-665d-4ead-b853-c7533a77aabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:53.797033 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 573/1168] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:53.820708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d80686-cd1c-4e1a-8fcf-729eb43244b2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:53.918360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d80686-cd1c-4e1a-8fcf-729eb43244b2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:53.952006 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e38aa2-a6a6-431e-86b3-dea28f967cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:53.952654 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38aa2-a6a6-431e-86b3-dea28f967cd4 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:53.952934 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38aa2-a6a6-431e-86b3-dea28f967cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:53.953207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38aa2-a6a6-431e-86b3-dea28f967cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:53.953941 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e38aa2-a6a6-431e-86b3-dea28f967cd4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:53.955335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e38aa2-a6a6-431e-86b3-dea28f967cd4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:54.037010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 596/1169] 10.222.0.24 () {60 vars in 1138 bytes} [Tue May 17 21:51:53 2022] POST /identity/v3/domains => generated 267 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 21:51:56.279382 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b030-5a2e-4caf-a40f-a28f1c26591a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:56.279904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b030-5a2e-4caf-a40f-a28f1c26591a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:56.279904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b030-5a2e-4caf-a40f-a28f1c26591a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:56.281231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 574/1170] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:56.286420 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41c1fb-090e-44dc-a5bd-bbf2ca1db129 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:56.286863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41c1fb-090e-44dc-a5bd-bbf2ca1db129 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:56.286965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41c1fb-090e-44dc-a5bd-bbf2ca1db129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:56.304097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5e41c1fb-090e-44dc-a5bd-bbf2ca1db129 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:56.305259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5e41c1fb-090e-44dc-a5bd-bbf2ca1db129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:56.369234 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 597/1171] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:56.392093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27b030-5a2e-4caf-a40f-a28f1c26591a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:56.487563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27b030-5a2e-4caf-a40f-a28f1c26591a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:56.519324 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ba91f-4157-46b7-92f4-e2877dd853ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:56.520747 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ba91f-4157-46b7-92f4-e2877dd853ab None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:56.521025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ba91f-4157-46b7-92f4-e2877dd853ab None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:56.521299 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ba91f-4157-46b7-92f4-e2877dd853ab None admin] PATH_INFO: `/v3/domains/a1f31cf30a1d4e1e80a2713982b92342` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:56.531178 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ba91f-4157-46b7-92f4-e2877dd853ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=a1f31cf30a1d4e1e80a2713982b92342)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:56.532550 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ba91f-4157-46b7-92f4-e2877dd853ab None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:56.534139 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 575/1172] 10.222.0.24 () {56 vars in 1183 bytes} [Tue May 17 21:51:56 2022] GET /identity/v3/domains/a1f31cf30a1d4e1e80a2713982b92342 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:56.539916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41c1fb-090e-44dc-a5bd-bbf2ca1db129 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:56.632895 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41c1fb-090e-44dc-a5bd-bbf2ca1db129 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:56.665204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1e508-3b74-4748-bb5d-5dcb6be4f025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:56.665847 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1e508-3b74-4748-bb5d-5dcb6be4f025 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:56.666127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1e508-3b74-4748-bb5d-5dcb6be4f025 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:56.666400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1e508-3b74-4748-bb5d-5dcb6be4f025 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:56.667095 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1e508-3b74-4748-bb5d-5dcb6be4f025 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:56.668534 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1e508-3b74-4748-bb5d-5dcb6be4f025 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:56.787620 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 598/1173] 10.222.0.24 () {60 vars in 1141 bytes} [Tue May 17 21:51:56 2022] POST /identity/v3/projects => generated 361 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:51:59.101307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507c6cc-fe44-4323-a8a0-2943590bc81a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:59.101853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507c6cc-fe44-4323-a8a0-2943590bc81a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:59.101853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507c6cc-fe44-4323-a8a0-2943590bc81a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:59.103235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 576/1174] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:51:59.108508 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3d00b-4ae2-4f3a-8d93-4d68a6163981 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:59.108922 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3d00b-4ae2-4f3a-8d93-4d68a6163981 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:59.109066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3d00b-4ae2-4f3a-8d93-4d68a6163981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:59.125778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-dfe3d00b-4ae2-4f3a-8d93-4d68a6163981 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:51:59.126948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dfe3d00b-4ae2-4f3a-8d93-4d68a6163981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:51:59.190544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 599/1175] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:51:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:51:59.216045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507c6cc-fe44-4323-a8a0-2943590bc81a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:59.313202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507c6cc-fe44-4323-a8a0-2943590bc81a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:59.344944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12eb9f1-3cb8-422c-86b6-c9dabe777d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:59.345791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12eb9f1-3cb8-422c-86b6-c9dabe777d67 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:59.346069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12eb9f1-3cb8-422c-86b6-c9dabe777d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:59.346338 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12eb9f1-3cb8-422c-86b6-c9dabe777d67 None admin] PATH_INFO: `/v3/domains/a1f31cf30a1d4e1e80a2713982b92342` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:59.347527 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12eb9f1-3cb8-422c-86b6-c9dabe777d67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a1f31cf30a1d4e1e80a2713982b92342)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:59.348974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12eb9f1-3cb8-422c-86b6-c9dabe777d67 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:59.350574 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 577/1176] 10.222.0.24 () {56 vars in 1183 bytes} [Tue May 17 21:51:59 2022] GET /identity/v3/domains/a1f31cf30a1d4e1e80a2713982b92342 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:51:59.356309 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3d00b-4ae2-4f3a-8d93-4d68a6163981 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:51:59.465284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3d00b-4ae2-4f3a-8d93-4d68a6163981 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:51:59.506945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68651af5-d405-45fd-8d11-c2e186b8ac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:51:59.507951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68651af5-d405-45fd-8d11-c2e186b8ac26 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:51:59.508373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68651af5-d405-45fd-8d11-c2e186b8ac26 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:51:59.508783 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68651af5-d405-45fd-8d11-c2e186b8ac26 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:51:59.509878 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68651af5-d405-45fd-8d11-c2e186b8ac26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:51:59.512211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68651af5-d405-45fd-8d11-c2e186b8ac26 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:51:59.621128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 600/1177] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:51:59 2022] POST /identity/v3/users => generated 311 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:52:01.888715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312b6e7-0e92-48a8-9895-079bb8de83d8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:01.889274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312b6e7-0e92-48a8-9895-079bb8de83d8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:01.889274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312b6e7-0e92-48a8-9895-079bb8de83d8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:01.890619 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 578/1178] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:52:01.896793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d13d8-992e-4bca-9c5c-4f32365112e1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:01.897179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d13d8-992e-4bca-9c5c-4f32365112e1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:01.897346 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d13d8-992e-4bca-9c5c-4f32365112e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:01.913620 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ac7d13d8-992e-4bca-9c5c-4f32365112e1 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:52:01.914775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ac7d13d8-992e-4bca-9c5c-4f32365112e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:52:01.978713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 601/1179] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:52:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:52:02.002054 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312b6e7-0e92-48a8-9895-079bb8de83d8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:02.099628 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312b6e7-0e92-48a8-9895-079bb8de83d8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:02.130426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b2bc4-750f-4972-b903-e34f69499eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:02.131215 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b2bc4-750f-4972-b903-e34f69499eac None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:02.131498 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b2bc4-750f-4972-b903-e34f69499eac None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:02.131768 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b2bc4-750f-4972-b903-e34f69499eac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:02.141678 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b2bc4-750f-4972-b903-e34f69499eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-593b2bc4-750f-4972-b903-e34f69499eac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:52:02.149579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:52:02.150710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:52:02.151688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:52:02.151688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:52:02.151688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:52:02.151688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:52:02.151688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:52:02.151688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:52:02.151688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:52:02.151688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:52:02.151688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:52:02.151688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:52:02.151688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:52:02.151688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:52:02.151688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 579/1180] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:52:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:52:02.157654 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d13d8-992e-4bca-9c5c-4f32365112e1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:02.258017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d13d8-992e-4bca-9c5c-4f32365112e1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:02.290173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1782e9-3be1-44d9-81a8-969d14eef838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:02.290826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1782e9-3be1-44d9-81a8-969d14eef838 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:02.291117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1782e9-3be1-44d9-81a8-969d14eef838 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:02.291408 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1782e9-3be1-44d9-81a8-969d14eef838 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:02.292146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1782e9-3be1-44d9-81a8-969d14eef838 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:52:02.292448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1782e9-3be1-44d9-81a8-969d14eef838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:52:02.293793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1782e9-3be1-44d9-81a8-969d14eef838 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:52:02.301731 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 602/1181] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:52:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:52:02.307511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b2bc4-750f-4972-b903-e34f69499eac None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:02.412503 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b2bc4-750f-4972-b903-e34f69499eac None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:02.444378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f576b56-065f-40a7-8aad-2761f3497d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:02.445245 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f576b56-065f-40a7-8aad-2761f3497d5a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:02.445526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f576b56-065f-40a7-8aad-2761f3497d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:02.445798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f576b56-065f-40a7-8aad-2761f3497d5a None admin] PATH_INFO: `/v3/users/95eadc640703434bad77993046ca22a5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:02.458770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f576b56-065f-40a7-8aad-2761f3497d5a None admin] RBAC: Authorizing `identity:get_user(user_id=95eadc640703434bad77993046ca22a5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:52:02.460228 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f576b56-065f-40a7-8aad-2761f3497d5a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:52:02.461871 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 580/1182] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:52:02 2022] GET /identity/v3/users/95eadc640703434bad77993046ca22a5 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:52:02.467621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1782e9-3be1-44d9-81a8-969d14eef838 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:02.563468 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1782e9-3be1-44d9-81a8-969d14eef838 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:02.595866 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be1615-534a-4225-8c9d-c8670b107b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:02.596505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be1615-534a-4225-8c9d-c8670b107b19 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:02.596788 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be1615-534a-4225-8c9d-c8670b107b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:02.597062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be1615-534a-4225-8c9d-c8670b107b19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:02.660589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be1615-534a-4225-8c9d-c8670b107b19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:52:02.662027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be1615-534a-4225-8c9d-c8670b107b19 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:52:02.753937 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 603/1183] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:52:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:52:02.760327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f576b56-065f-40a7-8aad-2761f3497d5a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:02.853928 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f576b56-065f-40a7-8aad-2761f3497d5a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:02.885329 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a38ba-871f-4070-a431-8751b75569b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:02.886159 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a38ba-871f-4070-a431-8751b75569b4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:02.886438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a38ba-871f-4070-a431-8751b75569b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:02.886706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a38ba-871f-4070-a431-8751b75569b4 None admin] PATH_INFO: `/v3/projects/66a1bbc32026489a8167afca294f4d8f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:02.887875 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a38ba-871f-4070-a431-8751b75569b4 None admin] RBAC: Authorizing `identity:get_project(project_id=66a1bbc32026489a8167afca294f4d8f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:52:02.889293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a38ba-871f-4070-a431-8751b75569b4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:52:02.891160 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 581/1184] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:52:02 2022] GET /identity/v3/projects/66a1bbc32026489a8167afca294f4d8f => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:52:02.897616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be1615-534a-4225-8c9d-c8670b107b19 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:02.992669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be1615-534a-4225-8c9d-c8670b107b19 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:03.024966 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3189b-b6d4-4291-80cf-0330f9e6c089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:03.025543 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3189b-b6d4-4291-80cf-0330f9e6c089 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:03.025822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3189b-b6d4-4291-80cf-0330f9e6c089 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:03.026091 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3189b-b6d4-4291-80cf-0330f9e6c089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:03.026908 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3189b-b6d4-4291-80cf-0330f9e6c089 None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=66a1bbc32026489a8167afca294f4d8f, user.id=95eadc640703434bad77993046ca22a5) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:52:03.027244 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3189b-b6d4-4291-80cf-0330f9e6c089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:52:03.028666 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3189b-b6d4-4291-80cf-0330f9e6c089 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:52:03.033840 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 604/1185] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:52:02 2022] GET /identity/v3/role_assignments?user.id=95eadc640703434bad77993046ca22a5&scope.project.id=66a1bbc32026489a8167afca294f4d8f&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:52:05.254361 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7138a0-04d8-40f4-8487-f8bb2dff4286 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:05.254876 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7138a0-04d8-40f4-8487-f8bb2dff4286 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:05.254876 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7138a0-04d8-40f4-8487-f8bb2dff4286 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:05.256218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 582/1186] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:52:05.261782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37de2d3-4a30-463e-8329-2b5216a8499e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:05.262198 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37de2d3-4a30-463e-8329-2b5216a8499e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:05.262336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37de2d3-4a30-463e-8329-2b5216a8499e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:05.279043 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e37de2d3-4a30-463e-8329-2b5216a8499e None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:52:05.280228 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e37de2d3-4a30-463e-8329-2b5216a8499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:52:05.342340 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 605/1187] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:52:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:52:05.365537 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7138a0-04d8-40f4-8487-f8bb2dff4286 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:05.461214 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7138a0-04d8-40f4-8487-f8bb2dff4286 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:05.493360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c39e8-5449-4124-bff0-b57b9bb87e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:05.494126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c39e8-5449-4124-bff0-b57b9bb87e92 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:05.494406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c39e8-5449-4124-bff0-b57b9bb87e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:05.494675 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c39e8-5449-4124-bff0-b57b9bb87e92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:05.504104 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c39e8-5449-4124-bff0-b57b9bb87e92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0c6c39e8-5449-4124-bff0-b57b9bb87e92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:52:05.511575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:52:05.512666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:52:05.513708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:52:05.513708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:52:05.513708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:52:05.513708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:52:05.513708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:52:05.513708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:52:05.513708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:52:05.513708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:52:05.513708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:52:05.513708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:52:05.513708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:52:05.513708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:52:05.513708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 583/1188] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:52:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:52:05.518633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37de2d3-4a30-463e-8329-2b5216a8499e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:05.612971 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37de2d3-4a30-463e-8329-2b5216a8499e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:05.645191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8478f-0294-41f9-97d9-5283a0491a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:05.645802 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8478f-0294-41f9-97d9-5283a0491a98 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:05.646083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8478f-0294-41f9-97d9-5283a0491a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:05.646359 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8478f-0294-41f9-97d9-5283a0491a98 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:05.647096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8478f-0294-41f9-97d9-5283a0491a98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:52:05.647607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8478f-0294-41f9-97d9-5283a0491a98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:52:05.648972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8478f-0294-41f9-97d9-5283a0491a98 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:52:05.656657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 606/1189] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:52:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:52:05.663016 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c39e8-5449-4124-bff0-b57b9bb87e92 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:05.756699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c39e8-5449-4124-bff0-b57b9bb87e92 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:05.788218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623673a0-7db5-442e-b714-aa92d6de9a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:05.789077 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623673a0-7db5-442e-b714-aa92d6de9a76 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:05.789358 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623673a0-7db5-442e-b714-aa92d6de9a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:05.789632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623673a0-7db5-442e-b714-aa92d6de9a76 None admin] PATH_INFO: `/v3/users/95eadc640703434bad77993046ca22a5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:05.790796 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623673a0-7db5-442e-b714-aa92d6de9a76 None admin] RBAC: Authorizing `identity:get_user(user_id=95eadc640703434bad77993046ca22a5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:52:05.792244 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623673a0-7db5-442e-b714-aa92d6de9a76 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:52:05.793847 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 584/1190] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:52:05 2022] GET /identity/v3/users/95eadc640703434bad77993046ca22a5 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:52:05.799482 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8478f-0294-41f9-97d9-5283a0491a98 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:05.896272 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8478f-0294-41f9-97d9-5283a0491a98 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:05.928470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a09335-789c-44dc-8776-fb5e775c4f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:05.929304 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a09335-789c-44dc-8776-fb5e775c4f41 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:05.929578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a09335-789c-44dc-8776-fb5e775c4f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:05.929845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a09335-789c-44dc-8776-fb5e775c4f41 None admin] PATH_INFO: `/v3/projects/66a1bbc32026489a8167afca294f4d8f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:05.930987 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a09335-789c-44dc-8776-fb5e775c4f41 None admin] RBAC: Authorizing `identity:get_project(project_id=66a1bbc32026489a8167afca294f4d8f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:52:05.932433 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a09335-789c-44dc-8776-fb5e775c4f41 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:52:05.934278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 607/1191] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:52:05 2022] GET /identity/v3/projects/66a1bbc32026489a8167afca294f4d8f => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:52:05.939945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623673a0-7db5-442e-b714-aa92d6de9a76 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:06.034557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623673a0-7db5-442e-b714-aa92d6de9a76 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:06.067224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b652cf-ec37-450d-ada7-78d5a3b9f2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:06.068112 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b652cf-ec37-450d-ada7-78d5a3b9f2e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:06.068396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b652cf-ec37-450d-ada7-78d5a3b9f2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:06.068675 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b652cf-ec37-450d-ada7-78d5a3b9f2e8 None admin] PATH_INFO: `/v3/projects/66a1bbc32026489a8167afca294f4d8f/users/95eadc640703434bad77993046ca22a5/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:06.070624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b652cf-ec37-450d-ada7-78d5a3b9f2e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=66a1bbc32026489a8167afca294f4d8f, user_id=95eadc640703434bad77993046ca22a5, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:52:06.072066 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b652cf-ec37-450d-ada7-78d5a3b9f2e8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:52:06.146315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 585/1192] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:52:05 2022] PUT /identity/v3/projects/66a1bbc32026489a8167afca294f4d8f/users/95eadc640703434bad77993046ca22a5/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:52:08.324877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c3415-d90b-4b85-aea5-4f47c991b64b None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:08.325407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c3415-d90b-4b85-aea5-4f47c991b64b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:08.325407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c3415-d90b-4b85-aea5-4f47c991b64b None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:08.326770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 608/1193] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:52:08.331969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e51b0e-7990-4e02-a9f1-b4b282076985 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:08.332959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e51b0e-7990-4e02-a9f1-b4b282076985 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:08.333246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e51b0e-7990-4e02-a9f1-b4b282076985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:08.349958 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e8e51b0e-7990-4e02-a9f1-b4b282076985 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:52:08.351143 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e8e51b0e-7990-4e02-a9f1-b4b282076985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:52:08.419411 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 586/1194] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:52:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:52:08.442656 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c3415-d90b-4b85-aea5-4f47c991b64b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:08.539762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c3415-d90b-4b85-aea5-4f47c991b64b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:08.571923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab882b98-c14c-43bc-a7e1-d4be87920c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:08.572690 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab882b98-c14c-43bc-a7e1-d4be87920c5a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:08.572968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab882b98-c14c-43bc-a7e1-d4be87920c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:08.573237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab882b98-c14c-43bc-a7e1-d4be87920c5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:08.583635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab882b98-c14c-43bc-a7e1-d4be87920c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ab882b98-c14c-43bc-a7e1-d4be87920c5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:52:08.591117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:52:08.592207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:52:08.593444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:52:08.593444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:52:08.593444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:52:08.593444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:52:08.593444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:52:08.593444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:52:08.593444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:52:08.593444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:52:08.593444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:52:08.593444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:52:08.593444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:52:08.593444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:52:08.593444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 609/1195] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:52:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:52:08.598138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e51b0e-7990-4e02-a9f1-b4b282076985 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:08.690977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e51b0e-7990-4e02-a9f1-b4b282076985 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:08.723443 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610482b-1c73-475d-877b-4f9540be500c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:08.724088 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610482b-1c73-475d-877b-4f9540be500c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:08.724368 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610482b-1c73-475d-877b-4f9540be500c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:08.724636 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610482b-1c73-475d-877b-4f9540be500c None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:08.725371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610482b-1c73-475d-877b-4f9540be500c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:52:08.725672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610482b-1c73-475d-877b-4f9540be500c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:52:08.727020 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610482b-1c73-475d-877b-4f9540be500c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:52:08.734786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 587/1196] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:52:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:52:08.740442 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab882b98-c14c-43bc-a7e1-d4be87920c5a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:08.836024 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab882b98-c14c-43bc-a7e1-d4be87920c5a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:08.865689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46dd92-a06f-4372-8fe3-3653e67c064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:08.866532 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46dd92-a06f-4372-8fe3-3653e67c064d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:08.868185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46dd92-a06f-4372-8fe3-3653e67c064d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:08.868185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46dd92-a06f-4372-8fe3-3653e67c064d None admin] PATH_INFO: `/v3/users/95eadc640703434bad77993046ca22a5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:08.868403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46dd92-a06f-4372-8fe3-3653e67c064d None admin] RBAC: Authorizing `identity:get_user(user_id=95eadc640703434bad77993046ca22a5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:52:08.869642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46dd92-a06f-4372-8fe3-3653e67c064d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:52:08.871265 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 610/1197] 10.222.0.24 () {56 vars in 1177 bytes} [Tue May 17 21:52:08 2022] GET /identity/v3/users/95eadc640703434bad77993046ca22a5 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:52:08.876813 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610482b-1c73-475d-877b-4f9540be500c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:08.974772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610482b-1c73-475d-877b-4f9540be500c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:09.007238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2129a1-82d1-4af4-a10c-81a786aa677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:09.007872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2129a1-82d1-4af4-a10c-81a786aa677c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:09.008150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2129a1-82d1-4af4-a10c-81a786aa677c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:09.008419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2129a1-82d1-4af4-a10c-81a786aa677c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:09.072391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2129a1-82d1-4af4-a10c-81a786aa677c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:52:09.073799 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2129a1-82d1-4af4-a10c-81a786aa677c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:52:09.167434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 588/1198] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:52:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:52:09.173288 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46dd92-a06f-4372-8fe3-3653e67c064d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:09.270619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46dd92-a06f-4372-8fe3-3653e67c064d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:09.302216 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15c0fe-adf9-4563-bc09-09610575ca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:09.303053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15c0fe-adf9-4563-bc09-09610575ca23 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:09.303363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15c0fe-adf9-4563-bc09-09610575ca23 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:09.303692 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15c0fe-adf9-4563-bc09-09610575ca23 None admin] PATH_INFO: `/v3/projects/66a1bbc32026489a8167afca294f4d8f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:09.304855 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15c0fe-adf9-4563-bc09-09610575ca23 None admin] RBAC: Authorizing `identity:get_project(project_id=66a1bbc32026489a8167afca294f4d8f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:52:09.306277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15c0fe-adf9-4563-bc09-09610575ca23 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:52:09.307972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 611/1199] 10.222.0.24 () {56 vars in 1186 bytes} [Tue May 17 21:52:09 2022] GET /identity/v3/projects/66a1bbc32026489a8167afca294f4d8f => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:52:09.313842 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2129a1-82d1-4af4-a10c-81a786aa677c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:52:09.406948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2129a1-82d1-4af4-a10c-81a786aa677c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:52:09.439957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7443d3e-0e9f-426e-83c1-67c6018e70c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:52:09.440532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7443d3e-0e9f-426e-83c1-67c6018e70c9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:52:09.440814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7443d3e-0e9f-426e-83c1-67c6018e70c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:52:09.441089 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7443d3e-0e9f-426e-83c1-67c6018e70c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:52:09.441945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7443d3e-0e9f-426e-83c1-67c6018e70c9 None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=66a1bbc32026489a8167afca294f4d8f, user.id=95eadc640703434bad77993046ca22a5) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:52:09.442249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7443d3e-0e9f-426e-83c1-67c6018e70c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:52:09.443672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7443d3e-0e9f-426e-83c1-67c6018e70c9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:52:09.449304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 589/1200] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:52:09 2022] GET /identity/v3/role_assignments?user.id=95eadc640703434bad77993046ca22a5&scope.project.id=66a1bbc32026489a8167afca294f4d8f&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:26.420066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17af9de-f410-4cca-84ab-0c12c6d72267 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:26.420679 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17af9de-f410-4cca-84ab-0c12c6d72267 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:26.420679 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17af9de-f410-4cca-84ab-0c12c6d72267 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:26.422022 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 612/1201] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:53:26.428533 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02272bc-bef1-4950-8d37-36ae7603cae2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:26.428990 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02272bc-bef1-4950-8d37-36ae7603cae2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:26.429110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02272bc-bef1-4950-8d37-36ae7603cae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:26.445395 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a02272bc-bef1-4950-8d37-36ae7603cae2 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:53:26.446563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a02272bc-bef1-4950-8d37-36ae7603cae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:53:26.511010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 590/1202] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:53:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:53:26.535980 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17af9de-f410-4cca-84ab-0c12c6d72267 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:26.634632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17af9de-f410-4cca-84ab-0c12c6d72267 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:26.667471 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea0028-f96e-4d78-820f-b679efe48c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:26.668247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea0028-f96e-4d78-820f-b679efe48c78 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:26.668528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea0028-f96e-4d78-820f-b679efe48c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:26.668800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea0028-f96e-4d78-820f-b679efe48c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:26.679724 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea0028-f96e-4d78-820f-b679efe48c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:26.681109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea0028-f96e-4d78-820f-b679efe48c78 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:26.698057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-f2ea0028-f96e-4d78-820f-b679efe48c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:26.698057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:26.698057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:26.698057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:26.698057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:26.698057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:26.698057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:26.698057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:26.698057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:26.698057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:26.698057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:26.698057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:26.698057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:53:26.698057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:53:26.698057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:26.699287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:26.700443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:53:26.700443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:53:26.700443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:26.700443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:26.700443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 613/1203] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:26.705283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02272bc-bef1-4950-8d37-36ae7603cae2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:26.802171 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02272bc-bef1-4950-8d37-36ae7603cae2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:26.835081 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003a816-535b-4def-8ace-882670aea6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:26.835744 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003a816-535b-4def-8ace-882670aea6bb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:26.836024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003a816-535b-4def-8ace-882670aea6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:26.836296 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003a816-535b-4def-8ace-882670aea6bb None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:26.837004 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003a816-535b-4def-8ace-882670aea6bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:26.837304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003a816-535b-4def-8ace-882670aea6bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:26.838697 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003a816-535b-4def-8ace-882670aea6bb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:26.850304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 591/1204] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:26.856100 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea0028-f96e-4d78-820f-b679efe48c78 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:26.952179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea0028-f96e-4d78-820f-b679efe48c78 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:26.985218 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4f7d3-167c-41ee-882e-9124e6a5e3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:26.985882 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4f7d3-167c-41ee-882e-9124e6a5e3aa None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:26.986163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4f7d3-167c-41ee-882e-9124e6a5e3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:26.986440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4f7d3-167c-41ee-882e-9124e6a5e3aa None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:26.987202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4f7d3-167c-41ee-882e-9124e6a5e3aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:26.989162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4f7d3-167c-41ee-882e-9124e6a5e3aa None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:27.079454 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 614/1205] 10.222.0.24 () {60 vars in 1132 bytes} [Tue May 17 21:53:26 2022] POST /identity/v3/users => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:53:29.293978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66ac5-af08-4797-94e7-7b641524b366 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:29.294505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66ac5-af08-4797-94e7-7b641524b366 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:29.294601 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66ac5-af08-4797-94e7-7b641524b366 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:29.295954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 592/1206] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 21:53:29.301584 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f859b-4cb4-488e-8381-d7b16f47b593 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:29.302253 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f859b-4cb4-488e-8381-d7b16f47b593 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:29.302388 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f859b-4cb4-488e-8381-d7b16f47b593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:29.318746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-bb9f859b-4cb4-488e-8381-d7b16f47b593 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:53:29.319956 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bb9f859b-4cb4-488e-8381-d7b16f47b593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:53:29.383545 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 615/1207] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:53:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:53:29.407410 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c66ac5-af08-4797-94e7-7b641524b366 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:29.507850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c66ac5-af08-4797-94e7-7b641524b366 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:29.540107 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc4f8a-2392-4771-8d07-77f070f3d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:29.540890 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc4f8a-2392-4771-8d07-77f070f3d53d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:29.541174 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc4f8a-2392-4771-8d07-77f070f3d53d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:29.541449 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc4f8a-2392-4771-8d07-77f070f3d53d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:29.552191 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc4f8a-2392-4771-8d07-77f070f3d53d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-30dc4f8a-2392-4771-8d07-77f070f3d53d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:53:29.559867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:29.567994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:29.568826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:29.568826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:29.568826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:29.568826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:29.568826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:53:29.568826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:53:29.568826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:53:29.568826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:53:29.568826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:53:29.568826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:53:29.568826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:53:29.568826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:29.568826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 593/1208] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:53:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:29.569574 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f859b-4cb4-488e-8381-d7b16f47b593 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:29.661289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f859b-4cb4-488e-8381-d7b16f47b593 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:29.694210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dacf0b-5562-4691-88b3-cf599b2dca35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:29.694868 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dacf0b-5562-4691-88b3-cf599b2dca35 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:29.695172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dacf0b-5562-4691-88b3-cf599b2dca35 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:29.695447 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dacf0b-5562-4691-88b3-cf599b2dca35 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:29.696182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dacf0b-5562-4691-88b3-cf599b2dca35 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:29.696484 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dacf0b-5562-4691-88b3-cf599b2dca35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:29.697847 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dacf0b-5562-4691-88b3-cf599b2dca35 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:29.705602 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 616/1209] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:53:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:29.711998 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc4f8a-2392-4771-8d07-77f070f3d53d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:29.807603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc4f8a-2392-4771-8d07-77f070f3d53d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:29.840147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e9f89-0c50-4b97-8637-6f22286c432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:29.840929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e9f89-0c50-4b97-8637-6f22286c432c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:29.841209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e9f89-0c50-4b97-8637-6f22286c432c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:29.841480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e9f89-0c50-4b97-8637-6f22286c432c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:29.851346 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e9f89-0c50-4b97-8637-6f22286c432c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:29.852800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e9f89-0c50-4b97-8637-6f22286c432c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:29.870301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f74e9f89-0c50-4b97-8637-6f22286c432c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:29.870301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:29.870301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:29.870301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:29.870301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:29.870301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:29.870301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:29.870301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:29.870301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:29.870301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:29.870301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:29.870301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:29.870301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:53:29.870301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:53:29.870301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:29.871428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:29.872491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:53:29.872491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:53:29.872491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:29.872491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:29.872491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 594/1210] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:29.877273 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dacf0b-5562-4691-88b3-cf599b2dca35 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:29.974403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dacf0b-5562-4691-88b3-cf599b2dca35 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:30.007432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d371009-084f-4df5-8564-4e3a881979bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:30.010578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d371009-084f-4df5-8564-4e3a881979bd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:30.010578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d371009-084f-4df5-8564-4e3a881979bd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:30.010578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d371009-084f-4df5-8564-4e3a881979bd None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:30.010578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d371009-084f-4df5-8564-4e3a881979bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:30.010578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d371009-084f-4df5-8564-4e3a881979bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:30.010971 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d371009-084f-4df5-8564-4e3a881979bd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:30.021878 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 617/1211] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:53:30.027541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e9f89-0c50-4b97-8637-6f22286c432c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:30.125374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e9f89-0c50-4b97-8637-6f22286c432c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:30.157968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec074bb-b227-460d-bf46-c2bbdfcecea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:30.158762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec074bb-b227-460d-bf46-c2bbdfcecea4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:30.159046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec074bb-b227-460d-bf46-c2bbdfcecea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:30.159886 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec074bb-b227-460d-bf46-c2bbdfcecea4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:30.167438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec074bb-b227-460d-bf46-c2bbdfcecea4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:30.168854 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec074bb-b227-460d-bf46-c2bbdfcecea4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1ec074bb-b227-460d-bf46-c2bbdfcecea4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:53:30.183621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:30.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:30.185770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:30.185770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:30.185770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:53:30.185770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:53:30.185770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:53:30.185770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:53:30.185770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:53:30.185770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:53:30.185770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 21:53:30.185770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:30.185770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 595/1212] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:30.190706 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d371009-084f-4df5-8564-4e3a881979bd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:30.285952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d371009-084f-4df5-8564-4e3a881979bd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:30.318285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098edd7-2f42-466f-b545-220d28dac58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:30.319003 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098edd7-2f42-466f-b545-220d28dac58f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:30.319255 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098edd7-2f42-466f-b545-220d28dac58f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:30.319527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098edd7-2f42-466f-b545-220d28dac58f None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:30.320352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098edd7-2f42-466f-b545-220d28dac58f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:30.320655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098edd7-2f42-466f-b545-220d28dac58f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:30.322092 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098edd7-2f42-466f-b545-220d28dac58f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:30.339180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 618/1213] 10.222.0.24 () {56 vars in 1143 bytes} [Tue May 17 21:53:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:30.344820 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec074bb-b227-460d-bf46-c2bbdfcecea4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:30.440192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec074bb-b227-460d-bf46-c2bbdfcecea4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:30.473091 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f718e-8bed-4fc1-8574-ab770b998380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:30.473718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f718e-8bed-4fc1-8574-ab770b998380 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:30.474000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f718e-8bed-4fc1-8574-ab770b998380 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:30.474270 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f718e-8bed-4fc1-8574-ab770b998380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:30.537901 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f718e-8bed-4fc1-8574-ab770b998380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:30.539442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f718e-8bed-4fc1-8574-ab770b998380 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:30.635573 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 596/1214] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:53:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 21:53:30.641351 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098edd7-2f42-466f-b545-220d28dac58f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:30.736868 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098edd7-2f42-466f-b545-220d28dac58f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:30.769505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca405b-c48b-4289-aca8-3b6e10d9a81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:30.770277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca405b-c48b-4289-aca8-3b6e10d9a81f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:30.770554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca405b-c48b-4289-aca8-3b6e10d9a81f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:30.770824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca405b-c48b-4289-aca8-3b6e10d9a81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:30.780525 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca405b-c48b-4289-aca8-3b6e10d9a81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:30.783228 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca405b-c48b-4289-aca8-3b6e10d9a81f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:30.798719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-23ca405b-c48b-4289-aca8-3b6e10d9a81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:30.798719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:30.798719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:30.798719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:30.798719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:30.798719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:30.798719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:30.798719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:30.798719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:30.798719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:30.798719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:30.798719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:30.798719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:53:30.798719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:53:30.798719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:30.800336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:30.801400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:53:30.801400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:53:30.801400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:30.801400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:30.801400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 619/1215] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:30.816613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f718e-8bed-4fc1-8574-ab770b998380 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:30.913492 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f718e-8bed-4fc1-8574-ab770b998380 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:30.947001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f1699-ce1e-4ee2-88b7-d67350aa1840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:30.947693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f1699-ce1e-4ee2-88b7-d67350aa1840 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:30.947974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f1699-ce1e-4ee2-88b7-d67350aa1840 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:30.948245 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f1699-ce1e-4ee2-88b7-d67350aa1840 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:30.948956 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f1699-ce1e-4ee2-88b7-d67350aa1840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:30.949259 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f1699-ce1e-4ee2-88b7-d67350aa1840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:30.950606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f1699-ce1e-4ee2-88b7-d67350aa1840 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:30.961632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 597/1216] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:30.967323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca405b-c48b-4289-aca8-3b6e10d9a81f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:31.063279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca405b-c48b-4289-aca8-3b6e10d9a81f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:31.095332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdab450-b06f-4cdd-9925-e7b39829c91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:31.096108 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdab450-b06f-4cdd-9925-e7b39829c91e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:31.096390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdab450-b06f-4cdd-9925-e7b39829c91e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:31.097200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdab450-b06f-4cdd-9925-e7b39829c91e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:31.103933 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdab450-b06f-4cdd-9925-e7b39829c91e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:31.109211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdab450-b06f-4cdd-9925-e7b39829c91e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:31.119413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ffdab450-b06f-4cdd-9925-e7b39829c91e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:53:31.119413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:31.119413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:31.119413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:31.119413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:31.119413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:31.119413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:31.119413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:31.119413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:31.119413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:31.119413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:31.119413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:31.119413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:53:31.119413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:53:31.119413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:31.120428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:31.121696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:53:31.121696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:53:31.121696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:53:31.121696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:53:31.121696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:53:31.121696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:53:31.121696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:53:31.121696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:31.121696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 620/1217] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:53:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:31.126424 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f1699-ce1e-4ee2-88b7-d67350aa1840 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:31.226479 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f1699-ce1e-4ee2-88b7-d67350aa1840 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:31.258058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934836e9-f319-4b4a-a70e-0adf1c031b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:31.258703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934836e9-f319-4b4a-a70e-0adf1c031b01 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:31.258981 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934836e9-f319-4b4a-a70e-0adf1c031b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:31.259286 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934836e9-f319-4b4a-a70e-0adf1c031b01 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:31.260054 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934836e9-f319-4b4a-a70e-0adf1c031b01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:31.260355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934836e9-f319-4b4a-a70e-0adf1c031b01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:31.261767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934836e9-f319-4b4a-a70e-0adf1c031b01 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:31.273691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 598/1218] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:53:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:53:31.279691 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdab450-b06f-4cdd-9925-e7b39829c91e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:31.376452 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdab450-b06f-4cdd-9925-e7b39829c91e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:31.409130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740a65c-96b6-4f55-af20-2f309d34f60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:31.410052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a65c-96b6-4f55-af20-2f309d34f60d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:31.410335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a65c-96b6-4f55-af20-2f309d34f60d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:31.410608 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a65c-96b6-4f55-af20-2f309d34f60d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:31.411494 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740a65c-96b6-4f55-af20-2f309d34f60d None admin] RBAC: Adding query filter params (role.id=17cc20a61bbf4f5ea7ae111203cfda47, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=2cbd89f9b7a24b6cb993ca86e964c54d) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:31.411798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740a65c-96b6-4f55-af20-2f309d34f60d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:31.416578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740a65c-96b6-4f55-af20-2f309d34f60d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:31.418703 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 621/1219] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:53:31 2022] GET /identity/v3/role_assignments?user.id=2cbd89f9b7a24b6cb993ca86e964c54d&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=17cc20a61bbf4f5ea7ae111203cfda47 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:33.649219 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cfee0-3e49-4de2-9b01-ddc10347efb3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:33.649775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cfee0-3e49-4de2-9b01-ddc10347efb3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:33.649880 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cfee0-3e49-4de2-9b01-ddc10347efb3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:33.651196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 599/1220] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:53:33.656290 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177383f-32b7-48ee-b8de-6f47c636e622 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:33.656670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177383f-32b7-48ee-b8de-6f47c636e622 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:33.656857 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177383f-32b7-48ee-b8de-6f47c636e622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:33.673830 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e177383f-32b7-48ee-b8de-6f47c636e622 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:53:33.675740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e177383f-32b7-48ee-b8de-6f47c636e622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:53:33.740589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 622/1221] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:53:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:53:33.763738 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cfee0-3e49-4de2-9b01-ddc10347efb3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:33.864655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cfee0-3e49-4de2-9b01-ddc10347efb3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:33.908367 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80898e45-97f9-41d3-835e-102f37f81946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:33.909715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80898e45-97f9-41d3-835e-102f37f81946 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:33.910005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80898e45-97f9-41d3-835e-102f37f81946 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:33.910277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80898e45-97f9-41d3-835e-102f37f81946 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:33.920150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80898e45-97f9-41d3-835e-102f37f81946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-80898e45-97f9-41d3-835e-102f37f81946 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:53:33.929105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:33.930246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:33.931504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:33.931504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:33.931504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:33.931504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:33.931504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:53:33.931504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:53:33.931504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:53:33.931504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:53:33.931504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:53:33.931504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:53:33.931504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:53:33.931504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:33.931504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 600/1222] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:53:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:33.936442 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177383f-32b7-48ee-b8de-6f47c636e622 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:34.029508 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177383f-32b7-48ee-b8de-6f47c636e622 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:34.062530 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5c7cd-007c-4f9e-9495-d0c473d75411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:34.063212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5c7cd-007c-4f9e-9495-d0c473d75411 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:34.063491 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5c7cd-007c-4f9e-9495-d0c473d75411 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:34.063759 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5c7cd-007c-4f9e-9495-d0c473d75411 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:34.064487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5c7cd-007c-4f9e-9495-d0c473d75411 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:34.064784 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5c7cd-007c-4f9e-9495-d0c473d75411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:34.066175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5c7cd-007c-4f9e-9495-d0c473d75411 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:34.073775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 623/1223] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:53:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:34.079631 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80898e45-97f9-41d3-835e-102f37f81946 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:34.176135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80898e45-97f9-41d3-835e-102f37f81946 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:34.208174 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afdd0f-6f0c-4ccb-8655-27d226e1f886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:34.208948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afdd0f-6f0c-4ccb-8655-27d226e1f886 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:34.209224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afdd0f-6f0c-4ccb-8655-27d226e1f886 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:34.209501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afdd0f-6f0c-4ccb-8655-27d226e1f886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:34.219760 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afdd0f-6f0c-4ccb-8655-27d226e1f886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:34.221179 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afdd0f-6f0c-4ccb-8655-27d226e1f886 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:34.244526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-13afdd0f-6f0c-4ccb-8655-27d226e1f886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:34.244526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:34.244526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:34.244526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:34.244526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:34.244526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:34.244526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:34.244526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:34.244526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:34.244526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:34.244526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:34.244526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:34.244526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:53:34.244526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:53:34.244526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:34.251728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:34.252912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:53:34.252912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:53:34.252912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:34.252912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:34.252912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 601/1224] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:34.253403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5c7cd-007c-4f9e-9495-d0c473d75411 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:34.350143 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5c7cd-007c-4f9e-9495-d0c473d75411 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:34.381493 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e07f3-9356-440b-a579-78d941dcc4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:34.382146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e07f3-9356-440b-a579-78d941dcc4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:34.382427 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e07f3-9356-440b-a579-78d941dcc4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:34.382699 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e07f3-9356-440b-a579-78d941dcc4e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:34.383443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e07f3-9356-440b-a579-78d941dcc4e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:34.383746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e07f3-9356-440b-a579-78d941dcc4e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:34.385101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e07f3-9356-440b-a579-78d941dcc4e3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:34.397149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 624/1225] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 21:53:34.402811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afdd0f-6f0c-4ccb-8655-27d226e1f886 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:34.500699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afdd0f-6f0c-4ccb-8655-27d226e1f886 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:34.533306 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acadce8-dd56-4809-88d7-10fd2cb87dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:34.534708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acadce8-dd56-4809-88d7-10fd2cb87dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:34.534995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acadce8-dd56-4809-88d7-10fd2cb87dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:34.535319 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acadce8-dd56-4809-88d7-10fd2cb87dc5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:34.543075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acadce8-dd56-4809-88d7-10fd2cb87dc5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:34.544528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acadce8-dd56-4809-88d7-10fd2cb87dc5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9acadce8-dd56-4809-88d7-10fd2cb87dc5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:53:34.559267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:34.560364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:34.561400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:34.561400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:34.561400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:53:34.561400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:53:34.561400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:53:34.561400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:53:34.561400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:53:34.561400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:53:34.561400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 21:53:34.561400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:34.561400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 602/1226] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:34.567207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e07f3-9356-440b-a579-78d941dcc4e3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:34.662970 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e07f3-9356-440b-a579-78d941dcc4e3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:34.696535 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e0504-d4df-4d3d-a957-2405a4aa828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:34.697198 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e0504-d4df-4d3d-a957-2405a4aa828c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:34.697470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e0504-d4df-4d3d-a957-2405a4aa828c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:34.697743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e0504-d4df-4d3d-a957-2405a4aa828c None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:34.698560 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e0504-d4df-4d3d-a957-2405a4aa828c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:34.698862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e0504-d4df-4d3d-a957-2405a4aa828c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:34.700324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e0504-d4df-4d3d-a957-2405a4aa828c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:34.717344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 625/1227] 10.222.0.24 () {56 vars in 1143 bytes} [Tue May 17 21:53:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:34.723199 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acadce8-dd56-4809-88d7-10fd2cb87dc5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:34.818709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acadce8-dd56-4809-88d7-10fd2cb87dc5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:34.858122 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a44fca-fbd6-4627-9010-454f25787b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:34.858976 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a44fca-fbd6-4627-9010-454f25787b9e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:34.859288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a44fca-fbd6-4627-9010-454f25787b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:34.859556 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a44fca-fbd6-4627-9010-454f25787b9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:34.870891 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a44fca-fbd6-4627-9010-454f25787b9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:34.872436 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a44fca-fbd6-4627-9010-454f25787b9e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:34.890172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b1a44fca-fbd6-4627-9010-454f25787b9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:34.890172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:34.890172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:34.890172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:34.890172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:34.890172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:34.890172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:34.890172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:34.890172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:34.890172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:34.890172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:34.890172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:34.890172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:53:34.890172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:53:34.890172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:34.891493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:34.892497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:53:34.892497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:53:34.892497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:34.892497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:34.892497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 603/1228] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:34.897927 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e0504-d4df-4d3d-a957-2405a4aa828c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:34.995561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e0504-d4df-4d3d-a957-2405a4aa828c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:35.028291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12725f-013d-451b-acde-51af5ab45d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:35.028938 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12725f-013d-451b-acde-51af5ab45d8a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:35.029214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12725f-013d-451b-acde-51af5ab45d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:35.029483 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12725f-013d-451b-acde-51af5ab45d8a None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:35.030184 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12725f-013d-451b-acde-51af5ab45d8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:35.030482 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12725f-013d-451b-acde-51af5ab45d8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:35.031865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12725f-013d-451b-acde-51af5ab45d8a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:35.042624 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 626/1229] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:35.048189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a44fca-fbd6-4627-9010-454f25787b9e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:35.144430 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a44fca-fbd6-4627-9010-454f25787b9e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:35.180364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d615c-445c-478c-ae81-b70c61e809cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:35.181144 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d615c-445c-478c-ae81-b70c61e809cd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:35.181424 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d615c-445c-478c-ae81-b70c61e809cd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:35.181693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d615c-445c-478c-ae81-b70c61e809cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:35.188144 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d615c-445c-478c-ae81-b70c61e809cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:35.189590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d615c-445c-478c-ae81-b70c61e809cd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:35.204076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-360d615c-445c-478c-ae81-b70c61e809cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:53:35.204076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:35.204076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:35.204076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:35.204076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:35.204076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:35.204076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:35.204076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:35.204076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:35.204076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:35.204076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:35.204076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:35.204076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:53:35.204076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:53:35.204076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:35.205149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:35.206623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:53:35.206623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:53:35.206623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:53:35.206623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:53:35.206623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:53:35.206623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:53:35.206623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:53:35.206623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:35.206623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 604/1230] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:53:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:35.211008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12725f-013d-451b-acde-51af5ab45d8a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:35.307127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12725f-013d-451b-acde-51af5ab45d8a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:35.339844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218462f-0e33-42d4-aa1d-5b4b8d2c0bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:35.340500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218462f-0e33-42d4-aa1d-5b4b8d2c0bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:35.340783 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218462f-0e33-42d4-aa1d-5b4b8d2c0bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:35.341057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218462f-0e33-42d4-aa1d-5b4b8d2c0bf3 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:35.341841 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218462f-0e33-42d4-aa1d-5b4b8d2c0bf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:35.342147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218462f-0e33-42d4-aa1d-5b4b8d2c0bf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:35.343661 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218462f-0e33-42d4-aa1d-5b4b8d2c0bf3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:35.355389 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 627/1231] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:53:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:35.361415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d615c-445c-478c-ae81-b70c61e809cd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:35.458812 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d615c-445c-478c-ae81-b70c61e809cd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:35.492013 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a0e82-5b16-475e-98a2-5c87a5d69198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:35.492899 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a0e82-5b16-475e-98a2-5c87a5d69198 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:35.493193 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a0e82-5b16-475e-98a2-5c87a5d69198 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:35.493462 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a0e82-5b16-475e-98a2-5c87a5d69198 None admin] PATH_INFO: `/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/2cbd89f9b7a24b6cb993ca86e964c54d/roles/17cc20a61bbf4f5ea7ae111203cfda47` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:35.507223 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a0e82-5b16-475e-98a2-5c87a5d69198 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e90e91d3094e67b09b2b8137f210f4, user_id=2cbd89f9b7a24b6cb993ca86e964c54d, role_id=17cc20a61bbf4f5ea7ae111203cfda47)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:35.508654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a0e82-5b16-475e-98a2-5c87a5d69198 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:35.645080 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 605/1232] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:53:35 2022] PUT /identity/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/2cbd89f9b7a24b6cb993ca86e964c54d/roles/17cc20a61bbf4f5ea7ae111203cfda47 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:53:37.891213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707248e-3e58-42fe-94af-81f3685459a8 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:37.891763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707248e-3e58-42fe-94af-81f3685459a8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:37.891763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707248e-3e58-42fe-94af-81f3685459a8 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:37.893119 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 628/1233] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:53:37.898578 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac103e5-999f-4698-bfc7-d2a0bf2eb1dc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:37.898980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac103e5-999f-4698-bfc7-d2a0bf2eb1dc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:37.899156 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac103e5-999f-4698-bfc7-d2a0bf2eb1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:37.915815 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fac103e5-999f-4698-bfc7-d2a0bf2eb1dc None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:53:37.936229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fac103e5-999f-4698-bfc7-d2a0bf2eb1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:53:37.981216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 606/1234] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:53:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:53:38.005573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707248e-3e58-42fe-94af-81f3685459a8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:38.104729 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707248e-3e58-42fe-94af-81f3685459a8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:38.138229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259f9da-ba3f-41cf-9ca8-50df9548607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:38.139070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259f9da-ba3f-41cf-9ca8-50df9548607b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:38.139402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259f9da-ba3f-41cf-9ca8-50df9548607b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:38.139700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259f9da-ba3f-41cf-9ca8-50df9548607b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:38.149651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259f9da-ba3f-41cf-9ca8-50df9548607b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b259f9da-ba3f-41cf-9ca8-50df9548607b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:53:38.157372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:38.158501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:38.159831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:38.159831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:38.159831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:38.159831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:38.159831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:53:38.159831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:53:38.159831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:53:38.159831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:53:38.159831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:53:38.159831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:53:38.159831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 21:53:38.159831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:38.159831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 629/1235] 10.222.0.24 () {56 vars in 1102 bytes} [Tue May 17 21:53:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:38.164538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac103e5-999f-4698-bfc7-d2a0bf2eb1dc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:38.260852 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac103e5-999f-4698-bfc7-d2a0bf2eb1dc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:38.292898 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdae7b7-308f-4c2c-99d8-2a3964d96eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:38.296258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdae7b7-308f-4c2c-99d8-2a3964d96eeb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:38.296258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdae7b7-308f-4c2c-99d8-2a3964d96eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:38.296258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdae7b7-308f-4c2c-99d8-2a3964d96eeb None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:38.296258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdae7b7-308f-4c2c-99d8-2a3964d96eeb None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:38.296258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdae7b7-308f-4c2c-99d8-2a3964d96eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:38.296673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdae7b7-308f-4c2c-99d8-2a3964d96eeb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:38.305451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 607/1236] 10.222.0.24 () {56 vars in 1103 bytes} [Tue May 17 21:53:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:38.311130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259f9da-ba3f-41cf-9ca8-50df9548607b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:38.409811 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259f9da-ba3f-41cf-9ca8-50df9548607b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:38.442160 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288eca3-c98c-46dc-81a1-92466d4b5f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:38.442937 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288eca3-c98c-46dc-81a1-92466d4b5f2b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:38.443258 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288eca3-c98c-46dc-81a1-92466d4b5f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:38.443563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288eca3-c98c-46dc-81a1-92466d4b5f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:38.453749 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288eca3-c98c-46dc-81a1-92466d4b5f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:38.455207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288eca3-c98c-46dc-81a1-92466d4b5f2b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:38.472435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-2288eca3-c98c-46dc-81a1-92466d4b5f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:38.472435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:38.472435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:38.472435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:38.472435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:38.472435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:38.472435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:38.472435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:38.472435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:38.472435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:38.472435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:38.472435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:38.472435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:53:38.472435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:53:38.472435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:38.473516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:38.474808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:53:38.474808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:53:38.474808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:38.474808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:38.474808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 630/1237] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:38.479403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdae7b7-308f-4c2c-99d8-2a3964d96eeb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:38.576330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdae7b7-308f-4c2c-99d8-2a3964d96eeb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:38.609800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2bece-beec-4cbb-a0d1-e3e1f8b8c3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:38.610455 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2bece-beec-4cbb-a0d1-e3e1f8b8c3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:38.610733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2bece-beec-4cbb-a0d1-e3e1f8b8c3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:38.611004 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2bece-beec-4cbb-a0d1-e3e1f8b8c3a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:38.611742 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2bece-beec-4cbb-a0d1-e3e1f8b8c3a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:38.612698 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2bece-beec-4cbb-a0d1-e3e1f8b8c3a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:38.614247 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2bece-beec-4cbb-a0d1-e3e1f8b8c3a3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:38.625274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 608/1238] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:38.630916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288eca3-c98c-46dc-81a1-92466d4b5f2b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:38.726846 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288eca3-c98c-46dc-81a1-92466d4b5f2b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:38.758865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06aa62c-18d8-4bcf-81f4-613286071adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:38.759706 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06aa62c-18d8-4bcf-81f4-613286071adb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:38.759981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06aa62c-18d8-4bcf-81f4-613286071adb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:38.760246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06aa62c-18d8-4bcf-81f4-613286071adb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:38.767364 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06aa62c-18d8-4bcf-81f4-613286071adb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:38.768926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06aa62c-18d8-4bcf-81f4-613286071adb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e06aa62c-18d8-4bcf-81f4-613286071adb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:53:38.782613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:38.783796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:38.785149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:38.785149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:38.785149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:53:38.785149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:53:38.785149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:53:38.785149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:53:38.785149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:53:38.785149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:53:38.785149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 21:53:38.785149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:38.785149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 631/1239] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:38.789626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2bece-beec-4cbb-a0d1-e3e1f8b8c3a3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:38.886133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2bece-beec-4cbb-a0d1-e3e1f8b8c3a3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:38.919427 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26015c45-faab-4693-b25b-c4097a37c00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:38.920183 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26015c45-faab-4693-b25b-c4097a37c00f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:38.920414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26015c45-faab-4693-b25b-c4097a37c00f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:38.920683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26015c45-faab-4693-b25b-c4097a37c00f None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:38.921510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26015c45-faab-4693-b25b-c4097a37c00f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:38.921813 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26015c45-faab-4693-b25b-c4097a37c00f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:38.923257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26015c45-faab-4693-b25b-c4097a37c00f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:38.941783 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 609/1240] 10.222.0.24 () {56 vars in 1143 bytes} [Tue May 17 21:53:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:38.947482 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06aa62c-18d8-4bcf-81f4-613286071adb None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:39.042518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06aa62c-18d8-4bcf-81f4-613286071adb None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:39.077635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eeecb-1773-4ff4-b809-6999482a8740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:39.078276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eeecb-1773-4ff4-b809-6999482a8740 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:39.078560 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eeecb-1773-4ff4-b809-6999482a8740 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:39.078836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eeecb-1773-4ff4-b809-6999482a8740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:39.142905 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620eeecb-1773-4ff4-b809-6999482a8740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:39.144420 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620eeecb-1773-4ff4-b809-6999482a8740 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:39.260841 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 632/1241] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:53:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:53:39.266805 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26015c45-faab-4693-b25b-c4097a37c00f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:39.361480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26015c45-faab-4693-b25b-c4097a37c00f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:39.394395 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f81202-fc08-441c-be30-b2911c53dae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:39.395199 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f81202-fc08-441c-be30-b2911c53dae3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:39.395483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f81202-fc08-441c-be30-b2911c53dae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:39.395756 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f81202-fc08-441c-be30-b2911c53dae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:39.405593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f81202-fc08-441c-be30-b2911c53dae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:39.407045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f81202-fc08-441c-be30-b2911c53dae3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:39.425727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-89f81202-fc08-441c-be30-b2911c53dae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:39.425727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:39.425727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:39.425727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:39.425727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:39.425727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:39.425727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:39.425727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:39.425727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:39.425727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:39.425727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:39.425727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:39.425727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:53:39.425727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:53:39.425727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:39.427127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:39.428257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:53:39.428257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:53:39.428257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:39.428257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:39.428257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 610/1242] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:53:39.433213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eeecb-1773-4ff4-b809-6999482a8740 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:39.527313 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eeecb-1773-4ff4-b809-6999482a8740 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:39.565767 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f36bad-7f0c-4a81-895c-46cb5139aa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:39.566457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f36bad-7f0c-4a81-895c-46cb5139aa5f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:39.566730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f36bad-7f0c-4a81-895c-46cb5139aa5f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:39.567000 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f36bad-7f0c-4a81-895c-46cb5139aa5f None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:39.567790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f36bad-7f0c-4a81-895c-46cb5139aa5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:39.568090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f36bad-7f0c-4a81-895c-46cb5139aa5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:39.569432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f36bad-7f0c-4a81-895c-46cb5139aa5f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:39.580483 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 633/1243] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:39.586784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f81202-fc08-441c-be30-b2911c53dae3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:39.683910 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f81202-fc08-441c-be30-b2911c53dae3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:39.716812 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5c502-1de8-4f87-948c-87884b28403f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:39.718473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5c502-1de8-4f87-948c-87884b28403f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:39.718473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5c502-1de8-4f87-948c-87884b28403f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:39.718473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5c502-1de8-4f87-948c-87884b28403f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:39.724910 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5c502-1de8-4f87-948c-87884b28403f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:39.728328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5c502-1de8-4f87-948c-87884b28403f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:39.740250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5ff5c502-1de8-4f87-948c-87884b28403f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:53:39.740250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:39.740250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:39.740250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:39.740250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:39.740250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:39.740250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:39.740250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:39.740250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:39.740250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:39.740250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:39.740250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:39.740250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:53:39.740250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:53:39.740250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:39.741274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:39.742229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:53:39.742229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:53:39.742229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:53:39.742229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:53:39.742229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:53:39.742229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:53:39.742229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:53:39.742229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:39.742229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 611/1244] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:39.747187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f36bad-7f0c-4a81-895c-46cb5139aa5f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:39.844758 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f36bad-7f0c-4a81-895c-46cb5139aa5f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:39.877533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba10f96-fb60-4ac9-bb42-6cdf1640daad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:39.878629 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba10f96-fb60-4ac9-bb42-6cdf1640daad None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:39.878905 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba10f96-fb60-4ac9-bb42-6cdf1640daad None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:39.879202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba10f96-fb60-4ac9-bb42-6cdf1640daad None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:39.879977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba10f96-fb60-4ac9-bb42-6cdf1640daad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:39.880277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba10f96-fb60-4ac9-bb42-6cdf1640daad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:39.881701 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba10f96-fb60-4ac9-bb42-6cdf1640daad None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:39.894386 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 634/1245] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:39.900570 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5c502-1de8-4f87-948c-87884b28403f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:39.996836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5c502-1de8-4f87-948c-87884b28403f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:40.029304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ba949-557f-408b-b41b-f9239b4de1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:40.029949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ba949-557f-408b-b41b-f9239b4de1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:40.030231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ba949-557f-408b-b41b-f9239b4de1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:40.030502 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ba949-557f-408b-b41b-f9239b4de1d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:40.031346 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ba949-557f-408b-b41b-f9239b4de1d9 None admin] RBAC: Adding query filter params (role.id=17cc20a61bbf4f5ea7ae111203cfda47, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=2cbd89f9b7a24b6cb993ca86e964c54d) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:40.031654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ba949-557f-408b-b41b-f9239b4de1d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:40.033060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ba949-557f-408b-b41b-f9239b4de1d9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:40.038720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 612/1246] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:53:39 2022] GET /identity/v3/role_assignments?user.id=2cbd89f9b7a24b6cb993ca86e964c54d&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=17cc20a61bbf4f5ea7ae111203cfda47 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:42.280081 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505c0f6-8d4e-4c21-8835-711a8768aa94 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:42.280630 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505c0f6-8d4e-4c21-8835-711a8768aa94 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:42.280630 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505c0f6-8d4e-4c21-8835-711a8768aa94 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:42.281928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 635/1247] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:53:42.287394 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b581170-2a17-4892-8c30-621761b5d4bb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:42.287794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b581170-2a17-4892-8c30-621761b5d4bb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:42.287985 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b581170-2a17-4892-8c30-621761b5d4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:42.304865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4b581170-2a17-4892-8c30-621761b5d4bb None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:53:42.306161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4b581170-2a17-4892-8c30-621761b5d4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:53:42.370444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 613/1248] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:53:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:53:42.395129 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505c0f6-8d4e-4c21-8835-711a8768aa94 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:42.491924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505c0f6-8d4e-4c21-8835-711a8768aa94 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:42.524575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c9fee-c506-48ac-b1f1-1517d3ca067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:42.525352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c9fee-c506-48ac-b1f1-1517d3ca067d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:42.525628 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c9fee-c506-48ac-b1f1-1517d3ca067d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:42.525901 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c9fee-c506-48ac-b1f1-1517d3ca067d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:42.535982 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c9fee-c506-48ac-b1f1-1517d3ca067d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-761c9fee-c506-48ac-b1f1-1517d3ca067d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:53:42.543646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:42.544764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:42.545965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:42.545965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:42.545965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:42.545965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:42.545965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:53:42.545965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:53:42.545965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:53:42.545965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:53:42.545965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:53:42.545965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:53:42.545965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:53:42.545965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:42.545965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 636/1249] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:53:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:42.551403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b581170-2a17-4892-8c30-621761b5d4bb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:42.648120 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b581170-2a17-4892-8c30-621761b5d4bb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:42.681102 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e20b66-4f0b-43bb-9ad6-05d266efc50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:42.681792 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e20b66-4f0b-43bb-9ad6-05d266efc50a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:42.682075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e20b66-4f0b-43bb-9ad6-05d266efc50a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:42.682350 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e20b66-4f0b-43bb-9ad6-05d266efc50a None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:42.683089 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e20b66-4f0b-43bb-9ad6-05d266efc50a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:42.683427 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e20b66-4f0b-43bb-9ad6-05d266efc50a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:42.684781 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e20b66-4f0b-43bb-9ad6-05d266efc50a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:42.693622 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 614/1250] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:53:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:42.699469 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c9fee-c506-48ac-b1f1-1517d3ca067d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:42.795444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c9fee-c506-48ac-b1f1-1517d3ca067d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:42.828528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504969f1-1ad4-4d9e-b598-299684c2abe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:42.829325 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504969f1-1ad4-4d9e-b598-299684c2abe9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:42.829596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504969f1-1ad4-4d9e-b598-299684c2abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:42.829862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504969f1-1ad4-4d9e-b598-299684c2abe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:42.840752 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504969f1-1ad4-4d9e-b598-299684c2abe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:42.842181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504969f1-1ad4-4d9e-b598-299684c2abe9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:42.860064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-504969f1-1ad4-4d9e-b598-299684c2abe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:42.860064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:42.860064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:42.860064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:42.860064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:42.860064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:42.860064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:42.860064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:42.860064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:42.860064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:42.860064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:42.860064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:42.860064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:53:42.860064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:53:42.860064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:42.861093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:42.862130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:53:42.862130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:53:42.862130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:42.862130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:42.862130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 637/1251] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:42.867084 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e20b66-4f0b-43bb-9ad6-05d266efc50a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:42.967665 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e20b66-4f0b-43bb-9ad6-05d266efc50a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:42.998848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fb825-8b15-409f-bc28-1fb0391e48f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:42.999529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fb825-8b15-409f-bc28-1fb0391e48f1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:42.999809 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fb825-8b15-409f-bc28-1fb0391e48f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:43.000080 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fb825-8b15-409f-bc28-1fb0391e48f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:43.000792 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fb825-8b15-409f-bc28-1fb0391e48f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:43.001092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fb825-8b15-409f-bc28-1fb0391e48f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:43.003007 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fb825-8b15-409f-bc28-1fb0391e48f1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:43.014860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 615/1252] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:43.021220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504969f1-1ad4-4d9e-b598-299684c2abe9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:43.116922 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504969f1-1ad4-4d9e-b598-299684c2abe9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:43.149670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d51049-61a9-45a7-8ece-6b97c7204134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:43.150455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d51049-61a9-45a7-8ece-6b97c7204134 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:43.150735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d51049-61a9-45a7-8ece-6b97c7204134 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:43.151007 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d51049-61a9-45a7-8ece-6b97c7204134 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:43.157737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d51049-61a9-45a7-8ece-6b97c7204134 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:43.159372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d51049-61a9-45a7-8ece-6b97c7204134 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e8d51049-61a9-45a7-8ece-6b97c7204134 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:53:43.173903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:43.175008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:43.176191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:43.176191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:43.176191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:53:43.176191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:53:43.176191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:53:43.176191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:53:43.176191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:53:43.176191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:53:43.176191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 21:53:43.176191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:43.176191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 638/1253] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:43.183092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fb825-8b15-409f-bc28-1fb0391e48f1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:43.279623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fb825-8b15-409f-bc28-1fb0391e48f1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:43.312611 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422d528-c2cd-4927-ba06-6156033169e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:43.313272 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422d528-c2cd-4927-ba06-6156033169e8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:43.313556 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422d528-c2cd-4927-ba06-6156033169e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:43.313835 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422d528-c2cd-4927-ba06-6156033169e8 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:43.314665 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422d528-c2cd-4927-ba06-6156033169e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:43.315603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422d528-c2cd-4927-ba06-6156033169e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:43.317029 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422d528-c2cd-4927-ba06-6156033169e8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:43.335806 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 616/1254] 10.222.0.24 () {56 vars in 1143 bytes} [Tue May 17 21:53:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:43.341553 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d51049-61a9-45a7-8ece-6b97c7204134 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:43.438961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d51049-61a9-45a7-8ece-6b97c7204134 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:43.471664 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb805a22-b3bc-4e27-8d4e-3831050f19b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:43.472303 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb805a22-b3bc-4e27-8d4e-3831050f19b8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:43.472581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb805a22-b3bc-4e27-8d4e-3831050f19b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:43.472854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb805a22-b3bc-4e27-8d4e-3831050f19b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:43.536533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb805a22-b3bc-4e27-8d4e-3831050f19b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:43.537969 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb805a22-b3bc-4e27-8d4e-3831050f19b8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:43.631603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 639/1255] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:53:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 21:53:43.637319 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422d528-c2cd-4927-ba06-6156033169e8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:43.733095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422d528-c2cd-4927-ba06-6156033169e8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:43.765650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7db0ce-b72e-457a-b810-5e9253c4e389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:43.766423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7db0ce-b72e-457a-b810-5e9253c4e389 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:43.766700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7db0ce-b72e-457a-b810-5e9253c4e389 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:43.766971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7db0ce-b72e-457a-b810-5e9253c4e389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:43.776645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7db0ce-b72e-457a-b810-5e9253c4e389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:43.778061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7db0ce-b72e-457a-b810-5e9253c4e389 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:43.795045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2a7db0ce-b72e-457a-b810-5e9253c4e389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:43.795045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:43.795045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:43.795045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:43.795045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:43.795045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:43.795045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:43.795045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:43.795045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:43.795045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:43.795045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:43.795045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:43.795045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:53:43.795045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:53:43.795045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:43.796128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:43.797370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:53:43.797370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:53:43.797370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:43.797370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:43.797370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 617/1256] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:43.802713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb805a22-b3bc-4e27-8d4e-3831050f19b8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:43.898962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb805a22-b3bc-4e27-8d4e-3831050f19b8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:43.933072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a023e3-5333-49bf-9284-16e5474448fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:43.933732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a023e3-5333-49bf-9284-16e5474448fd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:43.934020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a023e3-5333-49bf-9284-16e5474448fd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:43.934292 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a023e3-5333-49bf-9284-16e5474448fd None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:43.935012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a023e3-5333-49bf-9284-16e5474448fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:43.935347 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a023e3-5333-49bf-9284-16e5474448fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:43.936832 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a023e3-5333-49bf-9284-16e5474448fd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:43.948566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 640/1257] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:43.954147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7db0ce-b72e-457a-b810-5e9253c4e389 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:44.049952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7db0ce-b72e-457a-b810-5e9253c4e389 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:44.083314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185f612-2121-44a0-b935-408578688942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:44.084136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185f612-2121-44a0-b935-408578688942 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:44.084409 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185f612-2121-44a0-b935-408578688942 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:44.084695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185f612-2121-44a0-b935-408578688942 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:44.091045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185f612-2121-44a0-b935-408578688942 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:44.092487 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185f612-2121-44a0-b935-408578688942 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:44.106180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4185f612-2121-44a0-b935-408578688942 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:53:44.106180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:44.106180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:44.106180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:44.106180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:44.106180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:44.106180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:44.106180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:44.106180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:44.106180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:44.106180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:44.106180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:44.106180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:53:44.106180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:53:44.106180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:44.107140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:44.108055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:53:44.108055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:53:44.108055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:53:44.108055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:53:44.108055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:53:44.108055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:53:44.108055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:53:44.108055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:44.108055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 618/1258] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:53:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:44.114273 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a023e3-5333-49bf-9284-16e5474448fd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:44.211039 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a023e3-5333-49bf-9284-16e5474448fd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:44.244501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c136e2a-4a9a-4c8b-8d02-9ac6e47931b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:44.245145 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c136e2a-4a9a-4c8b-8d02-9ac6e47931b5 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:44.245424 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c136e2a-4a9a-4c8b-8d02-9ac6e47931b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:44.245697 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c136e2a-4a9a-4c8b-8d02-9ac6e47931b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:44.246542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c136e2a-4a9a-4c8b-8d02-9ac6e47931b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:44.246881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c136e2a-4a9a-4c8b-8d02-9ac6e47931b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:44.248347 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c136e2a-4a9a-4c8b-8d02-9ac6e47931b5 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:44.260141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 641/1259] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:53:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:44.266354 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185f612-2121-44a0-b935-408578688942 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:44.363580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185f612-2121-44a0-b935-408578688942 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:44.395377 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1588ea-b6b7-400b-a0c0-e46328a39ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:44.396018 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1588ea-b6b7-400b-a0c0-e46328a39ced None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:44.396302 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1588ea-b6b7-400b-a0c0-e46328a39ced None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:44.396575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1588ea-b6b7-400b-a0c0-e46328a39ced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:44.397395 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1588ea-b6b7-400b-a0c0-e46328a39ced None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=2cbd89f9b7a24b6cb993ca86e964c54d) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:44.397704 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1588ea-b6b7-400b-a0c0-e46328a39ced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:44.399137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1588ea-b6b7-400b-a0c0-e46328a39ced None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:44.404381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 619/1260] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:53:44 2022] GET /identity/v3/role_assignments?user.id=2cbd89f9b7a24b6cb993ca86e964c54d&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:46.595087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bfdff-c7f0-4715-884f-0df77fa39007 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:46.595701 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bfdff-c7f0-4715-884f-0df77fa39007 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:46.595701 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bfdff-c7f0-4715-884f-0df77fa39007 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:46.598122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 642/1261] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:53:46.603312 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edf6d3-37c5-42a7-99f4-63bd8eade06b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:46.603689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edf6d3-37c5-42a7-99f4-63bd8eade06b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:46.603884 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edf6d3-37c5-42a7-99f4-63bd8eade06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:46.620504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-08edf6d3-37c5-42a7-99f4-63bd8eade06b None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:53:46.621676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-08edf6d3-37c5-42a7-99f4-63bd8eade06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:53:46.686094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 620/1262] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:53:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:53:46.709977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bfdff-c7f0-4715-884f-0df77fa39007 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:46.807032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bfdff-c7f0-4715-884f-0df77fa39007 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:46.839542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f963cd-58ad-48c2-8f2f-3a62f67bd49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:46.840318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f963cd-58ad-48c2-8f2f-3a62f67bd49d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:46.840591 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f963cd-58ad-48c2-8f2f-3a62f67bd49d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:46.840859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f963cd-58ad-48c2-8f2f-3a62f67bd49d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:46.850592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f963cd-58ad-48c2-8f2f-3a62f67bd49d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-74f963cd-58ad-48c2-8f2f-3a62f67bd49d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:53:46.858173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:46.859289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:46.860333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:46.860333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:46.860333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:46.860333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:46.860333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:53:46.860333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:53:46.860333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:53:46.860333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:53:46.860333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:53:46.860333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:53:46.860333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:53:46.860333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:46.860333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 643/1263] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:53:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:46.865335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edf6d3-37c5-42a7-99f4-63bd8eade06b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:46.961873 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edf6d3-37c5-42a7-99f4-63bd8eade06b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:46.994041 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ed2c9-ed1b-4125-9151-830612df6251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:46.994701 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ed2c9-ed1b-4125-9151-830612df6251 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:46.994982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ed2c9-ed1b-4125-9151-830612df6251 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:46.995294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ed2c9-ed1b-4125-9151-830612df6251 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:46.996035 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ed2c9-ed1b-4125-9151-830612df6251 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:46.996342 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ed2c9-ed1b-4125-9151-830612df6251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:46.997689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ed2c9-ed1b-4125-9151-830612df6251 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:47.006361 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 621/1264] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:53:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:47.012313 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f963cd-58ad-48c2-8f2f-3a62f67bd49d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:47.107984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f963cd-58ad-48c2-8f2f-3a62f67bd49d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:47.141290 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ad9a0-8586-449e-9782-a21b56b0fc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:47.142065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ad9a0-8586-449e-9782-a21b56b0fc7c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:47.142343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ad9a0-8586-449e-9782-a21b56b0fc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:47.142609 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ad9a0-8586-449e-9782-a21b56b0fc7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:47.152934 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ad9a0-8586-449e-9782-a21b56b0fc7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:47.154354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ad9a0-8586-449e-9782-a21b56b0fc7c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:47.170996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-977ad9a0-8586-449e-9782-a21b56b0fc7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:47.170996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:47.170996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:47.170996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:47.170996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:47.170996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:47.170996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:47.170996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:47.170996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:47.170996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:47.170996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:47.170996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:47.170996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:53:47.170996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:53:47.170996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:47.172055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:47.173054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:53:47.173054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:53:47.173054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:47.173054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:47.173054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 644/1265] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:47.179155 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ed2c9-ed1b-4125-9151-830612df6251 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:47.275173 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ed2c9-ed1b-4125-9151-830612df6251 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:47.306856 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badd53d-0755-427a-a941-0bcf4ab76e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:47.307530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badd53d-0755-427a-a941-0bcf4ab76e46 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:47.307810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badd53d-0755-427a-a941-0bcf4ab76e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:47.308080 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badd53d-0755-427a-a941-0bcf4ab76e46 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:47.308789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badd53d-0755-427a-a941-0bcf4ab76e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:47.309088 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badd53d-0755-427a-a941-0bcf4ab76e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:47.310469 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badd53d-0755-427a-a941-0bcf4ab76e46 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:47.322391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 622/1266] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:47.328301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ad9a0-8586-449e-9782-a21b56b0fc7c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:47.426326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ad9a0-8586-449e-9782-a21b56b0fc7c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:47.458747 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c7052-00db-4beb-ae53-7ea836ea4910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:47.459563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c7052-00db-4beb-ae53-7ea836ea4910 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:47.459842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c7052-00db-4beb-ae53-7ea836ea4910 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:47.460111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c7052-00db-4beb-ae53-7ea836ea4910 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:47.467508 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c7052-00db-4beb-ae53-7ea836ea4910 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:47.468948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c7052-00db-4beb-ae53-7ea836ea4910 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-565c7052-00db-4beb-ae53-7ea836ea4910 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:53:47.483515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:47.484687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:47.485651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:47.485651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:47.485651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:53:47.485651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:53:47.485651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:53:47.485651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:53:47.485651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:53:47.485651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:53:47.485651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 21:53:47.485651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:47.485651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 645/1267] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:47.491455 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badd53d-0755-427a-a941-0bcf4ab76e46 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:47.586655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badd53d-0755-427a-a941-0bcf4ab76e46 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:47.619895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873327f-c9ad-44f5-8b05-ea6637888149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:47.620562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873327f-c9ad-44f5-8b05-ea6637888149 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:47.620843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873327f-c9ad-44f5-8b05-ea6637888149 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:47.621116 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873327f-c9ad-44f5-8b05-ea6637888149 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:47.621947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873327f-c9ad-44f5-8b05-ea6637888149 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:47.622248 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873327f-c9ad-44f5-8b05-ea6637888149 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:47.623706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873327f-c9ad-44f5-8b05-ea6637888149 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:47.641504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 623/1268] 10.222.0.24 () {56 vars in 1143 bytes} [Tue May 17 21:53:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:47.647355 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c7052-00db-4beb-ae53-7ea836ea4910 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:47.746570 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c7052-00db-4beb-ae53-7ea836ea4910 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:47.779050 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aca877-9253-4a75-8291-558c5d76f756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:47.779856 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aca877-9253-4a75-8291-558c5d76f756 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:47.780135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aca877-9253-4a75-8291-558c5d76f756 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:47.780407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aca877-9253-4a75-8291-558c5d76f756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:47.791319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aca877-9253-4a75-8291-558c5d76f756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:47.792753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aca877-9253-4a75-8291-558c5d76f756 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:47.809662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-67aca877-9253-4a75-8291-558c5d76f756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:47.809662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:47.809662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:47.809662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:47.809662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:47.809662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:47.809662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:47.809662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:47.809662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:47.809662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:47.809662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:47.809662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:47.809662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:53:47.809662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:53:47.809662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:47.810744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:47.811854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:53:47.811854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:53:47.811854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:47.811854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:47.811854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 646/1269] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:47.816660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873327f-c9ad-44f5-8b05-ea6637888149 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:47.914491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873327f-c9ad-44f5-8b05-ea6637888149 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:47.946796 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb590f-1d48-47ee-ac4b-40baabd86da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:47.949925 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb590f-1d48-47ee-ac4b-40baabd86da9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:47.949925 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb590f-1d48-47ee-ac4b-40baabd86da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:47.949925 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb590f-1d48-47ee-ac4b-40baabd86da9 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:47.949925 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb590f-1d48-47ee-ac4b-40baabd86da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:47.949925 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb590f-1d48-47ee-ac4b-40baabd86da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:47.950429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb590f-1d48-47ee-ac4b-40baabd86da9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:47.961813 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 624/1270] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:47.967442 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aca877-9253-4a75-8291-558c5d76f756 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:48.066165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aca877-9253-4a75-8291-558c5d76f756 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:48.097846 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17810c-0a4a-4414-b111-07964738d27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:48.098622 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17810c-0a4a-4414-b111-07964738d27c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:48.098899 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17810c-0a4a-4414-b111-07964738d27c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:48.099204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17810c-0a4a-4414-b111-07964738d27c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:48.105588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17810c-0a4a-4414-b111-07964738d27c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:48.107008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17810c-0a4a-4414-b111-07964738d27c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:48.121607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-6b17810c-0a4a-4414-b111-07964738d27c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:53:48.121607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:48.121607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:48.121607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:48.121607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:48.121607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:48.121607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:48.121607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:48.121607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:48.121607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:48.121607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:48.121607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:48.121607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:53:48.121607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:53:48.121607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:48.122615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:48.123576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:53:48.123576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:53:48.123576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:53:48.123576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:53:48.123576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:53:48.123576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:53:48.123576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:53:48.123576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:48.123576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 647/1271] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:53:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:48.129163 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb590f-1d48-47ee-ac4b-40baabd86da9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:48.226357 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb590f-1d48-47ee-ac4b-40baabd86da9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:48.259235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07112223-aee3-4714-ab1c-737be5169db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:48.259884 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07112223-aee3-4714-ab1c-737be5169db5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:48.260172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07112223-aee3-4714-ab1c-737be5169db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:48.260446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07112223-aee3-4714-ab1c-737be5169db5 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:48.261220 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07112223-aee3-4714-ab1c-737be5169db5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:48.261525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07112223-aee3-4714-ab1c-737be5169db5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:48.262954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07112223-aee3-4714-ab1c-737be5169db5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:48.274751 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 625/1272] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:53:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:48.280859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17810c-0a4a-4414-b111-07964738d27c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:48.378220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17810c-0a4a-4414-b111-07964738d27c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:48.410950 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996c495-7069-4605-9860-5e94a107c3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:48.411846 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996c495-7069-4605-9860-5e94a107c3d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:48.412145 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996c495-7069-4605-9860-5e94a107c3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:48.412410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996c495-7069-4605-9860-5e94a107c3d4 None admin] PATH_INFO: `/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/2cbd89f9b7a24b6cb993ca86e964c54d/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:48.414298 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996c495-7069-4605-9860-5e94a107c3d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e90e91d3094e67b09b2b8137f210f4, user_id=2cbd89f9b7a24b6cb993ca86e964c54d, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:48.415744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996c495-7069-4605-9860-5e94a107c3d4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:48.573231 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 648/1273] 10.222.0.24 () {58 vars in 1439 bytes} [Tue May 17 21:53:48 2022] PUT /identity/v3/projects/f6e90e91d3094e67b09b2b8137f210f4/users/2cbd89f9b7a24b6cb993ca86e964c54d/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 21:53:50.784399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00a4da-58cc-430e-8a2f-aedac6a7cf0a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:50.784991 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00a4da-58cc-430e-8a2f-aedac6a7cf0a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:50.784991 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00a4da-58cc-430e-8a2f-aedac6a7cf0a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:50.786318 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 626/1274] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:53:50.791828 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964a539-5059-4d48-b452-874a9db2fd45 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:50.792286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964a539-5059-4d48-b452-874a9db2fd45 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:50.792382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964a539-5059-4d48-b452-874a9db2fd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:50.809524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1964a539-5059-4d48-b452-874a9db2fd45 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:53:50.810688 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1964a539-5059-4d48-b452-874a9db2fd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:53:50.873956 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 649/1275] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:53:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:53:50.898091 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00a4da-58cc-430e-8a2f-aedac6a7cf0a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:50.999625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00a4da-58cc-430e-8a2f-aedac6a7cf0a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:51.033141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da354af-1c09-4e53-bd85-fa13e0f51642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:51.034128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da354af-1c09-4e53-bd85-fa13e0f51642 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:51.034477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da354af-1c09-4e53-bd85-fa13e0f51642 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:51.034685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da354af-1c09-4e53-bd85-fa13e0f51642 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:51.044236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da354af-1c09-4e53-bd85-fa13e0f51642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9da354af-1c09-4e53-bd85-fa13e0f51642 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 21:53:51.052673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:51.053851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:51.054953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:51.054953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:51.054953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:51.054953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:51.054953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 21:53:51.054953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 21:53:51.054953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 21:53:51.054953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 21:53:51.054953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 21:53:51.054953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 21:53:51.054953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 21:53:51.054953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:51.054953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 627/1276] 10.222.0.24 () {56 vars in 1096 bytes} [Tue May 17 21:53:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:51.059876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964a539-5059-4d48-b452-874a9db2fd45 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:51.154461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964a539-5059-4d48-b452-874a9db2fd45 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:51.188283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a71a5e-e481-46ff-9a01-1634d862d4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:51.188954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a71a5e-e481-46ff-9a01-1634d862d4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:51.189238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a71a5e-e481-46ff-9a01-1634d862d4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:51.189533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a71a5e-e481-46ff-9a01-1634d862d4a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:51.190314 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a71a5e-e481-46ff-9a01-1634d862d4a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:51.190616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a71a5e-e481-46ff-9a01-1634d862d4a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:51.192008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a71a5e-e481-46ff-9a01-1634d862d4a0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:51.200214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 650/1277] 10.222.0.24 () {56 vars in 1099 bytes} [Tue May 17 21:53:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:51.205842 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da354af-1c09-4e53-bd85-fa13e0f51642 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:51.303798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da354af-1c09-4e53-bd85-fa13e0f51642 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:51.335786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c896be8-bfc9-43f7-9aed-6b3f15e9eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:51.336570 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c896be8-bfc9-43f7-9aed-6b3f15e9eb8b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:51.336855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c896be8-bfc9-43f7-9aed-6b3f15e9eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:51.337133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c896be8-bfc9-43f7-9aed-6b3f15e9eb8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:51.347771 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c896be8-bfc9-43f7-9aed-6b3f15e9eb8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:51.349209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c896be8-bfc9-43f7-9aed-6b3f15e9eb8b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:51.366327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3c896be8-bfc9-43f7-9aed-6b3f15e9eb8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:51.366327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:51.366327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:51.366327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:51.366327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:51.366327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:51.366327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:51.366327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:51.366327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:51.366327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:51.366327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:51.366327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:51.366327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:53:51.366327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:53:51.366327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:51.367434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:51.368356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:53:51.368356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:53:51.368356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:51.368356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:51.368356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 628/1278] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:51.373291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a71a5e-e481-46ff-9a01-1634d862d4a0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:51.469238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a71a5e-e481-46ff-9a01-1634d862d4a0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:51.501995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63858adf-cae1-496f-be58-efa08d818205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:51.502641 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63858adf-cae1-496f-be58-efa08d818205 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:51.502917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63858adf-cae1-496f-be58-efa08d818205 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:51.503214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63858adf-cae1-496f-be58-efa08d818205 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:51.504172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63858adf-cae1-496f-be58-efa08d818205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:51.504472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63858adf-cae1-496f-be58-efa08d818205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:51.505820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63858adf-cae1-496f-be58-efa08d818205 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:51.517107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 651/1279] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:51.523437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c896be8-bfc9-43f7-9aed-6b3f15e9eb8b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:51.631177 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c896be8-bfc9-43f7-9aed-6b3f15e9eb8b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:51.664485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fb751-ec97-44e0-964a-256f4d44c665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:51.665291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fb751-ec97-44e0-964a-256f4d44c665 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:51.665575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fb751-ec97-44e0-964a-256f4d44c665 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:51.665851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fb751-ec97-44e0-964a-256f4d44c665 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:51.673182 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fb751-ec97-44e0-964a-256f4d44c665 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:51.674606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fb751-ec97-44e0-964a-256f4d44c665 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-548fb751-ec97-44e0-964a-256f4d44c665 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 21:53:51.689794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:51.691642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:51.692753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:51.692753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:51.692753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 21:53:51.692753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 21:53:51.692753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 21:53:51.692753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 21:53:51.692753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 21:53:51.692753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 21:53:51.692753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 21:53:51.692753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:51.692753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 629/1280] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:51.697596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63858adf-cae1-496f-be58-efa08d818205 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:51.793821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63858adf-cae1-496f-be58-efa08d818205 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:51.827315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e011a-dbe3-4f09-9e98-7b7be6eb8626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:51.827982 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e011a-dbe3-4f09-9e98-7b7be6eb8626 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:51.828262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e011a-dbe3-4f09-9e98-7b7be6eb8626 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:51.828532 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e011a-dbe3-4f09-9e98-7b7be6eb8626 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:51.829359 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e011a-dbe3-4f09-9e98-7b7be6eb8626 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:51.829662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e011a-dbe3-4f09-9e98-7b7be6eb8626 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:51.831156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e011a-dbe3-4f09-9e98-7b7be6eb8626 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:51.847935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 652/1281] 10.222.0.24 () {56 vars in 1143 bytes} [Tue May 17 21:53:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:51.853778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fb751-ec97-44e0-964a-256f4d44c665 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:51.962384 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fb751-ec97-44e0-964a-256f4d44c665 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:51.996296 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de244410-527f-4f36-bfc3-9a16c2c502d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:51.996936 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de244410-527f-4f36-bfc3-9a16c2c502d1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:51.997212 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de244410-527f-4f36-bfc3-9a16c2c502d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:51.997481 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de244410-527f-4f36-bfc3-9a16c2c502d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:52.061438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de244410-527f-4f36-bfc3-9a16c2c502d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:52.062878 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de244410-527f-4f36-bfc3-9a16c2c502d1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:52.155756 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 630/1282] 10.222.0.24 () {58 vars in 1282 bytes} [Tue May 17 21:53:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 21:53:52.161893 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e011a-dbe3-4f09-9e98-7b7be6eb8626 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:52.260950 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e011a-dbe3-4f09-9e98-7b7be6eb8626 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:52.294344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044c29c-bb4b-4402-a06d-7b9912f13149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:52.295144 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044c29c-bb4b-4402-a06d-7b9912f13149 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:52.295426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044c29c-bb4b-4402-a06d-7b9912f13149 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:52.295696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044c29c-bb4b-4402-a06d-7b9912f13149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:52.305658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044c29c-bb4b-4402-a06d-7b9912f13149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:52.307943 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044c29c-bb4b-4402-a06d-7b9912f13149 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:52.324225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-0044c29c-bb4b-4402-a06d-7b9912f13149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:52.324225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:52.324225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:52.324225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:52.324225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:52.324225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:52.324225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:52.324225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:52.324225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:52.324225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:52.324225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:52.324225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:52.324225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 21:53:52.324225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 21:53:52.324225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:52.325271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:52.326344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 21:53:52.326344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 21:53:52.326344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 21:53:52.326344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:52.326344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 653/1283] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 21:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:53:52.331245 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de244410-527f-4f36-bfc3-9a16c2c502d1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:52.426257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de244410-527f-4f36-bfc3-9a16c2c502d1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:52.458933 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890288b-d51b-44e0-b542-e693e3b311b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:52.459606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890288b-d51b-44e0-b542-e693e3b311b1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:52.459894 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890288b-d51b-44e0-b542-e693e3b311b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:52.460164 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890288b-d51b-44e0-b542-e693e3b311b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:52.460875 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890288b-d51b-44e0-b542-e693e3b311b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:52.461175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890288b-d51b-44e0-b542-e693e3b311b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:52.462525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890288b-d51b-44e0-b542-e693e3b311b1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:52.474125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 631/1284] 10.222.0.24 () {56 vars in 1109 bytes} [Tue May 17 21:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:52.479889 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044c29c-bb4b-4402-a06d-7b9912f13149 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:52.576945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044c29c-bb4b-4402-a06d-7b9912f13149 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:52.610412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a370c3-eb7d-4288-8301-6f36f142318b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:52.611223 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a370c3-eb7d-4288-8301-6f36f142318b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:52.611502 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a370c3-eb7d-4288-8301-6f36f142318b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:52.611819 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a370c3-eb7d-4288-8301-6f36f142318b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:52.618500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a370c3-eb7d-4288-8301-6f36f142318b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:52.620017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a370c3-eb7d-4288-8301-6f36f142318b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:52.634592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-72a370c3-eb7d-4288-8301-6f36f142318b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:53:52.634592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:52.634592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:52.634592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:52.634592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:52.634592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:52.634592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:52.634592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:52.634592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:52.634592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:52.634592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:52.634592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:52.634592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 21:53:52.634592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 21:53:52.634592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:52.636053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:52.637102 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 21:53:52.637102 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 21:53:52.637102 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 21:53:52.637102 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 21:53:52.637102 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 21:53:52.637102 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 21:53:52.637102 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 21:53:52.637102 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: ERROR keystone.server.flask.application May 17 21:53:52.637102 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 654/1285] 10.222.0.24 () {56 vars in 1111 bytes} [Tue May 17 21:53:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:52.641855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890288b-d51b-44e0-b542-e693e3b311b1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:52.738564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890288b-d51b-44e0-b542-e693e3b311b1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:52.769925 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f4426-6751-4bf6-b8e5-d71754312f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:52.770568 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f4426-6751-4bf6-b8e5-d71754312f2d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:52.770845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f4426-6751-4bf6-b8e5-d71754312f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:52.771137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f4426-6751-4bf6-b8e5-d71754312f2d None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:52.771914 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f4426-6751-4bf6-b8e5-d71754312f2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:52.772215 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f4426-6751-4bf6-b8e5-d71754312f2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:52.773626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f4426-6751-4bf6-b8e5-d71754312f2d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:52.785668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 632/1286] 10.222.0.24 () {56 vars in 1148 bytes} [Tue May 17 21:53:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:52.791594 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a370c3-eb7d-4288-8301-6f36f142318b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:52.891338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a370c3-eb7d-4288-8301-6f36f142318b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:52.924470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f4132-4e1d-4e53-b147-61e86b9a72d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:52.925115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f4132-4e1d-4e53-b147-61e86b9a72d5 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:52.926032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f4132-4e1d-4e53-b147-61e86b9a72d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:52.926258 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f4132-4e1d-4e53-b147-61e86b9a72d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:52.927362 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f4132-4e1d-4e53-b147-61e86b9a72d5 None admin] RBAC: Adding query filter params (role.id=5720267cdd3d4ef4aafc2b2a1d067a2e, scope.project.id=f6e90e91d3094e67b09b2b8137f210f4, user.id=2cbd89f9b7a24b6cb993ca86e964c54d) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:52.927671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f4132-4e1d-4e53-b147-61e86b9a72d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:52.929095 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f4132-4e1d-4e53-b147-61e86b9a72d5 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:52.934897 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 655/1287] 10.222.0.24 () {56 vars in 1374 bytes} [Tue May 17 21:53:52 2022] GET /identity/v3/role_assignments?user.id=2cbd89f9b7a24b6cb993ca86e964c54d&scope.project.id=f6e90e91d3094e67b09b2b8137f210f4&role.id=5720267cdd3d4ef4aafc2b2a1d067a2e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:55.195403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2668d0d-8981-42c0-81d0-dab631bf1c3c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:55.195956 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2668d0d-8981-42c0-81d0-dab631bf1c3c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:55.195956 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2668d0d-8981-42c0-81d0-dab631bf1c3c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:55.197291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 633/1288] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:53:55.203241 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10324334-fd4f-4829-950d-9fb92261a07e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:55.203852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10324334-fd4f-4829-950d-9fb92261a07e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:55.203852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10324334-fd4f-4829-950d-9fb92261a07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:55.222375 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-10324334-fd4f-4829-950d-9fb92261a07e None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:53:55.223593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-10324334-fd4f-4829-950d-9fb92261a07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:53:55.293722 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 656/1289] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:53:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:53:55.316202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2668d0d-8981-42c0-81d0-dab631bf1c3c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:55.417546 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2668d0d-8981-42c0-81d0-dab631bf1c3c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:55.452405 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3b2a4-37e8-47b8-a304-e61f83ce739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:55.453126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3b2a4-37e8-47b8-a304-e61f83ce739c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:55.453405 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3b2a4-37e8-47b8-a304-e61f83ce739c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:55.453675 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3b2a4-37e8-47b8-a304-e61f83ce739c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:55.454314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3b2a4-37e8-47b8-a304-e61f83ce739c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:55.455690 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3b2a4-37e8-47b8-a304-e61f83ce739c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-35e3b2a4-37e8-47b8-a304-e61f83ce739c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:53:55.467092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:53:55.468364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:53:55.469422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:53:55.469422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:53:55.469422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:53:55.469422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:53:55.469422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:53:55.469422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:53:55.469422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:53:55.469422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:53:55.469422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:53:55.469422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:53:55.469422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:53:55.469422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:53:55.469422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 21:53:55.469422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:53:55.469422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 634/1290] 10.222.0.24 () {56 vars in 1117 bytes} [Tue May 17 21:53:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:53:55.474475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10324334-fd4f-4829-950d-9fb92261a07e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:55.569171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10324334-fd4f-4829-950d-9fb92261a07e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:55.600988 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdffbdf-bb2d-48f9-a15f-9c943af161a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:55.601634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdffbdf-bb2d-48f9-a15f-9c943af161a1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:55.601921 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdffbdf-bb2d-48f9-a15f-9c943af161a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:55.602193 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdffbdf-bb2d-48f9-a15f-9c943af161a1 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:55.602887 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdffbdf-bb2d-48f9-a15f-9c943af161a1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:55.603217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdffbdf-bb2d-48f9-a15f-9c943af161a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:55.604578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdffbdf-bb2d-48f9-a15f-9c943af161a1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:55.609243 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 657/1291] 10.222.0.24 () {56 vars in 1116 bytes} [Tue May 17 21:53:55 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:55.615424 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3b2a4-37e8-47b8-a304-e61f83ce739c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:55.712891 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3b2a4-37e8-47b8-a304-e61f83ce739c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:55.745587 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1526f6c-213a-480d-89cd-65df026df1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:55.746235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1526f6c-213a-480d-89cd-65df026df1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:55.746518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1526f6c-213a-480d-89cd-65df026df1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:55.746795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1526f6c-213a-480d-89cd-65df026df1c5 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:55.747523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1526f6c-213a-480d-89cd-65df026df1c5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:53:55.747829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1526f6c-213a-480d-89cd-65df026df1c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:55.749279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1526f6c-213a-480d-89cd-65df026df1c5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:55.753530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 635/1292] 10.222.0.24 () {56 vars in 1116 bytes} [Tue May 17 21:53:55 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:53:57.949908 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abdfdf-a9dc-42be-ba3d-93036adb299a None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:57.950449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abdfdf-a9dc-42be-ba3d-93036adb299a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:57.950449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abdfdf-a9dc-42be-ba3d-93036adb299a None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:57.952045 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 658/1293] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:53:57.957728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bdb4d-d996-4ccc-b311-6cc32f875fbc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:57.958420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bdb4d-d996-4ccc-b311-6cc32f875fbc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:57.958420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bdb4d-d996-4ccc-b311-6cc32f875fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:57.974602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-092bdb4d-d996-4ccc-b311-6cc32f875fbc None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:53:57.975800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-092bdb4d-d996-4ccc-b311-6cc32f875fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:53:58.039664 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 636/1294] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:53:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:53:58.062385 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abdfdf-a9dc-42be-ba3d-93036adb299a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:53:58.161360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abdfdf-a9dc-42be-ba3d-93036adb299a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:53:58.194384 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2ba54-4d46-41c0-9795-54a6aab18d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:53:58.195122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2ba54-4d46-41c0-9795-54a6aab18d38 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:53:58.195414 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2ba54-4d46-41c0-9795-54a6aab18d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:53:58.195688 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2ba54-4d46-41c0-9795-54a6aab18d38 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:53:58.196399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2ba54-4d46-41c0-9795-54a6aab18d38 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:53:58.197748 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2ba54-4d46-41c0-9795-54a6aab18d38 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:53:58.293460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 659/1295] 10.222.0.24 () {60 vars in 1141 bytes} [Tue May 17 21:53:58 2022] POST /identity/v3/services => generated 246 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 21:54:00.570278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7b305-9bf8-45bb-bd72-0b95f140e4cb None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:54:00.570830 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7b305-9bf8-45bb-bd72-0b95f140e4cb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:54:00.570830 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7b305-9bf8-45bb-bd72-0b95f140e4cb None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:54:00.572257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 637/1296] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:54:00.577526 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63499b52-046c-4300-94ea-3fa5e5cf8f56 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:54:00.577929 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63499b52-046c-4300-94ea-3fa5e5cf8f56 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:54:00.578081 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63499b52-046c-4300-94ea-3fa5e5cf8f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:54:00.594883 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-63499b52-046c-4300-94ea-3fa5e5cf8f56 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:54:00.596071 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-63499b52-046c-4300-94ea-3fa5e5cf8f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:54:00.668171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 660/1297] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:54:00 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 21:54:00.692479 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7b305-9bf8-45bb-bd72-0b95f140e4cb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:54:00.789325 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7b305-9bf8-45bb-bd72-0b95f140e4cb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:54:00.822973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9ada7-41eb-4d65-9b09-e3f37378bacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:54:00.823718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9ada7-41eb-4d65-9b09-e3f37378bacf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:54:00.824004 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9ada7-41eb-4d65-9b09-e3f37378bacf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:54:00.824282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9ada7-41eb-4d65-9b09-e3f37378bacf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:54:00.824927 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9ada7-41eb-4d65-9b09-e3f37378bacf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:54:00.826277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9ada7-41eb-4d65-9b09-e3f37378bacf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-29b9ada7-41eb-4d65-9b09-e3f37378bacf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:54:00.838387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:54:00.839575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:54:00.840984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:54:00.840984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:54:00.840984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:54:00.840984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:54:00.840984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:54:00.840984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:54:00.840984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:54:00.840984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:54:00.840984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:54:00.840984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:54:00.840984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:54:00.840984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:54:00.840984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 21:54:00.840984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:54:00.840984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 638/1298] 10.222.0.24 () {56 vars in 1117 bytes} [Tue May 17 21:54:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 21:54:00.845642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63499b52-046c-4300-94ea-3fa5e5cf8f56 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:54:00.942556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63499b52-046c-4300-94ea-3fa5e5cf8f56 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:54:00.974876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b0f7-53f9-49f2-86ad-afda7a58fd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:54:00.975559 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b0f7-53f9-49f2-86ad-afda7a58fd64 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:54:00.975839 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b0f7-53f9-49f2-86ad-afda7a58fd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:54:00.976111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b0f7-53f9-49f2-86ad-afda7a58fd64 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:54:00.976860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428b0f7-53f9-49f2-86ad-afda7a58fd64 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:54:00.977130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428b0f7-53f9-49f2-86ad-afda7a58fd64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:54:00.978493 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428b0f7-53f9-49f2-86ad-afda7a58fd64 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:54:00.983419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 661/1299] 10.222.0.24 () {56 vars in 1116 bytes} [Tue May 17 21:54:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:54:00.989643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9ada7-41eb-4d65-9b09-e3f37378bacf None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:54:01.091962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9ada7-41eb-4d65-9b09-e3f37378bacf None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:54:01.122838 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16b1f2-c59c-4dc2-a5f4-3d02d3d6c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:54:01.123509 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16b1f2-c59c-4dc2-a5f4-3d02d3d6c95d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:54:01.123791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16b1f2-c59c-4dc2-a5f4-3d02d3d6c95d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:54:01.124063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16b1f2-c59c-4dc2-a5f4-3d02d3d6c95d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:54:01.124841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16b1f2-c59c-4dc2-a5f4-3d02d3d6c95d None admin] RBAC: Adding query filter params (interface=public, service_id=bb7b9c8265174c3881a0d595c6e65d0a, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:54:01.125149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16b1f2-c59c-4dc2-a5f4-3d02d3d6c95d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:54:01.126499 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16b1f2-c59c-4dc2-a5f4-3d02d3d6c95d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:54:01.132027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 639/1300] 10.222.0.24 () {56 vars in 1251 bytes} [Tue May 17 21:54:00 2022] GET /identity/v3/endpoints?service_id=bb7b9c8265174c3881a0d595c6e65d0a&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:54:01.137600 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b0f7-53f9-49f2-86ad-afda7a58fd64 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:54:01.233185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b0f7-53f9-49f2-86ad-afda7a58fd64 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:54:01.266121 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f814f-c730-4cc7-82e6-a95736071634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:54:01.266776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f814f-c730-4cc7-82e6-a95736071634 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:54:01.267052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f814f-c730-4cc7-82e6-a95736071634 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:54:01.267351 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f814f-c730-4cc7-82e6-a95736071634 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:54:01.268022 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f814f-c730-4cc7-82e6-a95736071634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:54:01.269464 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f814f-c730-4cc7-82e6-a95736071634 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:54:01.276107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 662/1301] 10.222.0.24 () {56 vars in 1087 bytes} [Tue May 17 21:54:01 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 21:54:03.647827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404689d-8fae-4f62-a699-299f13289cb8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:54:03.648381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404689d-8fae-4f62-a699-299f13289cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:54:03.648381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404689d-8fae-4f62-a699-299f13289cb8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:54:03.649784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 640/1302] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 21:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 21:54:03.655066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a7918-7abb-4f7d-94ac-700703637f02 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:54:03.655517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a7918-7abb-4f7d-94ac-700703637f02 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:54:03.655650 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a7918-7abb-4f7d-94ac-700703637f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:54:03.672477 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4a6a7918-7abb-4f7d-94ac-700703637f02 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 21:54:03.673690 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4a6a7918-7abb-4f7d-94ac-700703637f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 21:54:03.736829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 663/1303] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 21:54:03 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 21:54:03.760217 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404689d-8fae-4f62-a699-299f13289cb8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:54:03.858111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404689d-8fae-4f62-a699-299f13289cb8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:54:03.890292 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb0605-79aa-486b-b876-a7b313e44252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:54:03.891095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb0605-79aa-486b-b876-a7b313e44252 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:54:03.891406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb0605-79aa-486b-b876-a7b313e44252 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:54:03.891681 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb0605-79aa-486b-b876-a7b313e44252 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:54:03.892781 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb0605-79aa-486b-b876-a7b313e44252 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:54:03.894270 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb0605-79aa-486b-b876-a7b313e44252 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-48cb0605-79aa-486b-b876-a7b313e44252 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 21:54:03.906295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 21:54:03.907490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( May 17 21:54:03.908552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 21:54:03.908552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( May 17 21:54:03.908552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 21:54:03.908552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() May 17 21:54:03.908552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 21:54:03.908552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 21:54:03.908552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 21:54:03.908552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() May 17 21:54:03.908552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 21:54:03.908552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( May 17 21:54:03.908552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 21:54:03.908552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 21:54:03.908552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 21:54:03.908552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: ERROR keystone.server.flask.application May 17 21:54:03.908552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 641/1304] 10.222.0.24 () {56 vars in 1117 bytes} [Tue May 17 21:54:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 21:54:03.913616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a7918-7abb-4f7d-94ac-700703637f02 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:54:04.007457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a7918-7abb-4f7d-94ac-700703637f02 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:54:04.039792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5b90c-2002-4455-80bc-2d9ef1d3d3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:54:04.040442 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5b90c-2002-4455-80bc-2d9ef1d3d3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:54:04.040719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5b90c-2002-4455-80bc-2d9ef1d3d3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:54:04.040986 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5b90c-2002-4455-80bc-2d9ef1d3d3e9 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:54:04.041676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5b90c-2002-4455-80bc-2d9ef1d3d3e9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 21:54:04.041973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5b90c-2002-4455-80bc-2d9ef1d3d3e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:54:04.043347 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5b90c-2002-4455-80bc-2d9ef1d3d3e9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:54:04.048305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 664/1305] 10.222.0.24 () {56 vars in 1116 bytes} [Tue May 17 21:54:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 21:54:04.054632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb0605-79aa-486b-b876-a7b313e44252 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 21:54:04.152324 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb0605-79aa-486b-b876-a7b313e44252 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 21:54:04.183951 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36381ff8-66ae-481e-82fb-56644930ebf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 21:54:04.184527 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36381ff8-66ae-481e-82fb-56644930ebf7 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 21:54:04.184804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36381ff8-66ae-481e-82fb-56644930ebf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 21:54:04.185075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36381ff8-66ae-481e-82fb-56644930ebf7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 21:54:04.185796 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36381ff8-66ae-481e-82fb-56644930ebf7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 21:54:04.187365 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36381ff8-66ae-481e-82fb-56644930ebf7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 21:54:04.250119 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 642/1306] 10.222.0.24 () {60 vars in 1144 bytes} [Tue May 17 21:54:04 2022] POST /identity/v3/endpoints => generated 331 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:00:04.482097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995b01d-c64e-4236-b4d6-d3c9c3551ba1 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:04.482676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995b01d-c64e-4236-b4d6-d3c9c3551ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:04.482676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995b01d-c64e-4236-b4d6-d3c9c3551ba1 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:04.484293 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 665/1307] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:04.489652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179c110-ac3e-488f-87f4-5885ccbcc97a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:04.490534 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179c110-ac3e-488f-87f4-5885ccbcc97a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:04.491020 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179c110-ac3e-488f-87f4-5885ccbcc97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:04.637982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5179c110-ac3e-488f-87f4-5885ccbcc97a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:04.639481 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5179c110-ac3e-488f-87f4-5885ccbcc97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:04.787250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 643/1308] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:04.819552 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11782e29-fbed-44c4-adad-1bcb2216fbfa None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:04.819789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11782e29-fbed-44c4-adad-1bcb2216fbfa None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:04.820064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11782e29-fbed-44c4-adad-1bcb2216fbfa None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:04.821692 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 666/1309] 10.222.0.24 () {54 vars in 964 bytes} [Tue May 17 22:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:04.832718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d79ea-d9c2-4d75-9bcd-e840abb83d73 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:04.833018 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d79ea-d9c2-4d75-9bcd-e840abb83d73 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:04.833304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d79ea-d9c2-4d75-9bcd-e840abb83d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:04.918682 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a36d79ea-d9c2-4d75-9bcd-e840abb83d73 None None] MFA Rules not processed for user `c084b56d682c44119654743809109bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:04.919986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a36d79ea-d9c2-4d75-9bcd-e840abb83d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:04.999302 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 644/1310] 10.222.0.24 () {58 vars in 1061 bytes} [Tue May 17 22:00:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:05.009636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11782e29-fbed-44c4-adad-1bcb2216fbfa None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:00:05.011450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-11782e29-fbed-44c4-adad-1bcb2216fbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:05.118839 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11782e29-fbed-44c4-adad-1bcb2216fbfa None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:00:05.197927 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1aa0f-a781-4906-9013-ee14ce51b250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:00:05.198582 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1aa0f-a781-4906-9013-ee14ce51b250 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:05.198864 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1aa0f-a781-4906-9013-ee14ce51b250 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:05.199318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1aa0f-a781-4906-9013-ee14ce51b250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:05.200958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f9a1aa0f-a781-4906-9013-ee14ce51b250 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:05.312461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1aa0f-a781-4906-9013-ee14ce51b250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:00:05.314011 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1aa0f-a781-4906-9013-ee14ce51b250 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:00:05.333208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 667/1311] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:00:07.848504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde79f7-cfeb-4762-9f82-3393a7424b55 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:07.849036 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde79f7-cfeb-4762-9f82-3393a7424b55 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:07.849036 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde79f7-cfeb-4762-9f82-3393a7424b55 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:07.850428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 645/1312] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:07.855789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fbe8b-73c1-421a-a0bd-9ffb507acf68 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:07.856213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fbe8b-73c1-421a-a0bd-9ffb507acf68 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:07.856469 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fbe8b-73c1-421a-a0bd-9ffb507acf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:07.925939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a51fbe8b-73c1-421a-a0bd-9ffb507acf68 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:07.927140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a51fbe8b-73c1-421a-a0bd-9ffb507acf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:08.020308 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 668/1313] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:08.059092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde79f7-cfeb-4762-9f82-3393a7424b55 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:00:08.060717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2cde79f7-cfeb-4762-9f82-3393a7424b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:08.170561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde79f7-cfeb-4762-9f82-3393a7424b55 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:00:08.255258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787df0f-3189-43b4-8c4c-dbccf94fb7a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:00:08.255927 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787df0f-3189-43b4-8c4c-dbccf94fb7a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:08.256228 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787df0f-3189-43b4-8c4c-dbccf94fb7a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:08.256505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787df0f-3189-43b4-8c4c-dbccf94fb7a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:08.258245 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9787df0f-3189-43b4-8c4c-dbccf94fb7a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:08.382231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787df0f-3189-43b4-8c4c-dbccf94fb7a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:00:08.383787 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787df0f-3189-43b4-8c4c-dbccf94fb7a3 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:00:08.404752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 646/1314] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:00:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:00:11.206524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84917e0d-6428-46f9-a6cd-19bbcf6a8586 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:11.206524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84917e0d-6428-46f9-a6cd-19bbcf6a8586 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:11.207528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84917e0d-6428-46f9-a6cd-19bbcf6a8586 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:11.208392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 669/1315] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:11.213773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a6f5e-f5f1-42c5-a255-ddb4f82031b7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:11.214181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a6f5e-f5f1-42c5-a255-ddb4f82031b7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:11.214328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a6f5e-f5f1-42c5-a255-ddb4f82031b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:11.278400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e82a6f5e-f5f1-42c5-a255-ddb4f82031b7 None None] MFA Rules not processed for user `904d6d2dd6e34c9bac78d58a88116330`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:11.279631 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e82a6f5e-f5f1-42c5-a255-ddb4f82031b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:11.374134 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 647/1316] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:00:11 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:11.413809 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84917e0d-6428-46f9-a6cd-19bbcf6a8586 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:00:11.415417 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-84917e0d-6428-46f9-a6cd-19bbcf6a8586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:11.516891 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84917e0d-6428-46f9-a6cd-19bbcf6a8586 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:00:11.589298 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413ed7f-ab1c-41ca-ab10-d2cb9d1f8529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:00:11.589944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413ed7f-ab1c-41ca-ab10-d2cb9d1f8529 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:11.590223 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413ed7f-ab1c-41ca-ab10-d2cb9d1f8529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:11.590496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413ed7f-ab1c-41ca-ab10-d2cb9d1f8529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:11.592165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7413ed7f-ab1c-41ca-ab10-d2cb9d1f8529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:11.705363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413ed7f-ab1c-41ca-ab10-d2cb9d1f8529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:00:11.707417 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413ed7f-ab1c-41ca-ab10-d2cb9d1f8529 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:00:11.727853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 670/1317] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:00:11 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:00:14.794569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981af60d-dfc6-4476-968c-3f22c53eac17 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:14.795087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981af60d-dfc6-4476-968c-3f22c53eac17 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:14.795202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981af60d-dfc6-4476-968c-3f22c53eac17 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:14.796515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 648/1318] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:14.801909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375762b-c9b4-48a1-980e-26b4f35dea79 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:14.802312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375762b-c9b4-48a1-980e-26b4f35dea79 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:14.802463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375762b-c9b4-48a1-980e-26b4f35dea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:14.865573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a375762b-c9b4-48a1-980e-26b4f35dea79 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:14.866756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a375762b-c9b4-48a1-980e-26b4f35dea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:14.959587 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 671/1319] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:00:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:15.003046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981af60d-dfc6-4476-968c-3f22c53eac17 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:00:15.004646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-981af60d-dfc6-4476-968c-3f22c53eac17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:15.115206 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981af60d-dfc6-4476-968c-3f22c53eac17 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:00:15.185386 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8162400-2af8-42e9-bc59-0677271d680d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:00:15.185970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8162400-2af8-42e9-bc59-0677271d680d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:15.186251 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8162400-2af8-42e9-bc59-0677271d680d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:15.186529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8162400-2af8-42e9-bc59-0677271d680d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:15.188193 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b8162400-2af8-42e9-bc59-0677271d680d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:15.292051 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8162400-2af8-42e9-bc59-0677271d680d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:00:15.293466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8162400-2af8-42e9-bc59-0677271d680d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:00:15.312503 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 649/1320] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:00:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:00:18.526136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89536bd-e988-4d29-802b-a74f01a85ae6 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:18.526673 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89536bd-e988-4d29-802b-a74f01a85ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:18.526673 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89536bd-e988-4d29-802b-a74f01a85ae6 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:18.528083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 672/1321] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:18.533371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6214-dd09-4df7-8dbf-c646085f241d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:18.533812 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6214-dd09-4df7-8dbf-c646085f241d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:18.534076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6214-dd09-4df7-8dbf-c646085f241d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:18.596432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-738e6214-dd09-4df7-8dbf-c646085f241d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:18.597620 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-738e6214-dd09-4df7-8dbf-c646085f241d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:18.689215 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 650/1322] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:18.725886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89536bd-e988-4d29-802b-a74f01a85ae6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:00:18.728340 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f89536bd-e988-4d29-802b-a74f01a85ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:18.833005 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89536bd-e988-4d29-802b-a74f01a85ae6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:00:18.905292 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e089fec-176f-465f-af5c-9d503942a7d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:00:18.905976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e089fec-176f-465f-af5c-9d503942a7d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:18.906258 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e089fec-176f-465f-af5c-9d503942a7d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:18.906536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e089fec-176f-465f-af5c-9d503942a7d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:18.908235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9e089fec-176f-465f-af5c-9d503942a7d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:19.017106 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e089fec-176f-465f-af5c-9d503942a7d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:00:19.019327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e089fec-176f-465f-af5c-9d503942a7d1 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:00:19.037464 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 673/1323] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:00:21.339696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd114b-db79-44f0-864c-d807127dea6f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:21.340238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd114b-db79-44f0-864c-d807127dea6f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:21.340238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd114b-db79-44f0-864c-d807127dea6f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:21.341637 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 651/1324] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:21.347754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4acd76-08b7-4bee-a4cf-d85043dd80fc None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:21.348606 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4acd76-08b7-4bee-a4cf-d85043dd80fc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:21.348886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4acd76-08b7-4bee-a4cf-d85043dd80fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:21.417983 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7b4acd76-08b7-4bee-a4cf-d85043dd80fc None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:21.419231 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7b4acd76-08b7-4bee-a4cf-d85043dd80fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:21.515344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 674/1325] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:21.552005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd114b-db79-44f0-864c-d807127dea6f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:00:21.553642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ffdd114b-db79-44f0-864c-d807127dea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:21.655048 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd114b-db79-44f0-864c-d807127dea6f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:00:21.727766 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14fd08-1cef-4655-9e41-f6a1eabf830e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:00:21.728414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14fd08-1cef-4655-9e41-f6a1eabf830e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:21.728694 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14fd08-1cef-4655-9e41-f6a1eabf830e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:21.728970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14fd08-1cef-4655-9e41-f6a1eabf830e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:21.730592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6c14fd08-1cef-4655-9e41-f6a1eabf830e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:21.834789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14fd08-1cef-4655-9e41-f6a1eabf830e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:00:21.836248 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14fd08-1cef-4655-9e41-f6a1eabf830e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:00:21.853969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 652/1326] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:00:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:00:24.125497 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9670b-6a8a-4b6e-9503-6cf2e4c67fa5 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:24.126075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9670b-6a8a-4b6e-9503-6cf2e4c67fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:24.126075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9670b-6a8a-4b6e-9503-6cf2e4c67fa5 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:24.127495 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 675/1327] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:24.132667 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e6ea4-748d-494c-a574-76826cc58308 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:24.133098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e6ea4-748d-494c-a574-76826cc58308 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:24.133234 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e6ea4-748d-494c-a574-76826cc58308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:24.201824 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d19e6ea4-748d-494c-a574-76826cc58308 None None] MFA Rules not processed for user `904d6d2dd6e34c9bac78d58a88116330`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:24.202930 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d19e6ea4-748d-494c-a574-76826cc58308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:24.298547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 653/1328] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:00:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:24.336753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9670b-6a8a-4b6e-9503-6cf2e4c67fa5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:00:24.338358 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-73f9670b-6a8a-4b6e-9503-6cf2e4c67fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:24.439319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9670b-6a8a-4b6e-9503-6cf2e4c67fa5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:00:24.512178 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa108d9b-a7a9-4c66-babf-80a38f128554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:00:24.512756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa108d9b-a7a9-4c66-babf-80a38f128554 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:24.513033 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa108d9b-a7a9-4c66-babf-80a38f128554 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:24.513305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa108d9b-a7a9-4c66-babf-80a38f128554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:24.515022 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fa108d9b-a7a9-4c66-babf-80a38f128554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:24.624044 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa108d9b-a7a9-4c66-babf-80a38f128554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:00:24.625524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa108d9b-a7a9-4c66-babf-80a38f128554 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:00:24.644473 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 676/1329] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:00:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:00:27.284797 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32316faa-1c0e-4878-9538-787af1fb27e0 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:27.285349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32316faa-1c0e-4878-9538-787af1fb27e0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:27.285349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32316faa-1c0e-4878-9538-787af1fb27e0 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:27.286715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 654/1330] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:27.292210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd1b09-9595-4399-9d9e-11711733c142 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:27.292723 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd1b09-9595-4399-9d9e-11711733c142 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:27.292814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd1b09-9595-4399-9d9e-11711733c142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:27.358640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-75bd1b09-9595-4399-9d9e-11711733c142 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:27.359917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-75bd1b09-9595-4399-9d9e-11711733c142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:27.459398 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 677/1331] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:27.495802 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32316faa-1c0e-4878-9538-787af1fb27e0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:00:27.497303 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-32316faa-1c0e-4878-9538-787af1fb27e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:27.601953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32316faa-1c0e-4878-9538-787af1fb27e0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:00:27.673309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be3167-c060-4090-8c79-930e3c79c517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:00:27.674488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be3167-c060-4090-8c79-930e3c79c517 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:27.674781 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be3167-c060-4090-8c79-930e3c79c517 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:27.675058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be3167-c060-4090-8c79-930e3c79c517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:27.676730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e5be3167-c060-4090-8c79-930e3c79c517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:27.785385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be3167-c060-4090-8c79-930e3c79c517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:00:27.786854 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be3167-c060-4090-8c79-930e3c79c517 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:00:27.805300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 655/1332] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:00:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:00:30.125948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce39456-4217-47fc-be72-fbd0ff1b2240 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:30.126532 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce39456-4217-47fc-be72-fbd0ff1b2240 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:30.126532 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce39456-4217-47fc-be72-fbd0ff1b2240 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:30.128363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 678/1333] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:00:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:30.133689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8730f-dc2d-4d60-b0a6-3bc36a665f8e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:30.134087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8730f-dc2d-4d60-b0a6-3bc36a665f8e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:30.134318 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8730f-dc2d-4d60-b0a6-3bc36a665f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:30.197071 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1ff8730f-dc2d-4d60-b0a6-3bc36a665f8e None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:30.198188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1ff8730f-dc2d-4d60-b0a6-3bc36a665f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:30.297972 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 656/1334] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:30.341604 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce39456-4217-47fc-be72-fbd0ff1b2240 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:00:30.343146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2ce39456-4217-47fc-be72-fbd0ff1b2240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:30.446609 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce39456-4217-47fc-be72-fbd0ff1b2240 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:00:30.519996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354ca2e-7392-4bc9-b28e-b5817d26b000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:00:30.520649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354ca2e-7392-4bc9-b28e-b5817d26b000 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:30.520927 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354ca2e-7392-4bc9-b28e-b5817d26b000 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:30.521198 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354ca2e-7392-4bc9-b28e-b5817d26b000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:30.522824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0354ca2e-7392-4bc9-b28e-b5817d26b000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:30.630398 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354ca2e-7392-4bc9-b28e-b5817d26b000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:00:30.631876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354ca2e-7392-4bc9-b28e-b5817d26b000 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:00:30.650111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 679/1335] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:00:33.584524 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15929a-a893-48af-8e3a-2f0a57728faa None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:33.585063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15929a-a893-48af-8e3a-2f0a57728faa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:33.585063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15929a-a893-48af-8e3a-2f0a57728faa None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:33.586485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 657/1336] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:33.591738 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939e6a1-01b0-4011-a47d-4d1bb3cefbf4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:33.592114 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939e6a1-01b0-4011-a47d-4d1bb3cefbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:33.592289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939e6a1-01b0-4011-a47d-4d1bb3cefbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:33.655656 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2939e6a1-01b0-4011-a47d-4d1bb3cefbf4 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:33.656845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2939e6a1-01b0-4011-a47d-4d1bb3cefbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:33.763089 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 680/1337] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:00:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:33.798372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15929a-a893-48af-8e3a-2f0a57728faa None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:00:33.800563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1d15929a-a893-48af-8e3a-2f0a57728faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:33.900413 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15929a-a893-48af-8e3a-2f0a57728faa None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:00:33.972467 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72374905-37c1-4f2d-b10d-157d64482be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:00:33.973105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72374905-37c1-4f2d-b10d-157d64482be8 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:33.973382 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72374905-37c1-4f2d-b10d-157d64482be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:33.973652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72374905-37c1-4f2d-b10d-157d64482be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:33.975298 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-72374905-37c1-4f2d-b10d-157d64482be8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:34.092970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72374905-37c1-4f2d-b10d-157d64482be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:00:34.094407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72374905-37c1-4f2d-b10d-157d64482be8 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:00:34.112799 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 658/1338] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:00:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:00:38.467455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60e57c-035b-4e6b-95eb-2aaf73d112a3 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:38.468020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60e57c-035b-4e6b-95eb-2aaf73d112a3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:38.468020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60e57c-035b-4e6b-95eb-2aaf73d112a3 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:38.469376 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 681/1339] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:38.475332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1298b1a-54f5-4297-82cb-8394bf4d7df9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:38.475752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1298b1a-54f5-4297-82cb-8394bf4d7df9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:38.475899 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1298b1a-54f5-4297-82cb-8394bf4d7df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:38.546068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e1298b1a-54f5-4297-82cb-8394bf4d7df9 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:38.547278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e1298b1a-54f5-4297-82cb-8394bf4d7df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:38.651124 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 659/1340] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:38.705913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907d627-901e-460d-8311-99b1e4c2263c None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:38.706200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907d627-901e-460d-8311-99b1e4c2263c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:38.706666 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907d627-901e-460d-8311-99b1e4c2263c None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:38.708140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 682/1341] 10.222.0.24 () {54 vars in 964 bytes} [Tue May 17 22:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:38.714169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8a2ac-3d74-4da9-994a-6da116008e73 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:38.714459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8a2ac-3d74-4da9-994a-6da116008e73 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:38.714732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8a2ac-3d74-4da9-994a-6da116008e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:38.780031 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-aeb8a2ac-3d74-4da9-994a-6da116008e73 None None] MFA Rules not processed for user `c084b56d682c44119654743809109bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:38.781205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-aeb8a2ac-3d74-4da9-994a-6da116008e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:38.854428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 660/1342] 10.222.0.24 () {58 vars in 1061 bytes} [Tue May 17 22:00:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:00:38.863580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907d627-901e-460d-8311-99b1e4c2263c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:00:38.875011 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907d627-901e-460d-8311-99b1e4c2263c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:00:38.879649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75cb1f-3572-44cb-af4d-eed3e1bf3fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:00:38.880286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75cb1f-3572-44cb-af4d-eed3e1bf3fcb service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:38.880568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75cb1f-3572-44cb-af4d-eed3e1bf3fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:38.880859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75cb1f-3572-44cb-af4d-eed3e1bf3fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:38.889850 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75cb1f-3572-44cb-af4d-eed3e1bf3fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:00:38.891334 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75cb1f-3572-44cb-af4d-eed3e1bf3fcb service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:00:38.901682 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 683/1343] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:00:42.628602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4d3e5-16bd-4239-a1ce-4a2809603f40 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:42.629159 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4d3e5-16bd-4239-a1ce-4a2809603f40 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:42.629159 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4d3e5-16bd-4239-a1ce-4a2809603f40 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:42.630546 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 661/1344] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:42.635770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f88fcc-41e6-4acb-8f52-e74c570603d0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:42.636205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f88fcc-41e6-4acb-8f52-e74c570603d0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:42.636357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f88fcc-41e6-4acb-8f52-e74c570603d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:42.664434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-18f88fcc-41e6-4acb-8f52-e74c570603d0 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:42.665548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-18f88fcc-41e6-4acb-8f52-e74c570603d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:42.740008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 684/1345] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:00:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:42.777056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4d3e5-16bd-4239-a1ce-4a2809603f40 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:00:42.787821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4d3e5-16bd-4239-a1ce-4a2809603f40 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:00:42.791350 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f31d1b-1ee7-4b9f-af73-00a56bb16c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:00:42.792018 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f31d1b-1ee7-4b9f-af73-00a56bb16c37 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:42.792305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f31d1b-1ee7-4b9f-af73-00a56bb16c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:42.792584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f31d1b-1ee7-4b9f-af73-00a56bb16c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:42.802353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f31d1b-1ee7-4b9f-af73-00a56bb16c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:00:42.803812 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f31d1b-1ee7-4b9f-af73-00a56bb16c37 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:00:42.813681 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 662/1346] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:00:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:00:47.476773 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2229cff-0cc8-4d1e-8450-7c64afe5fd59 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:47.477275 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2229cff-0cc8-4d1e-8450-7c64afe5fd59 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:47.477275 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2229cff-0cc8-4d1e-8450-7c64afe5fd59 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:47.478664 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 685/1347] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:47.483982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dbd3b-5c3f-4099-8d26-e32a09e54791 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:47.484422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dbd3b-5c3f-4099-8d26-e32a09e54791 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:47.484663 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dbd3b-5c3f-4099-8d26-e32a09e54791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:47.502482 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-857dbd3b-5c3f-4099-8d26-e32a09e54791 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:47.503713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-857dbd3b-5c3f-4099-8d26-e32a09e54791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:47.511812 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 663/1348] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:47.550581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2229cff-0cc8-4d1e-8450-7c64afe5fd59 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:00:47.561781 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2229cff-0cc8-4d1e-8450-7c64afe5fd59 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:00:47.565445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912055bd-79c3-43b7-8400-7b7d797c1d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:00:47.566080 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912055bd-79c3-43b7-8400-7b7d797c1d06 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:47.566357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912055bd-79c3-43b7-8400-7b7d797c1d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:47.566634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912055bd-79c3-43b7-8400-7b7d797c1d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:47.575929 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912055bd-79c3-43b7-8400-7b7d797c1d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:00:47.577354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912055bd-79c3-43b7-8400-7b7d797c1d06 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:00:47.588124 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 686/1349] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:00:52.937907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0783775-ed18-4489-859c-927042d4645b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:52.939420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0783775-ed18-4489-859c-927042d4645b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:52.939918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0783775-ed18-4489-859c-927042d4645b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:52.941760 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 664/1350] 10.222.0.24 () {54 vars in 921 bytes} [Tue May 17 22:00:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:52.947072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfa665-f0ab-4b18-bf82-6c398de71e94 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:52.947949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfa665-f0ab-4b18-bf82-6c398de71e94 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:52.948423 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfa665-f0ab-4b18-bf82-6c398de71e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:53.000094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-58dfa665-f0ab-4b18-bf82-6c398de71e94 None None] MFA Rules not processed for user `2cbd89f9b7a24b6cb993ca86e964c54d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:53.001929 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-58dfa665-f0ab-4b18-bf82-6c398de71e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:53.083365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 687/1351] 10.222.0.24 () {58 vars in 1018 bytes} [Tue May 17 22:00:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:57.433811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f89ce-2501-4bb1-ad1c-ed2ab81f76ba None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:57.434363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f89ce-2501-4bb1-ad1c-ed2ab81f76ba None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:57.434363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f89ce-2501-4bb1-ad1c-ed2ab81f76ba None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:57.436130 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 665/1352] 10.222.0.24 () {54 vars in 921 bytes} [Tue May 17 22:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:57.442499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db4d50-a2da-4f85-b02c-e5ffdee05cac None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:57.443554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db4d50-a2da-4f85-b02c-e5ffdee05cac None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:57.444045 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db4d50-a2da-4f85-b02c-e5ffdee05cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:57.464932 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f0db4d50-a2da-4f85-b02c-e5ffdee05cac None None] MFA Rules not processed for user `2cbd89f9b7a24b6cb993ca86e964c54d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:57.466533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f0db4d50-a2da-4f85-b02c-e5ffdee05cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:57.476693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 688/1353] 10.222.0.24 () {58 vars in 1018 bytes} [Tue May 17 22:00:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:00:58.973069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284aae-083f-47ac-8fdc-71e7c456f728 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:58.973599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284aae-083f-47ac-8fdc-71e7c456f728 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:58.973599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284aae-083f-47ac-8fdc-71e7c456f728 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:58.975199 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 666/1354] 10.222.0.24 () {54 vars in 921 bytes} [Tue May 17 22:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:00:58.980029 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e00556-e837-46bc-b326-be931fc84fe8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:00:58.980429 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e00556-e837-46bc-b326-be931fc84fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:00:58.980649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e00556-e837-46bc-b326-be931fc84fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:00:58.999096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e7e00556-e837-46bc-b326-be931fc84fe8 None None] MFA Rules not processed for user `2cbd89f9b7a24b6cb993ca86e964c54d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:00:59.000454 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e7e00556-e837-46bc-b326-be931fc84fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:00:59.010169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 689/1355] 10.222.0.24 () {58 vars in 1018 bytes} [Tue May 17 22:00:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:01:02.848604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6508c74-f07b-4455-b6fb-4bf9183028dd None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:02.849222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6508c74-f07b-4455-b6fb-4bf9183028dd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:02.849320 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6508c74-f07b-4455-b6fb-4bf9183028dd None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:02.850946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 667/1356] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:02.856000 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d42d71-cf63-44bb-99d9-dc78c94a982a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:02.856419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d42d71-cf63-44bb-99d9-dc78c94a982a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:02.856554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d42d71-cf63-44bb-99d9-dc78c94a982a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:02.876327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a2d42d71-cf63-44bb-99d9-dc78c94a982a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:02.877857 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a2d42d71-cf63-44bb-99d9-dc78c94a982a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:02.896390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 690/1357] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:02.940867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da3683-2098-485f-92f4-3b397abe02ba None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:02.941289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da3683-2098-485f-92f4-3b397abe02ba None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:02.941696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da3683-2098-485f-92f4-3b397abe02ba None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:02.943292 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 668/1358] 10.222.0.24 () {54 vars in 961 bytes} [Tue May 17 22:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:02.948978 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3915cd-abe9-465b-a8cd-bf07cd89920b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:02.949334 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3915cd-abe9-465b-a8cd-bf07cd89920b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:02.949683 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3915cd-abe9-465b-a8cd-bf07cd89920b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:02.997859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-be3915cd-abe9-465b-a8cd-bf07cd89920b None None] MFA Rules not processed for user `8d06113649924eae83d04bc22337bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:02.999010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-be3915cd-abe9-465b-a8cd-bf07cd89920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:03.085028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 691/1359] 10.222.0.24 () {58 vars in 1058 bytes} [Tue May 17 22:01:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:03.095491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da3683-2098-485f-92f4-3b397abe02ba None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:03.113812 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da3683-2098-485f-92f4-3b397abe02ba None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:03.121157 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68540a70-93ad-4f38-a2a0-31c1a987a456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:03.123445 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68540a70-93ad-4f38-a2a0-31c1a987a456 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:03.123445 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68540a70-93ad-4f38-a2a0-31c1a987a456 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:03.123445 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68540a70-93ad-4f38-a2a0-31c1a987a456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:03.133351 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68540a70-93ad-4f38-a2a0-31c1a987a456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:03.135094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68540a70-93ad-4f38-a2a0-31c1a987a456 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:03.148619 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 669/1360] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:01:05.642850 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525786eb-30f6-4580-a05d-01ea68aa8fd7 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:05.643423 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525786eb-30f6-4580-a05d-01ea68aa8fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:05.643423 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525786eb-30f6-4580-a05d-01ea68aa8fd7 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:05.644875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 692/1361] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:01:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:05.650011 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fec0a4-1d4d-4695-b35b-108dd72d7d14 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:05.650407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fec0a4-1d4d-4695-b35b-108dd72d7d14 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:05.650572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fec0a4-1d4d-4695-b35b-108dd72d7d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:05.669150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-02fec0a4-1d4d-4695-b35b-108dd72d7d14 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:05.670424 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-02fec0a4-1d4d-4695-b35b-108dd72d7d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:05.681556 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 670/1362] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:05.726377 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525786eb-30f6-4580-a05d-01ea68aa8fd7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:05.741350 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525786eb-30f6-4580-a05d-01ea68aa8fd7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:05.747184 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f6066-14e6-46c7-883d-8c115ef5fc26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:05.747814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f6066-14e6-46c7-883d-8c115ef5fc26 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:05.748099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f6066-14e6-46c7-883d-8c115ef5fc26 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:05.748373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f6066-14e6-46c7-883d-8c115ef5fc26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:05.757775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f6066-14e6-46c7-883d-8c115ef5fc26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:05.759369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f6066-14e6-46c7-883d-8c115ef5fc26 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:05.770478 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 693/1363] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:01:08.511090 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e2379-f5c5-4295-957e-e39d1cea08f3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:08.511654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e2379-f5c5-4295-957e-e39d1cea08f3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:08.511654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e2379-f5c5-4295-957e-e39d1cea08f3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:08.513133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 671/1364] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:08.519916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf646c8-7d79-422f-864b-60b9400b1c6c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:08.520419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf646c8-7d79-422f-864b-60b9400b1c6c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:08.520561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf646c8-7d79-422f-864b-60b9400b1c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:08.540033 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-acf646c8-7d79-422f-864b-60b9400b1c6c None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:08.541212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-acf646c8-7d79-422f-864b-60b9400b1c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:08.552048 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 694/1365] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:08.600026 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9daba-76ad-41c9-9ebd-5e30fbfdfee8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:08.600311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9daba-76ad-41c9-9ebd-5e30fbfdfee8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:08.600588 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9daba-76ad-41c9-9ebd-5e30fbfdfee8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:08.602634 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 672/1366] 10.222.0.24 () {54 vars in 961 bytes} [Tue May 17 22:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:08.608473 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92c5cb-7ca2-4a4a-aca9-6b7ec3b5b945 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:08.608771 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92c5cb-7ca2-4a4a-aca9-6b7ec3b5b945 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:08.609053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92c5cb-7ca2-4a4a-aca9-6b7ec3b5b945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:08.630023 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0c92c5cb-7ca2-4a4a-aca9-6b7ec3b5b945 None None] MFA Rules not processed for user `8d06113649924eae83d04bc22337bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:08.631242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0c92c5cb-7ca2-4a4a-aca9-6b7ec3b5b945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:08.642830 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 695/1367] 10.222.0.24 () {58 vars in 1058 bytes} [Tue May 17 22:01:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:08.650853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9daba-76ad-41c9-9ebd-5e30fbfdfee8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:08.668439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9daba-76ad-41c9-9ebd-5e30fbfdfee8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:08.677428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8feb8-0749-4680-a1b7-396e57de3b30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:08.678079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8feb8-0749-4680-a1b7-396e57de3b30 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:08.678361 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8feb8-0749-4680-a1b7-396e57de3b30 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:08.678637 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8feb8-0749-4680-a1b7-396e57de3b30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:08.688706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8feb8-0749-4680-a1b7-396e57de3b30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:08.690287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8feb8-0749-4680-a1b7-396e57de3b30 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:08.700387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 673/1368] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:01:11.268914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba892d-1083-469c-a2b6-59eeccf77bd0 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:11.269455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba892d-1083-469c-a2b6-59eeccf77bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:11.269455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba892d-1083-469c-a2b6-59eeccf77bd0 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:11.270743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 696/1369] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:11.276477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592963b-4856-443c-9f77-917e1aea2041 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:11.276941 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592963b-4856-443c-9f77-917e1aea2041 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:11.277043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592963b-4856-443c-9f77-917e1aea2041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:11.295330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0592963b-4856-443c-9f77-917e1aea2041 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:11.296652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0592963b-4856-443c-9f77-917e1aea2041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:11.304930 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 674/1370] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:11.320972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6dccf-ebba-4fad-a6a4-f320ae3c8f33 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:11.321256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6dccf-ebba-4fad-a6a4-f320ae3c8f33 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:11.321801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6dccf-ebba-4fad-a6a4-f320ae3c8f33 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:11.323354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 697/1371] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:11.330299 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a2af3-f479-4d42-a835-baef6be2568d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:11.330586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a2af3-f479-4d42-a835-baef6be2568d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:11.331049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a2af3-f479-4d42-a835-baef6be2568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:11.352043 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6dccf-ebba-4fad-a6a4-f320ae3c8f33 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:11.353578 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6c2a2af3-f479-4d42-a835-baef6be2568d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:11.354791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6c2a2af3-f479-4d42-a835-baef6be2568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:11.365941 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 675/1372] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:11.367892 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6dccf-ebba-4fad-a6a4-f320ae3c8f33 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:11.373767 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c6f74-deb1-4e30-8670-7e5d72119789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:11.374568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6f74-deb1-4e30-8670-7e5d72119789 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:11.374960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6f74-deb1-4e30-8670-7e5d72119789 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:11.375530 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6f74-deb1-4e30-8670-7e5d72119789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:11.385115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c6f74-deb1-4e30-8670-7e5d72119789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:11.386859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c6f74-deb1-4e30-8670-7e5d72119789 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:11.397371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 698/1373] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:01:11.683182 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d72e6f-055e-41ff-8943-5a8fa6cbbf85 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:11.683477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d72e6f-055e-41ff-8943-5a8fa6cbbf85 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:11.683759 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d72e6f-055e-41ff-8943-5a8fa6cbbf85 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:11.686359 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 676/1374] 10.222.0.24 () {54 vars in 963 bytes} [Tue May 17 22:01:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:11.692464 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04298a8-bc90-4d0d-9dfb-2b8e31404d1d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:11.692883 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04298a8-bc90-4d0d-9dfb-2b8e31404d1d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:11.693266 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04298a8-bc90-4d0d-9dfb-2b8e31404d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:11.758538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d04298a8-bc90-4d0d-9dfb-2b8e31404d1d None None] MFA Rules not processed for user `f765ee92b36e43478c04db32227a5872`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:11.759828 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d04298a8-bc90-4d0d-9dfb-2b8e31404d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:11.820388 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 699/1375] 10.222.0.24 () {58 vars in 1060 bytes} [Tue May 17 22:01:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:11.828216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d72e6f-055e-41ff-8943-5a8fa6cbbf85 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:11.840007 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d72e6f-055e-41ff-8943-5a8fa6cbbf85 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:11.843616 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20e8eb-4451-45ee-b4fe-c3aa5ff49e8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:11.844499 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20e8eb-4451-45ee-b4fe-c3aa5ff49e8a service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:11.844850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20e8eb-4451-45ee-b4fe-c3aa5ff49e8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:11.845299 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20e8eb-4451-45ee-b4fe-c3aa5ff49e8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:11.854606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20e8eb-4451-45ee-b4fe-c3aa5ff49e8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:11.856136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20e8eb-4451-45ee-b4fe-c3aa5ff49e8a service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:11.866528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 677/1376] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:01:13.790225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8812ba7-9fc3-43e6-8d42-527d74a890c9 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:13.790754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8812ba7-9fc3-43e6-8d42-527d74a890c9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:13.790754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8812ba7-9fc3-43e6-8d42-527d74a890c9 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:13.792170 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 700/1377] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:13.797967 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280026c-d9fd-4753-9e80-524a0eace60f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:13.798439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280026c-d9fd-4753-9e80-524a0eace60f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:13.798544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280026c-d9fd-4753-9e80-524a0eace60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:13.816241 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4280026c-d9fd-4753-9e80-524a0eace60f None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:13.817418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4280026c-d9fd-4753-9e80-524a0eace60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:13.825606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 678/1378] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:13.869947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8812ba7-9fc3-43e6-8d42-527d74a890c9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:13.885052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8812ba7-9fc3-43e6-8d42-527d74a890c9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:13.890693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee91f5-a20b-440e-8399-f8a7b1e7935a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:13.892064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee91f5-a20b-440e-8399-f8a7b1e7935a service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:13.892353 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee91f5-a20b-440e-8399-f8a7b1e7935a service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:13.892627 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee91f5-a20b-440e-8399-f8a7b1e7935a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:13.901482 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee91f5-a20b-440e-8399-f8a7b1e7935a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:13.903098 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee91f5-a20b-440e-8399-f8a7b1e7935a service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:13.913653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 701/1379] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:01:16.361543 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945cf06-828e-49f1-a5b3-e99acf3886d5 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:16.362079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945cf06-828e-49f1-a5b3-e99acf3886d5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:16.362079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945cf06-828e-49f1-a5b3-e99acf3886d5 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:16.363514 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 679/1380] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:16.368882 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa8b50-44b3-4da3-9283-6b45803b388a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:16.369358 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa8b50-44b3-4da3-9283-6b45803b388a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:16.369459 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa8b50-44b3-4da3-9283-6b45803b388a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:16.389985 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d6fa8b50-44b3-4da3-9283-6b45803b388a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:16.392048 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d6fa8b50-44b3-4da3-9283-6b45803b388a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:16.400093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 702/1381] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:16.444145 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945cf06-828e-49f1-a5b3-e99acf3886d5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:16.459269 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945cf06-828e-49f1-a5b3-e99acf3886d5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:16.465586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407dcf7-2167-48f9-bc32-7ee05b54967c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:16.466338 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407dcf7-2167-48f9-bc32-7ee05b54967c service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:16.466723 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407dcf7-2167-48f9-bc32-7ee05b54967c service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:16.467113 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407dcf7-2167-48f9-bc32-7ee05b54967c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:16.476354 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407dcf7-2167-48f9-bc32-7ee05b54967c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:16.478101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407dcf7-2167-48f9-bc32-7ee05b54967c service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:16.489074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 680/1382] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:01:18.946215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cfa21-4295-42ad-9e5e-c5181016cb1f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:18.946738 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cfa21-4295-42ad-9e5e-c5181016cb1f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:18.946738 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cfa21-4295-42ad-9e5e-c5181016cb1f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:18.948158 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 703/1383] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:18.954391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0556680-c7f5-431e-a947-78a319b14db6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:18.954845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0556680-c7f5-431e-a947-78a319b14db6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:18.955419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0556680-c7f5-431e-a947-78a319b14db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:18.975812 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d0556680-c7f5-431e-a947-78a319b14db6 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:18.976993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d0556680-c7f5-431e-a947-78a319b14db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:18.986378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 681/1384] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:19.027495 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cfa21-4295-42ad-9e5e-c5181016cb1f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:19.042692 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cfa21-4295-42ad-9e5e-c5181016cb1f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:19.048430 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b65f80-0f2c-4d09-938a-239b75f46c95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:19.049062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b65f80-0f2c-4d09-938a-239b75f46c95 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:19.049349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b65f80-0f2c-4d09-938a-239b75f46c95 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:19.049625 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b65f80-0f2c-4d09-938a-239b75f46c95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:19.058058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b65f80-0f2c-4d09-938a-239b75f46c95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:19.059673 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b65f80-0f2c-4d09-938a-239b75f46c95 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:19.069971 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 704/1385] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:01:21.862054 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844bd99-75c1-4090-a5c3-5bedbd4f27ea None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:21.862638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844bd99-75c1-4090-a5c3-5bedbd4f27ea None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:21.862848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844bd99-75c1-4090-a5c3-5bedbd4f27ea None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:21.864904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 682/1386] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:01:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:21.872268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efe5a7-f33b-4b7e-94f2-6fb1c10ffc1a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:21.872720 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efe5a7-f33b-4b7e-94f2-6fb1c10ffc1a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:21.873054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efe5a7-f33b-4b7e-94f2-6fb1c10ffc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:21.896263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-33efe5a7-f33b-4b7e-94f2-6fb1c10ffc1a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:21.897782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-33efe5a7-f33b-4b7e-94f2-6fb1c10ffc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:21.907339 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 705/1387] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:21.952114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844bd99-75c1-4090-a5c3-5bedbd4f27ea None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:21.966993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844bd99-75c1-4090-a5c3-5bedbd4f27ea None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:21.973210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d31e90-b59a-44a0-b293-b332d05a3ba7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:21.973862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d31e90-b59a-44a0-b293-b332d05a3ba7 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:21.974147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d31e90-b59a-44a0-b293-b332d05a3ba7 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:21.974428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d31e90-b59a-44a0-b293-b332d05a3ba7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:21.983079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d31e90-b59a-44a0-b293-b332d05a3ba7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:21.985525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d31e90-b59a-44a0-b293-b332d05a3ba7 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:21.998152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 683/1388] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:01:24.984772 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e3ab0-eacd-48a9-874f-e8bcb74107ca None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:24.985321 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e3ab0-eacd-48a9-874f-e8bcb74107ca None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:24.985695 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e3ab0-eacd-48a9-874f-e8bcb74107ca None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:24.987123 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 706/1389] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:01:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:24.993398 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812da94-f574-493c-9e7f-e9e823bd1a81 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:24.993888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812da94-f574-493c-9e7f-e9e823bd1a81 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:24.993985 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812da94-f574-493c-9e7f-e9e823bd1a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:25.012005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5812da94-f574-493c-9e7f-e9e823bd1a81 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:25.013281 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5812da94-f574-493c-9e7f-e9e823bd1a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:25.021466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 684/1390] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:25.070251 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e3ab0-eacd-48a9-874f-e8bcb74107ca None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:25.085244 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e3ab0-eacd-48a9-874f-e8bcb74107ca None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:25.090630 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66205c88-e45d-41ef-aec7-e599562ab9d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:25.091285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66205c88-e45d-41ef-aec7-e599562ab9d5 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:25.091561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66205c88-e45d-41ef-aec7-e599562ab9d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:25.091833 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66205c88-e45d-41ef-aec7-e599562ab9d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:25.102090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66205c88-e45d-41ef-aec7-e599562ab9d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:25.103724 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66205c88-e45d-41ef-aec7-e599562ab9d5 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:25.114277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 707/1391] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:01:27.662183 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fe93a-4635-46a5-b281-fb0ec19b3dd6 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:27.662814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fe93a-4635-46a5-b281-fb0ec19b3dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:27.662814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fe93a-4635-46a5-b281-fb0ec19b3dd6 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:27.664506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 685/1392] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:27.670538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9615ff8-fcdf-4116-b3f4-18e9115ccb68 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:27.671146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9615ff8-fcdf-4116-b3f4-18e9115ccb68 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:27.671146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9615ff8-fcdf-4116-b3f4-18e9115ccb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:27.690369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a9615ff8-fcdf-4116-b3f4-18e9115ccb68 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:27.691636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a9615ff8-fcdf-4116-b3f4-18e9115ccb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:27.699548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 708/1393] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:27.744658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fe93a-4635-46a5-b281-fb0ec19b3dd6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:27.759602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fe93a-4635-46a5-b281-fb0ec19b3dd6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:27.764999 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566136f3-a3b8-469d-b392-4b14c9addf56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:27.765778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566136f3-a3b8-469d-b392-4b14c9addf56 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:27.766168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566136f3-a3b8-469d-b392-4b14c9addf56 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:27.766447 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566136f3-a3b8-469d-b392-4b14c9addf56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:27.774522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566136f3-a3b8-469d-b392-4b14c9addf56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:27.776114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566136f3-a3b8-469d-b392-4b14c9addf56 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:27.785705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 686/1394] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:01:27.849586 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847eb7-c785-41b2-8e61-5087ad61f303 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:27.849859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847eb7-c785-41b2-8e61-5087ad61f303 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:27.850139 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847eb7-c785-41b2-8e61-5087ad61f303 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:27.851562 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 709/1395] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:27.856857 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7463d0-e769-4f5a-97af-c05da8b3a11c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:27.857150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7463d0-e769-4f5a-97af-c05da8b3a11c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:27.857430 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7463d0-e769-4f5a-97af-c05da8b3a11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:27.876327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0d7463d0-e769-4f5a-97af-c05da8b3a11c None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:27.885202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0d7463d0-e769-4f5a-97af-c05da8b3a11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:27.885800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 687/1396] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:27.943483 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581981f-a152-467d-be72-d155bf6484fc None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:27.943881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581981f-a152-467d-be72-d155bf6484fc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:27.944165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581981f-a152-467d-be72-d155bf6484fc None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:27.945573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 710/1397] 10.222.0.24 () {54 vars in 962 bytes} [Tue May 17 22:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:27.954223 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f1e59-da0f-4f5b-95c2-dfeab6ad4a9b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:27.954223 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f1e59-da0f-4f5b-95c2-dfeab6ad4a9b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:27.954223 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f1e59-da0f-4f5b-95c2-dfeab6ad4a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:28.008704 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bc2f1e59-da0f-4f5b-95c2-dfeab6ad4a9b None None] MFA Rules not processed for user `68748827b9f14eb7958d5b202c5d6877`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:28.009940 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bc2f1e59-da0f-4f5b-95c2-dfeab6ad4a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:28.075015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 688/1398] 10.222.0.24 () {58 vars in 1059 bytes} [Tue May 17 22:01:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:28.082960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581981f-a152-467d-be72-d155bf6484fc None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:28.093969 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581981f-a152-467d-be72-d155bf6484fc None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:28.097891 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7f6e4-0f87-4a49-8b94-eaf3614e097d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68748827b9f14eb7958d5b202c5d6877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:28.098617 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7f6e4-0f87-4a49-8b94-eaf3614e097d service glance] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:28.098972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7f6e4-0f87-4a49-8b94-eaf3614e097d service glance] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:28.099283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7f6e4-0f87-4a49-8b94-eaf3614e097d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:28.109519 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7f6e4-0f87-4a49-8b94-eaf3614e097d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:28.111159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7f6e4-0f87-4a49-8b94-eaf3614e097d service glance] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:28.121416 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 711/1399] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:01:28.647475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad93df-559a-4abf-99ee-28440f723cbf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:28.647843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad93df-559a-4abf-99ee-28440f723cbf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:28.648193 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad93df-559a-4abf-99ee-28440f723cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:28.697253 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-56ad93df-559a-4abf-99ee-28440f723cbf None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:28.698432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-56ad93df-559a-4abf-99ee-28440f723cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:28.760035 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 689/1400] 10.222.0.24 () {58 vars in 1009 bytes} [Tue May 17 22:01:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:28.805733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fb873-5d76-4a21-9c05-b8b8b5fb1c8a None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:28.806484 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fb873-5d76-4a21-9c05-b8b8b5fb1c8a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:28.806595 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fb873-5d76-4a21-9c05-b8b8b5fb1c8a None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:28.807976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 712/1401] 10.222.0.24 () {54 vars in 942 bytes} [Tue May 17 22:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:28.814227 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb6ece-ec04-4ca5-b9b6-b81e879924c5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:28.814516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb6ece-ec04-4ca5-b9b6-b81e879924c5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:28.814792 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb6ece-ec04-4ca5-b9b6-b81e879924c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:28.863094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f8fb6ece-ec04-4ca5-b9b6-b81e879924c5 None None] MFA Rules not processed for user `957c3decfb19445d80836f767fa23bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:28.864364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f8fb6ece-ec04-4ca5-b9b6-b81e879924c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:28.940554 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 690/1402] 10.222.0.24 () {58 vars in 1039 bytes} [Tue May 17 22:01:28 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:28.950353 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fb873-5d76-4a21-9c05-b8b8b5fb1c8a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:28.966138 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fb873-5d76-4a21-9c05-b8b8b5fb1c8a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:28.970921 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71961490-6c87-484d-8ccf-62018fd3a91c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:28.971642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71961490-6c87-484d-8ccf-62018fd3a91c service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:28.971923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71961490-6c87-484d-8ccf-62018fd3a91c service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:28.972197 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71961490-6c87-484d-8ccf-62018fd3a91c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:28.980578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71961490-6c87-484d-8ccf-62018fd3a91c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:28.982293 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71961490-6c87-484d-8ccf-62018fd3a91c service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:28.990857 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 713/1403] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:01:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 22:01:30.175361 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca948c-7f02-4d7c-8a59-48ae9e154868 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:30.175882 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca948c-7f02-4d7c-8a59-48ae9e154868 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:30.175882 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca948c-7f02-4d7c-8a59-48ae9e154868 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:30.177354 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 691/1404] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:30.182825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6bf05-8cb3-464e-8788-adfb3a8ec5ed None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:30.183647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6bf05-8cb3-464e-8788-adfb3a8ec5ed None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:30.184111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6bf05-8cb3-464e-8788-adfb3a8ec5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:30.201814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-95d6bf05-8cb3-464e-8788-adfb3a8ec5ed None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:30.203585 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-95d6bf05-8cb3-464e-8788-adfb3a8ec5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:30.213077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 714/1405] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:01:30.261063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca948c-7f02-4d7c-8a59-48ae9e154868 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:30.278310 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca948c-7f02-4d7c-8a59-48ae9e154868 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:30.284301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d9205-5944-4206-9224-9160dc112a58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:30.284947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d9205-5944-4206-9224-9160dc112a58 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:30.285234 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d9205-5944-4206-9224-9160dc112a58 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:30.285514 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d9205-5944-4206-9224-9160dc112a58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:30.294609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d9205-5944-4206-9224-9160dc112a58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:30.296218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d9205-5944-4206-9224-9160dc112a58 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:30.315322 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 692/1406] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:01:32.789974 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb259c3-0f68-41a7-bbe9-cf05b33ba789 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:32.790509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb259c3-0f68-41a7-bbe9-cf05b33ba789 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:32.790509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb259c3-0f68-41a7-bbe9-cf05b33ba789 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:32.791933 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 715/1407] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:32.802697 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c476c8-5c72-4515-8895-91bf9a3b1772 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:32.802697 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c476c8-5c72-4515-8895-91bf9a3b1772 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:32.802697 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c476c8-5c72-4515-8895-91bf9a3b1772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:32.820501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-79c476c8-5c72-4515-8895-91bf9a3b1772 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:32.821696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-79c476c8-5c72-4515-8895-91bf9a3b1772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:32.830370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 693/1408] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:32.874333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb259c3-0f68-41a7-bbe9-cf05b33ba789 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:32.889368 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb259c3-0f68-41a7-bbe9-cf05b33ba789 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:32.896048 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a16625-eeba-429e-93d4-537849512665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:32.896690 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a16625-eeba-429e-93d4-537849512665 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:32.897159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a16625-eeba-429e-93d4-537849512665 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:32.897445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a16625-eeba-429e-93d4-537849512665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:32.907127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a16625-eeba-429e-93d4-537849512665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:32.908738 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a16625-eeba-429e-93d4-537849512665 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:32.918296 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 716/1409] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:01:53.473933 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4d73d-26b8-4fc1-8b4a-f4fdc475d778 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:53.474573 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4d73d-26b8-4fc1-8b4a-f4fdc475d778 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:53.474573 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4d73d-26b8-4fc1-8b4a-f4fdc475d778 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:53.475902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 694/1410] 10.222.0.24 () {54 vars in 918 bytes} [Tue May 17 22:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:53.480997 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40385b-5f9c-4200-9f63-164a6a5afdf3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:53.481424 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40385b-5f9c-4200-9f63-164a6a5afdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:53.481552 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40385b-5f9c-4200-9f63-164a6a5afdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:53.500337 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-dd40385b-5f9c-4200-9f63-164a6a5afdf3 None None] MFA Rules not processed for user `2cbd89f9b7a24b6cb993ca86e964c54d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:53.501592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dd40385b-5f9c-4200-9f63-164a6a5afdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:53.509951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 717/1411] 10.222.0.24 () {58 vars in 1015 bytes} [Tue May 17 22:01:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:53.523949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d71dc-6e13-46df-bae1-d94b7189db49 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:53.524259 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d71dc-6e13-46df-bae1-d94b7189db49 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:53.524522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d71dc-6e13-46df-bae1-d94b7189db49 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:53.525945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 695/1412] 10.222.0.24 () {54 vars in 918 bytes} [Tue May 17 22:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:53.530418 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222e2eb-5cb2-482c-b940-9db036ccb12d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:53.530702 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222e2eb-5cb2-482c-b940-9db036ccb12d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:53.531505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222e2eb-5cb2-482c-b940-9db036ccb12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:53.549396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0222e2eb-5cb2-482c-b940-9db036ccb12d None None] MFA Rules not processed for user `8d06113649924eae83d04bc22337bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:53.550553 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0222e2eb-5cb2-482c-b940-9db036ccb12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:53.559736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 718/1413] 10.222.0.24 () {58 vars in 1015 bytes} [Tue May 17 22:01:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:56.248375 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e274f8-5cf1-4962-8558-52f6a78d4ef1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:56.248909 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e274f8-5cf1-4962-8558-52f6a78d4ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:56.248909 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e274f8-5cf1-4962-8558-52f6a78d4ef1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:56.250971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 696/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 22:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:56.256331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd2ea-ac39-41fa-8eb0-a4f03f02adbb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:56.256791 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd2ea-ac39-41fa-8eb0-a4f03f02adbb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:56.256887 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd2ea-ac39-41fa-8eb0-a4f03f02adbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:56.275443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c70dd2ea-ac39-41fa-8eb0-a4f03f02adbb None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:56.276603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c70dd2ea-ac39-41fa-8eb0-a4f03f02adbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:56.284803 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 719/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 22:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:56.327278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e274f8-5cf1-4962-8558-52f6a78d4ef1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:56.341394 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e274f8-5cf1-4962-8558-52f6a78d4ef1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:56.346686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7885d8-52c3-4c4f-ba46-6e7d35e1d6fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:56.347342 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7885d8-52c3-4c4f-ba46-6e7d35e1d6fd service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:56.347626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7885d8-52c3-4c4f-ba46-6e7d35e1d6fd service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:56.347908 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7885d8-52c3-4c4f-ba46-6e7d35e1d6fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:56.355843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7885d8-52c3-4c4f-ba46-6e7d35e1d6fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:56.357401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7885d8-52c3-4c4f-ba46-6e7d35e1d6fd service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:56.367242 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 697/1416] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:01:57.359592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f2cf9-1398-4c93-a166-c39939f46386 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:57.360135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f2cf9-1398-4c93-a166-c39939f46386 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:57.360135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f2cf9-1398-4c93-a166-c39939f46386 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:57.361508 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 720/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 22:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:57.366372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09978b-92e8-480e-a414-4e6aa47c5183 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:57.366823 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09978b-92e8-480e-a414-4e6aa47c5183 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:57.366958 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09978b-92e8-480e-a414-4e6aa47c5183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:57.384999 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1e09978b-92e8-480e-a414-4e6aa47c5183 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:57.386176 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1e09978b-92e8-480e-a414-4e6aa47c5183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:57.394472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 698/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 22:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:57.568320 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f2cf9-1398-4c93-a166-c39939f46386 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:57.582688 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f2cf9-1398-4c93-a166-c39939f46386 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:57.587938 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c24255-a39b-4856-b424-241b3b6f2a10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:57.588563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c24255-a39b-4856-b424-241b3b6f2a10 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:57.588842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c24255-a39b-4856-b424-241b3b6f2a10 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:57.589116 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c24255-a39b-4856-b424-241b3b6f2a10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:57.596958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c24255-a39b-4856-b424-241b3b6f2a10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:57.598556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c24255-a39b-4856-b424-241b3b6f2a10 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:57.607642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 721/1419] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:01:58.552071 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235408a5-1c49-4f9a-8d7c-b89eaaec4589 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:58.552626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235408a5-1c49-4f9a-8d7c-b89eaaec4589 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:58.552626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235408a5-1c49-4f9a-8d7c-b89eaaec4589 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:58.554006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 699/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 22:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:58.559026 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11838ec-6b82-45ad-b189-8fb373d7f013 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:58.559503 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11838ec-6b82-45ad-b189-8fb373d7f013 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:58.559641 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11838ec-6b82-45ad-b189-8fb373d7f013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:58.577890 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f11838ec-6b82-45ad-b189-8fb373d7f013 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:58.579161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f11838ec-6b82-45ad-b189-8fb373d7f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:58.586831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 722/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 22:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:58.738340 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235408a5-1c49-4f9a-8d7c-b89eaaec4589 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:58.752877 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235408a5-1c49-4f9a-8d7c-b89eaaec4589 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:58.758201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eaaf26-e278-426e-99c0-089ca4aba89e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:58.758837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaaf26-e278-426e-99c0-089ca4aba89e service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:58.759137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaaf26-e278-426e-99c0-089ca4aba89e service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:58.759432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaaf26-e278-426e-99c0-089ca4aba89e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:58.770663 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eaaf26-e278-426e-99c0-089ca4aba89e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:58.773383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eaaf26-e278-426e-99c0-089ca4aba89e service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:58.786997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 700/1422] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:01:59.708991 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1c4a-2501-4885-a232-dfa70a43f190 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:59.709538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1c4a-2501-4885-a232-dfa70a43f190 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:59.709656 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1c4a-2501-4885-a232-dfa70a43f190 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:59.710939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 723/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 22:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:01:59.715701 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561be13f-4623-4a09-88ae-6b7b8822e403 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:59.716153 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561be13f-4623-4a09-88ae-6b7b8822e403 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:59.716266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561be13f-4623-4a09-88ae-6b7b8822e403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:59.734632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-561be13f-4623-4a09-88ae-6b7b8822e403 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:01:59.735843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-561be13f-4623-4a09-88ae-6b7b8822e403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:01:59.743487 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 701/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 22:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:01:59.891996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa1c4a-2501-4885-a232-dfa70a43f190 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:01:59.906798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa1c4a-2501-4885-a232-dfa70a43f190 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:01:59.912163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303038dd-0030-48ba-b253-adcd9b7e2303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:01:59.912789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303038dd-0030-48ba-b253-adcd9b7e2303 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:01:59.913068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303038dd-0030-48ba-b253-adcd9b7e2303 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:01:59.913340 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303038dd-0030-48ba-b253-adcd9b7e2303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:01:59.921234 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303038dd-0030-48ba-b253-adcd9b7e2303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:01:59.923633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303038dd-0030-48ba-b253-adcd9b7e2303 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:01:59.932996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 724/1425] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:02:00.862667 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01fe6b-1dac-4989-9a5c-8dc87ccc51bb None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:00.863258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01fe6b-1dac-4989-9a5c-8dc87ccc51bb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:00.863258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01fe6b-1dac-4989-9a5c-8dc87ccc51bb None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:00.864633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 702/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 22:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:02:00.869527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ef7b3-8d40-45d7-a978-00ecfa65714a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:00.869926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ef7b3-8d40-45d7-a978-00ecfa65714a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:00.870072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ef7b3-8d40-45d7-a978-00ecfa65714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:00.888684 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-843ef7b3-8d40-45d7-a978-00ecfa65714a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:02:00.889894 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-843ef7b3-8d40-45d7-a978-00ecfa65714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:00.898411 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 725/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 22:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:02:01.048965 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01fe6b-1dac-4989-9a5c-8dc87ccc51bb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:02:01.063370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01fe6b-1dac-4989-9a5c-8dc87ccc51bb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:02:01.068669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4d837-9857-43fb-ac03-24019bdb62b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:02:01.069300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4d837-9857-43fb-ac03-24019bdb62b2 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:01.069584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4d837-9857-43fb-ac03-24019bdb62b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:01.069860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4d837-9857-43fb-ac03-24019bdb62b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:01.078743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4d837-9857-43fb-ac03-24019bdb62b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:02:01.080416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4d837-9857-43fb-ac03-24019bdb62b2 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:02:01.089765 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 703/1428] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:02:02.036131 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45200ce6-e6db-44c6-ae2e-96ea49ca4366 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:02.036670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45200ce6-e6db-44c6-ae2e-96ea49ca4366 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:02.036670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45200ce6-e6db-44c6-ae2e-96ea49ca4366 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:02.038044 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 726/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 22:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:02:02.042861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2433-ae4b-4224-ba6f-94fbed3ea5e9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:02.043358 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2433-ae4b-4224-ba6f-94fbed3ea5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:02.043456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2433-ae4b-4224-ba6f-94fbed3ea5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:02.062061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ceaf2433-ae4b-4224-ba6f-94fbed3ea5e9 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:02:02.063205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ceaf2433-ae4b-4224-ba6f-94fbed3ea5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:02.070931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 704/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 22:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:02:02.222890 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45200ce6-e6db-44c6-ae2e-96ea49ca4366 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:02:02.237596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45200ce6-e6db-44c6-ae2e-96ea49ca4366 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:02:02.243745 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d785f6b-4f74-4baa-bb5d-43abb297ea8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:02:02.244383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d785f6b-4f74-4baa-bb5d-43abb297ea8a service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:02.244661 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d785f6b-4f74-4baa-bb5d-43abb297ea8a service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:02.244933 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d785f6b-4f74-4baa-bb5d-43abb297ea8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:02.256330 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d785f6b-4f74-4baa-bb5d-43abb297ea8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:02:02.258405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d785f6b-4f74-4baa-bb5d-43abb297ea8a service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:02:02.269881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 727/1431] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:02:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:02:03.198832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef6caf-37d8-4f0b-8e03-34b08e23c685 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:03.199394 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef6caf-37d8-4f0b-8e03-34b08e23c685 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:03.199394 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef6caf-37d8-4f0b-8e03-34b08e23c685 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:03.200788 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 705/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 22:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:02:03.206305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdeec3-c1fb-45c1-a7c1-71d7756ced48 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:03.206762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdeec3-c1fb-45c1-a7c1-71d7756ced48 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:03.206898 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdeec3-c1fb-45c1-a7c1-71d7756ced48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:03.225018 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-51fdeec3-c1fb-45c1-a7c1-71d7756ced48 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:02:03.226199 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-51fdeec3-c1fb-45c1-a7c1-71d7756ced48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:03.234908 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 728/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 22:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:02:03.389682 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef6caf-37d8-4f0b-8e03-34b08e23c685 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:02:03.404478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef6caf-37d8-4f0b-8e03-34b08e23c685 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:02:03.409974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30720b4-f8b1-4897-944c-55ac762da33b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:02:03.410603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30720b4-f8b1-4897-944c-55ac762da33b service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:03.410883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30720b4-f8b1-4897-944c-55ac762da33b service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:03.411188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30720b4-f8b1-4897-944c-55ac762da33b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:03.419232 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30720b4-f8b1-4897-944c-55ac762da33b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:02:03.420823 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30720b4-f8b1-4897-944c-55ac762da33b service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:02:03.430472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 706/1434] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:02:04.349258 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead9fe-e6bd-4801-977b-4fd8b657aaec None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:04.349835 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead9fe-e6bd-4801-977b-4fd8b657aaec None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:04.349835 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead9fe-e6bd-4801-977b-4fd8b657aaec None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:04.351213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 729/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 22:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:02:04.356069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cad2d-2725-4cf6-ac50-8168e531cd15 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:04.356511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cad2d-2725-4cf6-ac50-8168e531cd15 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:04.356622 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cad2d-2725-4cf6-ac50-8168e531cd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:04.375024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f15cad2d-2725-4cf6-ac50-8168e531cd15 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:02:04.376238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f15cad2d-2725-4cf6-ac50-8168e531cd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:04.384043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 707/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:02:04.533572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ead9fe-e6bd-4801-977b-4fd8b657aaec None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:02:04.549107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ead9fe-e6bd-4801-977b-4fd8b657aaec None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:02:04.554367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7eeb1-e916-4810-b265-c216c9dda5bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:02:04.554993 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7eeb1-e916-4810-b265-c216c9dda5bc service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:04.555314 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7eeb1-e916-4810-b265-c216c9dda5bc service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:04.555595 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7eeb1-e916-4810-b265-c216c9dda5bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:04.564464 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7eeb1-e916-4810-b265-c216c9dda5bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:02:04.566047 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7eeb1-e916-4810-b265-c216c9dda5bc service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:02:04.575283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 730/1437] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:02:05.516572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bdd11-7039-46f4-a922-ae85727b636b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:05.517117 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bdd11-7039-46f4-a922-ae85727b636b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:05.517117 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bdd11-7039-46f4-a922-ae85727b636b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:05.518499 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 708/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 22:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:02:05.523336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c625c81-3a95-442e-b2d3-8518561d6609 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:05.523751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c625c81-3a95-442e-b2d3-8518561d6609 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:05.523896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c625c81-3a95-442e-b2d3-8518561d6609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:05.542045 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7c625c81-3a95-442e-b2d3-8518561d6609 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:02:05.543274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7c625c81-3a95-442e-b2d3-8518561d6609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:05.551170 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 731/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 22:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:02:05.699627 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bdd11-7039-46f4-a922-ae85727b636b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:02:05.714414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bdd11-7039-46f4-a922-ae85727b636b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:02:05.719849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78296d7-b14c-4cd0-900e-0c001c6aae2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:02:05.720479 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78296d7-b14c-4cd0-900e-0c001c6aae2d service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:05.720764 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78296d7-b14c-4cd0-900e-0c001c6aae2d service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:05.721042 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78296d7-b14c-4cd0-900e-0c001c6aae2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:05.729154 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78296d7-b14c-4cd0-900e-0c001c6aae2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:02:05.730762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78296d7-b14c-4cd0-900e-0c001c6aae2d service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:02:05.740441 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 709/1440] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:02:07.864447 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6871e4-fe26-47b5-a41e-d98ac32506cb None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:07.864977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6871e4-fe26-47b5-a41e-d98ac32506cb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:07.864977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6871e4-fe26-47b5-a41e-d98ac32506cb None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:07.866373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 732/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 22:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:02:07.871759 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6718f40-cf96-4863-8b1c-60277d08a68a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:07.872176 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6718f40-cf96-4863-8b1c-60277d08a68a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:07.872315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6718f40-cf96-4863-8b1c-60277d08a68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:07.891848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a6718f40-cf96-4863-8b1c-60277d08a68a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:02:07.893047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a6718f40-cf96-4863-8b1c-60277d08a68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:07.900838 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 710/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 22:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:02:07.939367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6871e4-fe26-47b5-a41e-d98ac32506cb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:02:07.949815 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6871e4-fe26-47b5-a41e-d98ac32506cb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:02:07.953891 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f2efc-81a9-42f3-ac4f-16769df63d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:02:07.954517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f2efc-81a9-42f3-ac4f-16769df63d8a service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:07.954798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f2efc-81a9-42f3-ac4f-16769df63d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:07.955073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f2efc-81a9-42f3-ac4f-16769df63d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:07.963740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f2efc-81a9-42f3-ac4f-16769df63d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:02:07.965175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f2efc-81a9-42f3-ac4f-16769df63d8a service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:02:07.974361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 733/1443] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:02:10.503428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31e3c0-050f-4ce8-bacf-756fc0d1e0f1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:10.503958 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31e3c0-050f-4ce8-bacf-756fc0d1e0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:10.503958 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31e3c0-050f-4ce8-bacf-756fc0d1e0f1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:10.505431 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 22:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:02:10.510726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5068b7-9119-47c0-834c-074ff5c3a7bf None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:10.511183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5068b7-9119-47c0-834c-074ff5c3a7bf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:10.511294 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5068b7-9119-47c0-834c-074ff5c3a7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:10.529246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-df5068b7-9119-47c0-834c-074ff5c3a7bf None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:02:10.531080 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-df5068b7-9119-47c0-834c-074ff5c3a7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:10.538786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 22:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:02:10.576940 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31e3c0-050f-4ce8-bacf-756fc0d1e0f1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:02:10.579243 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5a31e3c0-050f-4ce8-bacf-756fc0d1e0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:10.592812 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31e3c0-050f-4ce8-bacf-756fc0d1e0f1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:02:10.596666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a3208-09f7-4599-a519-0997ad57635c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:02:10.597298 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a3208-09f7-4599-a519-0997ad57635c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:10.597580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a3208-09f7-4599-a519-0997ad57635c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:10.597855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a3208-09f7-4599-a519-0997ad57635c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:10.606601 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a3208-09f7-4599-a519-0997ad57635c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:02:10.608038 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a3208-09f7-4599-a519-0997ad57635c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:02:10.617222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 712/1446] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:02:13.257577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55261-ce28-4a17-b07b-e6674ea8e96e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:13.258157 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55261-ce28-4a17-b07b-e6674ea8e96e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:13.258157 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55261-ce28-4a17-b07b-e6674ea8e96e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:13.259455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 22:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:02:13.264757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d115480-5ef0-4c01-bfb5-4bae8599ce25 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:13.265195 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d115480-5ef0-4c01-bfb5-4bae8599ce25 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:13.265325 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d115480-5ef0-4c01-bfb5-4bae8599ce25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:13.283692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7d115480-5ef0-4c01-bfb5-4bae8599ce25 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:02:13.284947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7d115480-5ef0-4c01-bfb5-4bae8599ce25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:13.292692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 22:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:02:13.331813 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55261-ce28-4a17-b07b-e6674ea8e96e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:02:13.342182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55261-ce28-4a17-b07b-e6674ea8e96e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:02:13.345759 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5100e-3748-4a86-a75b-248770d51eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:02:13.346381 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5100e-3748-4a86-a75b-248770d51eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:13.346657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5100e-3748-4a86-a75b-248770d51eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:13.346926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5100e-3748-4a86-a75b-248770d51eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:13.355611 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5100e-3748-4a86-a75b-248770d51eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:02:13.357017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5100e-3748-4a86-a75b-248770d51eb9 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:02:13.366096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 736/1449] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:02:15.723075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8307d0-aad8-4908-873c-c6e302908f42 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:15.723724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8307d0-aad8-4908-873c-c6e302908f42 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:15.723724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8307d0-aad8-4908-873c-c6e302908f42 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:15.725017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 22:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:02:15.730221 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c8b89-cc2f-49b6-bbc3-49caab228ced None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:15.730636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c8b89-cc2f-49b6-bbc3-49caab228ced None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:15.730781 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c8b89-cc2f-49b6-bbc3-49caab228ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:15.748837 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-157c8b89-cc2f-49b6-bbc3-49caab228ced None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:02:15.750010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-157c8b89-cc2f-49b6-bbc3-49caab228ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:15.758239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 22:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:02:15.797586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8307d0-aad8-4908-873c-c6e302908f42 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:02:15.808342 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8307d0-aad8-4908-873c-c6e302908f42 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:02:15.811778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329eed16-17ad-4d61-a756-1f89a925ac1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:02:15.812403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329eed16-17ad-4d61-a756-1f89a925ac1c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:15.812686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329eed16-17ad-4d61-a756-1f89a925ac1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:15.813017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329eed16-17ad-4d61-a756-1f89a925ac1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:15.821888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329eed16-17ad-4d61-a756-1f89a925ac1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:02:15.823323 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329eed16-17ad-4d61-a756-1f89a925ac1c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:02:15.833187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 715/1452] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:02:18.096141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553fa25-93cb-4844-aee6-60d301e0e85b None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:18.096758 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553fa25-93cb-4844-aee6-60d301e0e85b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:18.096758 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553fa25-93cb-4844-aee6-60d301e0e85b None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:18.098104 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 22:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:02:18.103656 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b55bb-a9a1-4abe-a886-bae3130839be None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:18.104129 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b55bb-a9a1-4abe-a886-bae3130839be None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:18.104260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b55bb-a9a1-4abe-a886-bae3130839be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:18.121938 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e16b55bb-a9a1-4abe-a886-bae3130839be None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:02:18.123136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e16b55bb-a9a1-4abe-a886-bae3130839be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:18.131589 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 22:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:02:18.169106 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553fa25-93cb-4844-aee6-60d301e0e85b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:02:18.180378 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553fa25-93cb-4844-aee6-60d301e0e85b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:02:18.184064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01a7e4-43ec-4046-8047-2c749bf6f9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:02:18.184682 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01a7e4-43ec-4046-8047-2c749bf6f9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:18.184967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01a7e4-43ec-4046-8047-2c749bf6f9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:18.185237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01a7e4-43ec-4046-8047-2c749bf6f9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:18.194625 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01a7e4-43ec-4046-8047-2c749bf6f9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:02:18.196071 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01a7e4-43ec-4046-8047-2c749bf6f9b0 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:02:18.205367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 739/1455] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:02:20.495059 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1de4a-58eb-4ce6-9ea0-2844526fdf89 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:20.495594 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1de4a-58eb-4ce6-9ea0-2844526fdf89 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:20.495699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1de4a-58eb-4ce6-9ea0-2844526fdf89 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:20.497011 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 22:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:02:20.502917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39897941-982f-43a7-ba0e-278aca8a2652 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:20.503383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39897941-982f-43a7-ba0e-278aca8a2652 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:20.503493 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39897941-982f-43a7-ba0e-278aca8a2652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:20.520630 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-39897941-982f-43a7-ba0e-278aca8a2652 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:02:20.521808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-39897941-982f-43a7-ba0e-278aca8a2652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:20.529482 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 22:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:02:20.568038 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1de4a-58eb-4ce6-9ea0-2844526fdf89 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:02:20.578374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1de4a-58eb-4ce6-9ea0-2844526fdf89 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:02:20.582015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61e6ba-1714-40f0-ac29-373e1eabb943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:02:20.582639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61e6ba-1714-40f0-ac29-373e1eabb943 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:20.582922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61e6ba-1714-40f0-ac29-373e1eabb943 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:20.583228 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61e6ba-1714-40f0-ac29-373e1eabb943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:20.591870 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61e6ba-1714-40f0-ac29-373e1eabb943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:02:20.593274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61e6ba-1714-40f0-ac29-373e1eabb943 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:02:20.603480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 718/1458] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:02:22.998204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab22fb1-587f-4050-864a-416dd4d11cc7 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:22.998766 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab22fb1-587f-4050-864a-416dd4d11cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:22.998766 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab22fb1-587f-4050-864a-416dd4d11cc7 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:23.000146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 22:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:02:23.005928 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65beecb-c89b-40df-b42f-8f3ef15b9967 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:23.006344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65beecb-c89b-40df-b42f-8f3ef15b9967 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:23.006493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65beecb-c89b-40df-b42f-8f3ef15b9967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:23.024441 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f65beecb-c89b-40df-b42f-8f3ef15b9967 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:02:23.025632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f65beecb-c89b-40df-b42f-8f3ef15b9967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:23.033511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 22:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:02:23.071044 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab22fb1-587f-4050-864a-416dd4d11cc7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:02:23.082516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab22fb1-587f-4050-864a-416dd4d11cc7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:02:23.086121 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1745ec-4026-48d0-9dd8-c46a462a64bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:02:23.086750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1745ec-4026-48d0-9dd8-c46a462a64bd service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:23.087031 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1745ec-4026-48d0-9dd8-c46a462a64bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:23.087341 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1745ec-4026-48d0-9dd8-c46a462a64bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:23.096865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1745ec-4026-48d0-9dd8-c46a462a64bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:02:23.102433 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1745ec-4026-48d0-9dd8-c46a462a64bd service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:02:23.107708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 742/1461] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:02:25.347329 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682fca9-7f3c-4e12-85fb-ce5ed3f65d64 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:25.347893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682fca9-7f3c-4e12-85fb-ce5ed3f65d64 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:25.347893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682fca9-7f3c-4e12-85fb-ce5ed3f65d64 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:25.349267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 22:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:02:25.354635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3bddc-8913-4572-a107-3a7b9dfdf183 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:25.355039 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3bddc-8913-4572-a107-3a7b9dfdf183 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:25.355240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3bddc-8913-4572-a107-3a7b9dfdf183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:25.373039 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-bbd3bddc-8913-4572-a107-3a7b9dfdf183 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:02:25.374215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bbd3bddc-8913-4572-a107-3a7b9dfdf183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:25.381965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 22:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:02:25.418529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682fca9-7f3c-4e12-85fb-ce5ed3f65d64 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:02:25.429887 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682fca9-7f3c-4e12-85fb-ce5ed3f65d64 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:02:25.433600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92366d-6998-4cd8-b8ee-4d87f47f6e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:02:25.434231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92366d-6998-4cd8-b8ee-4d87f47f6e8e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:25.434515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92366d-6998-4cd8-b8ee-4d87f47f6e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:25.434820 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92366d-6998-4cd8-b8ee-4d87f47f6e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:25.443711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92366d-6998-4cd8-b8ee-4d87f47f6e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:02:25.445115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92366d-6998-4cd8-b8ee-4d87f47f6e8e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:02:25.454827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 721/1464] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:02:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:02:27.691787 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c8f46-0b55-4319-82a5-07c1ebd6490a None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:27.692369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c8f46-0b55-4319-82a5-07c1ebd6490a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:27.692369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c8f46-0b55-4319-82a5-07c1ebd6490a None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:27.693689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 22:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:02:27.699088 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad191994-2702-4053-81bc-c89bfb0b5ae6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:27.699506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad191994-2702-4053-81bc-c89bfb0b5ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:27.699678 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad191994-2702-4053-81bc-c89bfb0b5ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:27.717884 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ad191994-2702-4053-81bc-c89bfb0b5ae6 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:02:27.719710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ad191994-2702-4053-81bc-c89bfb0b5ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:27.727645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 22:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:02:27.763663 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c8f46-0b55-4319-82a5-07c1ebd6490a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:02:27.774598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c8f46-0b55-4319-82a5-07c1ebd6490a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:02:27.778070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98176c4-08f4-4419-a87f-9dc7de2329a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:02:27.778695 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98176c4-08f4-4419-a87f-9dc7de2329a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:27.778974 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98176c4-08f4-4419-a87f-9dc7de2329a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:27.779285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98176c4-08f4-4419-a87f-9dc7de2329a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:27.788545 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98176c4-08f4-4419-a87f-9dc7de2329a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:02:27.789961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98176c4-08f4-4419-a87f-9dc7de2329a7 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:02:27.799371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 745/1467] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:02:30.015493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceb875-bda0-462b-b4ee-a1115e947218 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:30.016583 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceb875-bda0-462b-b4ee-a1115e947218 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:30.016732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceb875-bda0-462b-b4ee-a1115e947218 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:30.018114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 22:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:02:30.023729 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec28ce1-5536-4db1-92eb-540e7e08c6d9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:30.024158 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec28ce1-5536-4db1-92eb-540e7e08c6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:30.024277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec28ce1-5536-4db1-92eb-540e7e08c6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:30.042178 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8ec28ce1-5536-4db1-92eb-540e7e08c6d9 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:02:30.043397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8ec28ce1-5536-4db1-92eb-540e7e08c6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:02:30.051081 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 22:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:02:30.087560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceb875-bda0-462b-b4ee-a1115e947218 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:02:30.098694 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceb875-bda0-462b-b4ee-a1115e947218 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:02:30.102435 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aaa17d-4b22-4ff3-a2a1-2ca28b1f2cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:02:30.103137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaa17d-4b22-4ff3-a2a1-2ca28b1f2cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:02:30.103432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaa17d-4b22-4ff3-a2a1-2ca28b1f2cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:02:30.103711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaa17d-4b22-4ff3-a2a1-2ca28b1f2cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:02:30.112783 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aaa17d-4b22-4ff3-a2a1-2ca28b1f2cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:02:30.114214 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aaa17d-4b22-4ff3-a2a1-2ca28b1f2cb5 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:02:30.123514 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 724/1470] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:03:03.685395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87759f-43c4-4a1c-9a46-7d763162bdf9 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:03.685992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87759f-43c4-4a1c-9a46-7d763162bdf9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:03.685992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87759f-43c4-4a1c-9a46-7d763162bdf9 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:03.687657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 747/1471] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:03:03.692822 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abb73c-ff7b-4808-a77a-14ed228b0b96 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:03.693250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abb73c-ff7b-4808-a77a-14ed228b0b96 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:03.693368 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abb73c-ff7b-4808-a77a-14ed228b0b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:03.711162 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f1abb73c-ff7b-4808-a77a-14ed228b0b96 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:03:03.712348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f1abb73c-ff7b-4808-a77a-14ed228b0b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:03:03.720799 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 725/1472] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:03:03.766861 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644f18a-9796-48d3-9309-4856dfb7d01d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:03.767182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644f18a-9796-48d3-9309-4856dfb7d01d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:03.767490 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644f18a-9796-48d3-9309-4856dfb7d01d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:03.768880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 748/1473] 10.222.0.24 () {54 vars in 962 bytes} [Tue May 17 22:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:03:03.773761 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a7319-4e16-4925-9c69-883b37baf532 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:03.774006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a7319-4e16-4925-9c69-883b37baf532 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:03.774289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a7319-4e16-4925-9c69-883b37baf532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:03.792304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f08a7319-4e16-4925-9c69-883b37baf532 None None] MFA Rules not processed for user `68748827b9f14eb7958d5b202c5d6877`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:03:03.793470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f08a7319-4e16-4925-9c69-883b37baf532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:03:03.799972 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 726/1474] 10.222.0.24 () {58 vars in 1059 bytes} [Tue May 17 22:03:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:03:03.807333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644f18a-9796-48d3-9309-4856dfb7d01d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:03:03.817945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644f18a-9796-48d3-9309-4856dfb7d01d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:03:03.821637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a2d9a-7d58-4f12-9174-aca53ca311e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68748827b9f14eb7958d5b202c5d6877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:03:03.822260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a2d9a-7d58-4f12-9174-aca53ca311e4 service glance] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:03.822538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a2d9a-7d58-4f12-9174-aca53ca311e4 service glance] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:03.822816 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a2d9a-7d58-4f12-9174-aca53ca311e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:03.832576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a2d9a-7d58-4f12-9174-aca53ca311e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:03:03.833991 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a2d9a-7d58-4f12-9174-aca53ca311e4 service glance] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:03:03.844571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 749/1475] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:03:06.152750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db5da5-879a-41f9-aa57-dc080b0606d8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:06.153362 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db5da5-879a-41f9-aa57-dc080b0606d8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:06.153362 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db5da5-879a-41f9-aa57-dc080b0606d8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:06.154592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 727/1476] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:03:06.160465 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82f100-d4c9-4e03-af15-90121339363f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:06.160880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82f100-d4c9-4e03-af15-90121339363f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:06.171200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82f100-d4c9-4e03-af15-90121339363f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:06.178659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5b82f100-d4c9-4e03-af15-90121339363f None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:03:06.179862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5b82f100-d4c9-4e03-af15-90121339363f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:03:06.187830 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 750/1477] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:03:06.212495 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db5da5-879a-41f9-aa57-dc080b0606d8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:03:06.225532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db5da5-879a-41f9-aa57-dc080b0606d8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:03:06.229919 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74760f-6857-4393-a882-2e2f7314b491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:03:06.230572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74760f-6857-4393-a882-2e2f7314b491 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:06.230847 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74760f-6857-4393-a882-2e2f7314b491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:06.231124 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74760f-6857-4393-a882-2e2f7314b491 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:06.231858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74760f-6857-4393-a882-2e2f7314b491 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:03:06.234176 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-4f74760f-6857-4393-a882-2e2f7314b491 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 22:03:06.234176 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: warnings.warn(msg) May 17 22:03:06.234176 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: May 17 22:03:06.235323 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74760f-6857-4393-a882-2e2f7314b491 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:03:06.254401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 728/1478] 10.222.0.24 () {56 vars in 1108 bytes} [Tue May 17 22:03:06 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:03:08.502205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3614d5-a9fc-497f-a16e-8c9db9007cb7 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:08.502640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3614d5-a9fc-497f-a16e-8c9db9007cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:08.502733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3614d5-a9fc-497f-a16e-8c9db9007cb7 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:08.504153 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 751/1479] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:03:08.509385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dd37c-c2ea-4ab9-9a55-f8c50b7fc11e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:08.509829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dd37c-c2ea-4ab9-9a55-f8c50b7fc11e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:08.509953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dd37c-c2ea-4ab9-9a55-f8c50b7fc11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:08.528038 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cc3dd37c-c2ea-4ab9-9a55-f8c50b7fc11e None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:03:08.529235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cc3dd37c-c2ea-4ab9-9a55-f8c50b7fc11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:03:08.537765 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 729/1480] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:03:08.580449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3614d5-a9fc-497f-a16e-8c9db9007cb7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:03:08.594601 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3614d5-a9fc-497f-a16e-8c9db9007cb7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:03:08.599809 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9236c50-48a2-490f-bc8b-b9fcd318f19c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:03:08.600432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9236c50-48a2-490f-bc8b-b9fcd318f19c service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:08.600709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9236c50-48a2-490f-bc8b-b9fcd318f19c service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:08.600980 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9236c50-48a2-490f-bc8b-b9fcd318f19c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:08.609106 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9236c50-48a2-490f-bc8b-b9fcd318f19c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:03:08.610659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9236c50-48a2-490f-bc8b-b9fcd318f19c service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:03:08.619676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 752/1481] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:03:11.141541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280ea80-1edd-4b87-9a6b-3f991715ad7e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:11.142105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280ea80-1edd-4b87-9a6b-3f991715ad7e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:11.142105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280ea80-1edd-4b87-9a6b-3f991715ad7e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:11.143547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 730/1482] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:03:11.154426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dc23a-d924-423c-9f8e-e9b26fde9608 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:11.154426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dc23a-d924-423c-9f8e-e9b26fde9608 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:11.154426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dc23a-d924-423c-9f8e-e9b26fde9608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:11.166810 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c77dc23a-d924-423c-9f8e-e9b26fde9608 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:03:11.168026 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c77dc23a-d924-423c-9f8e-e9b26fde9608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:03:11.176836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 753/1483] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:03:11.213497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280ea80-1edd-4b87-9a6b-3f991715ad7e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:03:11.224278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280ea80-1edd-4b87-9a6b-3f991715ad7e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:03:11.227838 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfc848-cddb-4c3c-bf06-949b04e1c6a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:03:11.228475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfc848-cddb-4c3c-bf06-949b04e1c6a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:11.228761 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfc848-cddb-4c3c-bf06-949b04e1c6a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:11.229042 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfc848-cddb-4c3c-bf06-949b04e1c6a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:11.238521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfc848-cddb-4c3c-bf06-949b04e1c6a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:03:11.239978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfc848-cddb-4c3c-bf06-949b04e1c6a0 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:03:11.249860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 731/1484] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:03:13.568960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826e66c-972b-42b0-a94c-e0cfc925982e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:13.569547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826e66c-972b-42b0-a94c-e0cfc925982e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:13.569547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826e66c-972b-42b0-a94c-e0cfc925982e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:13.570867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 754/1485] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:03:13.575991 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6753e8-390b-4493-81fd-a666f8365a70 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:13.576984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6753e8-390b-4493-81fd-a666f8365a70 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:13.577134 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6753e8-390b-4493-81fd-a666f8365a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:13.595023 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1b6753e8-390b-4493-81fd-a666f8365a70 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:03:13.596233 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1b6753e8-390b-4493-81fd-a666f8365a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:03:13.604009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 732/1486] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:03:13.641963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826e66c-972b-42b0-a94c-e0cfc925982e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:03:13.652421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826e66c-972b-42b0-a94c-e0cfc925982e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:03:13.656636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df691b99-f440-47b6-b6bc-444849d8acae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:03:13.657264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df691b99-f440-47b6-b6bc-444849d8acae service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:13.657542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df691b99-f440-47b6-b6bc-444849d8acae service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:13.657815 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df691b99-f440-47b6-b6bc-444849d8acae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:13.666591 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df691b99-f440-47b6-b6bc-444849d8acae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:03:13.668051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df691b99-f440-47b6-b6bc-444849d8acae service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:03:13.677238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 755/1487] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:03:16.078130 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f640e55-6aaf-4d1d-a268-c6c5c856fa76 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:16.078751 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f640e55-6aaf-4d1d-a268-c6c5c856fa76 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:16.078751 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f640e55-6aaf-4d1d-a268-c6c5c856fa76 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:16.080115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 733/1488] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:03:16.085159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc232cf-6dba-442f-a3d4-57990d213344 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:16.085566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc232cf-6dba-442f-a3d4-57990d213344 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:16.085713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc232cf-6dba-442f-a3d4-57990d213344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:16.104606 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7dc232cf-6dba-442f-a3d4-57990d213344 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:03:16.105763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7dc232cf-6dba-442f-a3d4-57990d213344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:03:16.114139 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 756/1489] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:03:16.153420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f640e55-6aaf-4d1d-a268-c6c5c856fa76 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:03:16.164544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f640e55-6aaf-4d1d-a268-c6c5c856fa76 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:03:16.168042 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c211c-63a3-48fc-98c7-02b7830bca00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:03:16.168674 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c211c-63a3-48fc-98c7-02b7830bca00 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:16.168957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c211c-63a3-48fc-98c7-02b7830bca00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:16.169234 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c211c-63a3-48fc-98c7-02b7830bca00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:16.178671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c211c-63a3-48fc-98c7-02b7830bca00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:03:16.180108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c211c-63a3-48fc-98c7-02b7830bca00 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:03:16.190194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 734/1490] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:03:18.805246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd1b2-7cd8-41ec-bbad-eff24035bcd8 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:18.805815 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd1b2-7cd8-41ec-bbad-eff24035bcd8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:18.805815 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd1b2-7cd8-41ec-bbad-eff24035bcd8 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:18.807452 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 757/1491] 10.222.0.24 () {54 vars in 926 bytes} [Tue May 17 22:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:03:18.813127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5c2c7-bda6-4ef8-9d9b-bd580aff186f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:18.813547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5c2c7-bda6-4ef8-9d9b-bd580aff186f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:18.813692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5c2c7-bda6-4ef8-9d9b-bd580aff186f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:18.832133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-42b5c2c7-bda6-4ef8-9d9b-bd580aff186f None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:03:18.833305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-42b5c2c7-bda6-4ef8-9d9b-bd580aff186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:03:18.840947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 735/1492] 10.222.0.24 () {58 vars in 1023 bytes} [Tue May 17 22:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:03:18.879892 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdd1b2-7cd8-41ec-bbad-eff24035bcd8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:03:18.891215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdd1b2-7cd8-41ec-bbad-eff24035bcd8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:03:18.894896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7942b5-02d3-4dac-a70b-d20d05398378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:03:18.895659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7942b5-02d3-4dac-a70b-d20d05398378 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:03:18.897675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7942b5-02d3-4dac-a70b-d20d05398378 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:03:18.897675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7942b5-02d3-4dac-a70b-d20d05398378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:03:18.906123 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7942b5-02d3-4dac-a70b-d20d05398378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:03:18.907571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7942b5-02d3-4dac-a70b-d20d05398378 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:03:18.916962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 758/1493] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:05:07.205831 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e07f3b-09d0-49c8-8060-46ff2aaf4ff4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:07.206416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e07f3b-09d0-49c8-8060-46ff2aaf4ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:07.206416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e07f3b-09d0-49c8-8060-46ff2aaf4ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:07.224479 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-93e07f3b-09d0-49c8-8060-46ff2aaf4ff4 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:05:07.226315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-93e07f3b-09d0-49c8-8060-46ff2aaf4ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:05:07.233743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 736/1494] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:05:07.243529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e18f90-1260-424b-975c-ef304c2f0f2d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:07.244045 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e18f90-1260-424b-975c-ef304c2f0f2d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:07.244149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e18f90-1260-424b-975c-ef304c2f0f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:07.261633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a1e18f90-1260-424b-975c-ef304c2f0f2d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:05:07.262827 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a1e18f90-1260-424b-975c-ef304c2f0f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:05:07.270503 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 759/1495] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:05:07.274977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e07f3b-09d0-49c8-8060-46ff2aaf4ff4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:05:07.285279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e07f3b-09d0-49c8-8060-46ff2aaf4ff4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:05:07.289728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024332ae-7ba8-4bac-9b1e-34ceede4359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:05:07.290469 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024332ae-7ba8-4bac-9b1e-34ceede4359c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:07.290751 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024332ae-7ba8-4bac-9b1e-34ceede4359c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:07.291023 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024332ae-7ba8-4bac-9b1e-34ceede4359c admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:07.291794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024332ae-7ba8-4bac-9b1e-34ceede4359c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:05:07.292098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024332ae-7ba8-4bac-9b1e-34ceede4359c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:05:07.293197 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-024332ae-7ba8-4bac-9b1e-34ceede4359c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 22:05:07.293197 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: warnings.warn(msg) May 17 22:05:07.293197 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: May 17 22:05:07.294110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024332ae-7ba8-4bac-9b1e-34ceede4359c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:05:07.305806 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 737/1496] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:05:07.314056 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e18f90-1260-424b-975c-ef304c2f0f2d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:05:07.323021 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e18f90-1260-424b-975c-ef304c2f0f2d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:05:07.328888 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af178b-ca9a-4359-85df-1d2a55d3bec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:05:07.329528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af178b-ca9a-4359-85df-1d2a55d3bec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:07.329802 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af178b-ca9a-4359-85df-1d2a55d3bec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:07.330069 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af178b-ca9a-4359-85df-1d2a55d3bec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:07.330842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af178b-ca9a-4359-85df-1d2a55d3bec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:05:07.332637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: WARNING py.warnings [None req-83af178b-ca9a-4359-85df-1d2a55d3bec5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 22:05:07.332637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: warnings.warn(msg) May 17 22:05:07.332637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: May 17 22:05:07.333811 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af178b-ca9a-4359-85df-1d2a55d3bec5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:05:07.448736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 760/1497] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:05:07 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:05:07.453345 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024332ae-7ba8-4bac-9b1e-34ceede4359c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:05:07.463681 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024332ae-7ba8-4bac-9b1e-34ceede4359c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:05:07.519662 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9562f6-ec92-451e-b1d9-9cfa62722c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:05:07.520334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9562f6-ec92-451e-b1d9-9cfa62722c8a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:07.520621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9562f6-ec92-451e-b1d9-9cfa62722c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:07.520902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9562f6-ec92-451e-b1d9-9cfa62722c8a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:07.521585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9562f6-ec92-451e-b1d9-9cfa62722c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:05:07.522592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-0d9562f6-ec92-451e-b1d9-9cfa62722c8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 22:05:07.522592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: warnings.warn(msg) May 17 22:05:07.522592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: May 17 22:05:07.523832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9562f6-ec92-451e-b1d9-9cfa62722c8a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:05:07.590283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 738/1498] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:05:07 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:05:07.595257 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af178b-ca9a-4359-85df-1d2a55d3bec5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:05:07.605466 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af178b-ca9a-4359-85df-1d2a55d3bec5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:05:07.609981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829376e-8161-43d3-b2fc-0af2ee581b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:05:07.610633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829376e-8161-43d3-b2fc-0af2ee581b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:07.614689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829376e-8161-43d3-b2fc-0af2ee581b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:07.614689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829376e-8161-43d3-b2fc-0af2ee581b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:07.614689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829376e-8161-43d3-b2fc-0af2ee581b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:05:07.614689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: WARNING py.warnings [None req-5829376e-8161-43d3-b2fc-0af2ee581b2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 22:05:07.614689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: warnings.warn(msg) May 17 22:05:07.614689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: May 17 22:05:07.614689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829376e-8161-43d3-b2fc-0af2ee581b2d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:05:07.627635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 761/1499] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:05:07.631569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9562f6-ec92-451e-b1d9-9cfa62722c8a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:05:07.643734 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9562f6-ec92-451e-b1d9-9cfa62722c8a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:05:07.648706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eaaa8-416a-4616-a3fd-f49ee07b8b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:05:07.649406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eaaa8-416a-4616-a3fd-f49ee07b8b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:07.649695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eaaa8-416a-4616-a3fd-f49ee07b8b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:07.650091 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eaaa8-416a-4616-a3fd-f49ee07b8b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:07.650890 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eaaa8-416a-4616-a3fd-f49ee07b8b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:05:07.652381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-af1eaaa8-416a-4616-a3fd-f49ee07b8b99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 22:05:07.652381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: warnings.warn(msg) May 17 22:05:07.652381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: May 17 22:05:07.652836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eaaa8-416a-4616-a3fd-f49ee07b8b99 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:05:07.668252 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 739/1500] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:05:07.672639 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829376e-8161-43d3-b2fc-0af2ee581b2d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:05:07.682627 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829376e-8161-43d3-b2fc-0af2ee581b2d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:05:07.687653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45db81f-e410-4db9-a716-48e4f1679bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:05:07.688519 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45db81f-e410-4db9-a716-48e4f1679bef admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:07.688794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45db81f-e410-4db9-a716-48e4f1679bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:07.689060 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45db81f-e410-4db9-a716-48e4f1679bef admin admin] PATH_INFO: `/v3/projects/1710200567ac40c18b3e3c0a3fdb3fa0/users/5dfff709c33a42cbb63bf91243fd763b/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:07.705281 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45db81f-e410-4db9-a716-48e4f1679bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1710200567ac40c18b3e3c0a3fdb3fa0, user_id=5dfff709c33a42cbb63bf91243fd763b, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:05:07.706316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: WARNING py.warnings [None req-f45db81f-e410-4db9-a716-48e4f1679bef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 22:05:07.706316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: warnings.warn(msg) May 17 22:05:07.706316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: May 17 22:05:07.708246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45db81f-e410-4db9-a716-48e4f1679bef admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:05:07.802268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 762/1501] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:05:07 2022] PUT /identity/v3/projects/1710200567ac40c18b3e3c0a3fdb3fa0/users/5dfff709c33a42cbb63bf91243fd763b/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:05:07.813960 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7268a2-6332-4da2-b8c9-e3c676d87552 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:07.814255 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7268a2-6332-4da2-b8c9-e3c676d87552 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:07.814536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7268a2-6332-4da2-b8c9-e3c676d87552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:07.839997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6e7268a2-6332-4da2-b8c9-e3c676d87552 None None] MFA Rules not processed for user `5dfff709c33a42cbb63bf91243fd763b`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:05:07.841184 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6e7268a2-6332-4da2-b8c9-e3c676d87552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:05:07.902586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 740/1502] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:05:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:05:07.916245 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23177149-1b85-41d0-8d93-6bd40404b651 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:07.916541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23177149-1b85-41d0-8d93-6bd40404b651 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:07.916823 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23177149-1b85-41d0-8d93-6bd40404b651 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:07.918195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 763/1503] 10.222.0.24 () {54 vars in 963 bytes} [Tue May 17 22:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:05:07.923791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4bc53-64c1-4385-a787-ec9ed4fc0fd4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:07.924086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4bc53-64c1-4385-a787-ec9ed4fc0fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:07.924366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4bc53-64c1-4385-a787-ec9ed4fc0fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:07.942120 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1fe4bc53-64c1-4385-a787-ec9ed4fc0fd4 None None] MFA Rules not processed for user `f765ee92b36e43478c04db32227a5872`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:05:07.943332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1fe4bc53-64c1-4385-a787-ec9ed4fc0fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:05:07.993394 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 741/1504] 10.222.0.24 () {58 vars in 1060 bytes} [Tue May 17 22:05:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:05:08.002246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23177149-1b85-41d0-8d93-6bd40404b651 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:05:08.012853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23177149-1b85-41d0-8d93-6bd40404b651 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:05:08.016618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bb8bd-9a04-429d-9114-41a39021d325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:05:08.017247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bb8bd-9a04-429d-9114-41a39021d325 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:08.017528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bb8bd-9a04-429d-9114-41a39021d325 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:08.017808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bb8bd-9a04-429d-9114-41a39021d325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:08.025902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bb8bd-9a04-429d-9114-41a39021d325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:05:08.027354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bb8bd-9a04-429d-9114-41a39021d325 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:05:08.036644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 764/1505] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:05:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:05:08.078091 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079a239-059e-4eac-9fb2-317b5dc929fd None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:08.078387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079a239-059e-4eac-9fb2-317b5dc929fd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:08.078670 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079a239-059e-4eac-9fb2-317b5dc929fd None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:08.079987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 742/1506] 10.222.0.24 () {52 vars in 829 bytes} [Tue May 17 22:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:05:08.083574 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bb8bd-9a04-429d-9114-41a39021d325 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:05:08.146715 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bb8bd-9a04-429d-9114-41a39021d325 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:05:08.151134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29593da3-2bc0-4128-99e4-a2e08f792fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:05:08.151995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29593da3-2bc0-4128-99e4-a2e08f792fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:08.152271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29593da3-2bc0-4128-99e4-a2e08f792fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:08.152540 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29593da3-2bc0-4128-99e4-a2e08f792fa5 admin admin] PATH_INFO: `/v3/users/5dfff709c33a42cbb63bf91243fd763b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:08.153709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29593da3-2bc0-4128-99e4-a2e08f792fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dfff709c33a42cbb63bf91243fd763b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:05:08.155807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: WARNING py.warnings [None req-29593da3-2bc0-4128-99e4-a2e08f792fa5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 22:05:08.155807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: warnings.warn(msg) May 17 22:05:08.155807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: May 17 22:05:08.156963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29593da3-2bc0-4128-99e4-a2e08f792fa5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:05:08.326884 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-29593da3-2bc0-4128-99e4-a2e08f792fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dfff709c33a42cbb63bf91243fd763b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:05:08.345173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-29593da3-2bc0-4128-99e4-a2e08f792fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dfff709c33a42cbb63bf91243fd763b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:05:08.412390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-29593da3-2bc0-4128-99e4-a2e08f792fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dfff709c33a42cbb63bf91243fd763b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:05:08.413002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-29593da3-2bc0-4128-99e4-a2e08f792fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dfff709c33a42cbb63bf91243fd763b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:05:08.413721 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-29593da3-2bc0-4128-99e4-a2e08f792fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dfff709c33a42cbb63bf91243fd763b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:05:08.431399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 765/1507] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:05:08 2022] DELETE /identity/v3/users/5dfff709c33a42cbb63bf91243fd763b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:05:08.436902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ac72e-9855-4a95-b52a-ee62bf0fca66 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:08.437382 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ac72e-9855-4a95-b52a-ee62bf0fca66 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:08.437490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ac72e-9855-4a95-b52a-ee62bf0fca66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:08.455006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9a6ac72e-9855-4a95-b52a-ee62bf0fca66 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:05:08.456209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9a6ac72e-9855-4a95-b52a-ee62bf0fca66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:05:08.512341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 743/1508] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:05:08.522412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29593da3-2bc0-4128-99e4-a2e08f792fa5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:05:08.523807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-29593da3-2bc0-4128-99e4-a2e08f792fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:05:08.580391 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29593da3-2bc0-4128-99e4-a2e08f792fa5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:05:08.583870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0930175-1d18-4087-86a0-1d8bec63c7f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:05:08.584508 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0930175-1d18-4087-86a0-1d8bec63c7f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:08.584792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0930175-1d18-4087-86a0-1d8bec63c7f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:08.585066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0930175-1d18-4087-86a0-1d8bec63c7f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:08.593899 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0930175-1d18-4087-86a0-1d8bec63c7f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:05:08.595347 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0930175-1d18-4087-86a0-1d8bec63c7f2 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:05:08.604440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 766/1509] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:05:09.072103 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ac72e-9855-4a95-b52a-ee62bf0fca66 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:05:09.073540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9a6ac72e-9855-4a95-b52a-ee62bf0fca66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:05:09.086071 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ac72e-9855-4a95-b52a-ee62bf0fca66 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:05:09.090802 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21803392-3ba7-402b-8402-fc337fccafba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:05:09.091692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21803392-3ba7-402b-8402-fc337fccafba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:05:09.091980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21803392-3ba7-402b-8402-fc337fccafba admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:05:09.092252 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21803392-3ba7-402b-8402-fc337fccafba admin admin] PATH_INFO: `/v3/projects/1710200567ac40c18b3e3c0a3fdb3fa0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:05:09.093443 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21803392-3ba7-402b-8402-fc337fccafba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1710200567ac40c18b3e3c0a3fdb3fa0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:05:09.094454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-21803392-3ba7-402b-8402-fc337fccafba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 22:05:09.094454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: warnings.warn(msg) May 17 22:05:09.094454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: May 17 22:05:09.095763 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21803392-3ba7-402b-8402-fc337fccafba admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:05:09.206343 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21803392-3ba7-402b-8402-fc337fccafba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1710200567ac40c18b3e3c0a3fdb3fa0', 'request_id': 'req-21803392-3ba7-402b-8402-fc337fccafba'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:05:09.281825 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21803392-3ba7-402b-8402-fc337fccafba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1710200567ac40c18b3e3c0a3fdb3fa0', 'request_id': 'req-21803392-3ba7-402b-8402-fc337fccafba'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:05:09.287963 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21803392-3ba7-402b-8402-fc337fccafba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1710200567ac40c18b3e3c0a3fdb3fa0', 'request_id': 'req-21803392-3ba7-402b-8402-fc337fccafba'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:05:09.306831 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21803392-3ba7-402b-8402-fc337fccafba admin admin] The token cache is being invalidate because project 1710200567ac40c18b3e3c0a3fdb3fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:05:09.307135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21803392-3ba7-402b-8402-fc337fccafba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:05:09.308114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21803392-3ba7-402b-8402-fc337fccafba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:05:09.309721 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 744/1510] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:05:09 2022] DELETE /identity/v3/projects/1710200567ac40c18b3e3c0a3fdb3fa0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:06:50.997942 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d2803-5e4f-4614-a177-f4b49ee75331 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:06:50.998540 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d2803-5e4f-4614-a177-f4b49ee75331 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:06:50.998540 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d2803-5e4f-4614-a177-f4b49ee75331 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:06:50.999886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 767/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 22:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:06:51.004661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f4ad5-91aa-49f3-8539-50df677f110b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:06:51.005122 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f4ad5-91aa-49f3-8539-50df677f110b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:06:51.005228 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f4ad5-91aa-49f3-8539-50df677f110b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:06:51.024289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4c0f4ad5-91aa-49f3-8539-50df677f110b None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:06:51.025508 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4c0f4ad5-91aa-49f3-8539-50df677f110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:06:51.084668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 745/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 22:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:06:51.256094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d2803-5e4f-4614-a177-f4b49ee75331 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:06:51.257750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-717d2803-5e4f-4614-a177-f4b49ee75331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:06:51.331402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d2803-5e4f-4614-a177-f4b49ee75331 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:06:51.336731 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8822388-947f-4ee5-998f-8181eb1237d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:06:51.337388 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822388-947f-4ee5-998f-8181eb1237d1 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:06:51.337675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822388-947f-4ee5-998f-8181eb1237d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:06:51.337951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822388-947f-4ee5-998f-8181eb1237d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:06:51.345930 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8822388-947f-4ee5-998f-8181eb1237d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:06:51.347546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8822388-947f-4ee5-998f-8181eb1237d1 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:06:51.356801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 768/1513] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:06:51.957300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899687c5-eb8a-4e79-b69b-3810b210f75c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:06:51.957592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899687c5-eb8a-4e79-b69b-3810b210f75c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:06:51.957874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899687c5-eb8a-4e79-b69b-3810b210f75c None None] PATH_INFO: `/v3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:06:51.959221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 746/1514] 10.222.0.52 () {54 vars in 925 bytes} [Tue May 17 22:06:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:06:51.966881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7896297-5c5c-41d2-8d34-b58f99e1063d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:06:51.967346 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7896297-5c5c-41d2-8d34-b58f99e1063d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:06:51.967694 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7896297-5c5c-41d2-8d34-b58f99e1063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:06:51.992297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b7896297-5c5c-41d2-8d34-b58f99e1063d None None] MFA Rules not processed for user `2cbd89f9b7a24b6cb993ca86e964c54d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:06:51.994078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b7896297-5c5c-41d2-8d34-b58f99e1063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:06:52.189112 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 769/1515] 10.222.0.52 () {58 vars in 1015 bytes} [Tue May 17 22:06:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:06:52.299374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a7b63-3b9b-400c-b076-3d5598621c3e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:06:52.299966 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a7b63-3b9b-400c-b076-3d5598621c3e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:06:52.299966 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a7b63-3b9b-400c-b076-3d5598621c3e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:06:52.301296 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 747/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 22:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:06:52.306213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3f130-9826-4511-bddb-1cb541e714fb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:06:52.306533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3f130-9826-4511-bddb-1cb541e714fb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:06:52.306808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3f130-9826-4511-bddb-1cb541e714fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:06:52.325619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-60a3f130-9826-4511-bddb-1cb541e714fb None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:06:52.326792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-60a3f130-9826-4511-bddb-1cb541e714fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:06:52.334448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 770/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 22:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:06:52.486912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a7b63-3b9b-400c-b076-3d5598621c3e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:06:52.501481 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a7b63-3b9b-400c-b076-3d5598621c3e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:06:52.506953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668a98e-e439-41e6-bd09-cc43bc86a06e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:06:52.507625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668a98e-e439-41e6-bd09-cc43bc86a06e service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:06:52.507906 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668a98e-e439-41e6-bd09-cc43bc86a06e service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:06:52.508178 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668a98e-e439-41e6-bd09-cc43bc86a06e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:06:52.517075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668a98e-e439-41e6-bd09-cc43bc86a06e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:06:52.518651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668a98e-e439-41e6-bd09-cc43bc86a06e service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:06:52.528639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 748/1518] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:06:56.270628 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb83b9-8a2e-48ab-9f41-6ddc2a4a889c None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:06:56.271202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb83b9-8a2e-48ab-9f41-6ddc2a4a889c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:06:56.271202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb83b9-8a2e-48ab-9f41-6ddc2a4a889c None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:06:56.272524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 771/1519] 10.222.0.24 () {54 vars in 960 bytes} [Tue May 17 22:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:06:56.277778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dd23c-55d2-4f8c-8a9c-e3be536400b0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:06:56.278216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dd23c-55d2-4f8c-8a9c-e3be536400b0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:06:56.278365 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dd23c-55d2-4f8c-8a9c-e3be536400b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:06:56.296988 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0f0dd23c-55d2-4f8c-8a9c-e3be536400b0 None None] MFA Rules not processed for user `2cbd89f9b7a24b6cb993ca86e964c54d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:06:56.298195 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0f0dd23c-55d2-4f8c-8a9c-e3be536400b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:06:56.306956 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 749/1520] 10.222.0.24 () {58 vars in 1057 bytes} [Tue May 17 22:06:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:06:56.316903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb83b9-8a2e-48ab-9f41-6ddc2a4a889c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:06:56.329936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb83b9-8a2e-48ab-9f41-6ddc2a4a889c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:06:56.334773 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1be66-200c-4e2a-aee1-2c81c1da494b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cbd89f9b7a24b6cb993ca86e964c54d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:06:56.335429 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1be66-200c-4e2a-aee1-2c81c1da494b service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:06:56.335707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1be66-200c-4e2a-aee1-2c81c1da494b service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:06:56.335979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1be66-200c-4e2a-aee1-2c81c1da494b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:06:56.344063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1be66-200c-4e2a-aee1-2c81c1da494b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:06:56.345654 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1be66-200c-4e2a-aee1-2c81c1da494b service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:06:56.355691 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 772/1521] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:06:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:07:03.826194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139f188-40f1-4336-a60c-312ba93d99ef None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:03.826785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139f188-40f1-4336-a60c-312ba93d99ef None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:03.826785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139f188-40f1-4336-a60c-312ba93d99ef None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:03.828165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 750/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 22:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:07:03.833013 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8add062-d047-43d1-bbc2-cb73955c2770 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:03.833443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8add062-d047-43d1-bbc2-cb73955c2770 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:03.833550 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8add062-d047-43d1-bbc2-cb73955c2770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:03.850943 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f8add062-d047-43d1-bbc2-cb73955c2770 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:07:03.852137 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f8add062-d047-43d1-bbc2-cb73955c2770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:07:03.860313 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 773/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 22:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:07:04.014937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139f188-40f1-4336-a60c-312ba93d99ef None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:07:04.030096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139f188-40f1-4336-a60c-312ba93d99ef None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:07:04.037910 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9259a3-1355-46f3-b730-610e9e63bc0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:07:04.038560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9259a3-1355-46f3-b730-610e9e63bc0c service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:04.038847 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9259a3-1355-46f3-b730-610e9e63bc0c service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:04.039156 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9259a3-1355-46f3-b730-610e9e63bc0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:04.048825 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9259a3-1355-46f3-b730-610e9e63bc0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:07:04.051752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9259a3-1355-46f3-b730-610e9e63bc0c service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:07:04.060135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 751/1524] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:07:04.965912 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc380ad5-0213-4409-8823-cb20a31a2a7e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:04.966443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc380ad5-0213-4409-8823-cb20a31a2a7e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:04.966443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc380ad5-0213-4409-8823-cb20a31a2a7e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:04.967989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 774/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 22:07:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:07:04.972615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d62d8-e08c-4cbf-a6d5-8543bcc0635f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:04.973117 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d62d8-e08c-4cbf-a6d5-8543bcc0635f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:04.973289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d62d8-e08c-4cbf-a6d5-8543bcc0635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:04.991061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f44d62d8-e08c-4cbf-a6d5-8543bcc0635f None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:07:04.992258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f44d62d8-e08c-4cbf-a6d5-8543bcc0635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:07:05.000141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 752/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 22:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:07:05.150305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc380ad5-0213-4409-8823-cb20a31a2a7e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:07:05.164380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc380ad5-0213-4409-8823-cb20a31a2a7e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:07:05.170283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b55577-b5f7-4f9f-9f1d-8463324d1b46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:07:05.170910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b55577-b5f7-4f9f-9f1d-8463324d1b46 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:05.171225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b55577-b5f7-4f9f-9f1d-8463324d1b46 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:05.171506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b55577-b5f7-4f9f-9f1d-8463324d1b46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:05.179484 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b55577-b5f7-4f9f-9f1d-8463324d1b46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:07:05.181050 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b55577-b5f7-4f9f-9f1d-8463324d1b46 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:07:05.191146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 775/1527] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:07:09.363842 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f5b70-f379-414b-bad7-9dc7e6ff7e34 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:09.364409 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f5b70-f379-414b-bad7-9dc7e6ff7e34 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:09.364409 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f5b70-f379-414b-bad7-9dc7e6ff7e34 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:09.365779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 753/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 22:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:07:09.371488 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f571f7-29af-4deb-81be-05b34c1a9368 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:09.372283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f571f7-29af-4deb-81be-05b34c1a9368 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:09.372591 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f571f7-29af-4deb-81be-05b34c1a9368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:09.390651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-81f571f7-29af-4deb-81be-05b34c1a9368 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:07:09.391876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-81f571f7-29af-4deb-81be-05b34c1a9368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:07:09.399554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 776/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 22:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:07:09.436505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f5b70-f379-414b-bad7-9dc7e6ff7e34 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:07:09.438205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f61f5b70-f379-414b-bad7-9dc7e6ff7e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:07:09.493090 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f5b70-f379-414b-bad7-9dc7e6ff7e34 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:07:09.497131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29505b66-bee5-4dd3-81a4-19d837c7cb3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:07:09.497759 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29505b66-bee5-4dd3-81a4-19d837c7cb3d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:09.498038 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29505b66-bee5-4dd3-81a4-19d837c7cb3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:09.498314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29505b66-bee5-4dd3-81a4-19d837c7cb3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:09.506932 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29505b66-bee5-4dd3-81a4-19d837c7cb3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:07:09.508362 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29505b66-bee5-4dd3-81a4-19d837c7cb3d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:07:09.518016 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 754/1530] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:07:11.737820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513485b1-afac-47b3-93b1-f2fdf1be97c4 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:11.738390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513485b1-afac-47b3-93b1-f2fdf1be97c4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:11.738390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513485b1-afac-47b3-93b1-f2fdf1be97c4 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:11.739804 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 777/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 22:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:07:11.745204 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd05d5d-451b-4ebc-a399-552567f3b7cf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:11.745729 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd05d5d-451b-4ebc-a399-552567f3b7cf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:11.745970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd05d5d-451b-4ebc-a399-552567f3b7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:11.763963 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ebd05d5d-451b-4ebc-a399-552567f3b7cf None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:07:11.765183 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ebd05d5d-451b-4ebc-a399-552567f3b7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:07:11.773009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 755/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 22:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:07:11.809619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513485b1-afac-47b3-93b1-f2fdf1be97c4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:07:11.820171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513485b1-afac-47b3-93b1-f2fdf1be97c4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:07:11.823678 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb496abf-d843-4239-9b6b-55ea3ac48026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:07:11.824818 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb496abf-d843-4239-9b6b-55ea3ac48026 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:11.825096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb496abf-d843-4239-9b6b-55ea3ac48026 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:11.825367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb496abf-d843-4239-9b6b-55ea3ac48026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:11.834050 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb496abf-d843-4239-9b6b-55ea3ac48026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:07:11.835555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb496abf-d843-4239-9b6b-55ea3ac48026 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:07:11.845417 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 778/1533] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:07:15.529938 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d79c8-b0c3-4e35-8536-445203efaf06 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:15.530516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d79c8-b0c3-4e35-8536-445203efaf06 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:15.530516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d79c8-b0c3-4e35-8536-445203efaf06 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:15.531900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 756/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 22:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:07:15.537154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3781875-2d39-4ddc-8e97-93e80e794ee2 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:15.537601 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3781875-2d39-4ddc-8e97-93e80e794ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:15.537716 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3781875-2d39-4ddc-8e97-93e80e794ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:15.555743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c3781875-2d39-4ddc-8e97-93e80e794ee2 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:07:15.556916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c3781875-2d39-4ddc-8e97-93e80e794ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:07:15.564887 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 779/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 22:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:07:15.840155 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d79c8-b0c3-4e35-8536-445203efaf06 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:07:15.841817 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ed1d79c8-b0c3-4e35-8536-445203efaf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:07:15.897176 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d79c8-b0c3-4e35-8536-445203efaf06 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:07:15.900607 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce148fc-1a7a-40a4-b575-56dd92f720e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:07:15.901238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce148fc-1a7a-40a4-b575-56dd92f720e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:15.901519 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce148fc-1a7a-40a4-b575-56dd92f720e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:15.901791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce148fc-1a7a-40a4-b575-56dd92f720e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:15.911187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce148fc-1a7a-40a4-b575-56dd92f720e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:07:15.912628 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce148fc-1a7a-40a4-b575-56dd92f720e6 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:07:15.922687 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 757/1536] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:07:18.215851 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507430b-3e6f-459f-8b8e-6650e5d8ebcf None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:18.216399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507430b-3e6f-459f-8b8e-6650e5d8ebcf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:18.216399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507430b-3e6f-459f-8b8e-6650e5d8ebcf None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:18.217688 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 780/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 22:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:07:18.222820 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2a43b-0664-452a-a179-d2bcb374c0aa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:18.223378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2a43b-0664-452a-a179-d2bcb374c0aa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:18.223489 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2a43b-0664-452a-a179-d2bcb374c0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:18.241101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4de2a43b-0664-452a-a179-d2bcb374c0aa None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:07:18.242293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4de2a43b-0664-452a-a179-d2bcb374c0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:07:18.250784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 758/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 22:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:07:18.524949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507430b-3e6f-459f-8b8e-6650e5d8ebcf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:07:18.526671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3507430b-3e6f-459f-8b8e-6650e5d8ebcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:07:18.539368 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507430b-3e6f-459f-8b8e-6650e5d8ebcf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:07:18.543397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88c9e9-9423-4019-9b57-548c1d60d950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:07:18.544019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88c9e9-9423-4019-9b57-548c1d60d950 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:07:18.544298 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88c9e9-9423-4019-9b57-548c1d60d950 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:07:18.544567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88c9e9-9423-4019-9b57-548c1d60d950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:07:18.553133 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88c9e9-9423-4019-9b57-548c1d60d950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:07:18.554539 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88c9e9-9423-4019-9b57-548c1d60d950 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:07:18.564427 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 781/1539] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:08:50.072611 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4251-2811-4441-85ea-95795c15a2db None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.073740 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4251-2811-4441-85ea-95795c15a2db None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.074269 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4251-2811-4441-85ea-95795c15a2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.104119 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-323f4251-2811-4441-85ea-95795c15a2db None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:50.105707 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-323f4251-2811-4441-85ea-95795c15a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:50.115263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 759/1540] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:50.128126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b307ef-1f4f-48ed-bf79-09ad8293354d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.128363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dc357-73d5-42b3-b057-c8eba15d1ca8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.128833 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dc357-73d5-42b3-b057-c8eba15d1ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.128833 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dc357-73d5-42b3-b057-c8eba15d1ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.129470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b307ef-1f4f-48ed-bf79-09ad8293354d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.129979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b307ef-1f4f-48ed-bf79-09ad8293354d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.156401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-42b307ef-1f4f-48ed-bf79-09ad8293354d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:50.157537 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-42b307ef-1f4f-48ed-bf79-09ad8293354d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:50.158561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d27dc357-73d5-42b3-b057-c8eba15d1ca8 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:50.159778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d27dc357-73d5-42b3-b057-c8eba15d1ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:50.173655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 760/1541] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:50.175004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 782/1542] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:50.175160 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2ea67-f2a4-455e-9cf3-7ee729268fa6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.175349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2ea67-f2a4-455e-9cf3-7ee729268fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.175626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2ea67-f2a4-455e-9cf3-7ee729268fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.181486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dc357-73d5-42b3-b057-c8eba15d1ca8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:50.192841 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dc357-73d5-42b3-b057-c8eba15d1ca8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:50.207407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b5e2ea67-f2a4-455e-9cf3-7ee729268fa6 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:50.208616 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b5e2ea67-f2a4-455e-9cf3-7ee729268fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:50.209593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661eb229-be77-4905-bc53-a84fcd6cfd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:50.210271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eb229-be77-4905-bc53-a84fcd6cfd85 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.210544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eb229-be77-4905-bc53-a84fcd6cfd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.210844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eb229-be77-4905-bc53-a84fcd6cfd85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.211679 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661eb229-be77-4905-bc53-a84fcd6cfd85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:08:50.211986 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661eb229-be77-4905-bc53-a84fcd6cfd85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:50.213010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: WARNING py.warnings [None req-661eb229-be77-4905-bc53-a84fcd6cfd85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 22:08:50.213010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: warnings.warn(msg) May 17 22:08:50.213010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: May 17 22:08:50.213885 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661eb229-be77-4905-bc53-a84fcd6cfd85 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:50.233605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 761/1543] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:50.234919 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2edb0a-0e1a-42d4-a413-e7edb1452d29 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.239002 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2edb0a-0e1a-42d4-a413-e7edb1452d29 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.239576 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2edb0a-0e1a-42d4-a413-e7edb1452d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.239930 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 783/1544] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:08:50.241333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45dcc-e02d-4f30-be1a-e48e4dbe6c57 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.241674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45dcc-e02d-4f30-be1a-e48e4dbe6c57 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.241954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45dcc-e02d-4f30-be1a-e48e4dbe6c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.271859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ee2edb0a-0e1a-42d4-a413-e7edb1452d29 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:50.273065 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ee2edb0a-0e1a-42d4-a413-e7edb1452d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:50.280594 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-69b45dcc-e02d-4f30-be1a-e48e4dbe6c57 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:50.281774 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-69b45dcc-e02d-4f30-be1a-e48e4dbe6c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:50.292952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 762/1545] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:50.294550 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714dca-2063-4893-b138-b46d54395c1b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.295075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714dca-2063-4893-b138-b46d54395c1b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.295603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714dca-2063-4893-b138-b46d54395c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.305269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 784/1546] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:50.306573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b45dcc-e02d-4f30-be1a-e48e4dbe6c57 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:50.324769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b45dcc-e02d-4f30-be1a-e48e4dbe6c57 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:50.340738 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e0714dca-2063-4893-b138-b46d54395c1b None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:50.342464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e0714dca-2063-4893-b138-b46d54395c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:50.345748 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f30d35-0e9e-438f-af30-eed27258a2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:50.345748 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f30d35-0e9e-438f-af30-eed27258a2ff admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.345748 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f30d35-0e9e-438f-af30-eed27258a2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.345748 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f30d35-0e9e-438f-af30-eed27258a2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.346236 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f30d35-0e9e-438f-af30-eed27258a2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:50.351135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f30d35-0e9e-438f-af30-eed27258a2ff admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:50.368769 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 763/1547] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:50.370016 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714dca-2063-4893-b138-b46d54395c1b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:50.384611 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714dca-2063-4893-b138-b46d54395c1b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:50.394824 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886da02f-be1e-4786-ba0f-251842b388bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:50.405944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886da02f-be1e-4786-ba0f-251842b388bb admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.405944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886da02f-be1e-4786-ba0f-251842b388bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.405944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886da02f-be1e-4786-ba0f-251842b388bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.405944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886da02f-be1e-4786-ba0f-251842b388bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:08:50.405944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886da02f-be1e-4786-ba0f-251842b388bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:50.405944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886da02f-be1e-4786-ba0f-251842b388bb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:50.425922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 764/1548] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:08:50.427702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbc945-8d54-4776-97a1-49a5e0d09b4a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.428242 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbc945-8d54-4776-97a1-49a5e0d09b4a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.431870 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbc945-8d54-4776-97a1-49a5e0d09b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.460416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-49dbc945-8d54-4776-97a1-49a5e0d09b4a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:50.462594 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-49dbc945-8d54-4776-97a1-49a5e0d09b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:50.477960 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 765/1549] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:50.479219 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbc945-8d54-4776-97a1-49a5e0d09b4a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:50.494142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbc945-8d54-4776-97a1-49a5e0d09b4a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:50.499256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 785/1550] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/projects => generated 389 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:50.499256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f30d35-0e9e-438f-af30-eed27258a2ff admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:50.561250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1ec6-a90d-40a8-a18d-758e80c505e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:50.562324 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1ec6-a90d-40a8-a18d-758e80c505e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.562836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1ec6-a90d-40a8-a18d-758e80c505e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.563401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1ec6-a90d-40a8-a18d-758e80c505e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.564362 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd1ec6-a90d-40a8-a18d-758e80c505e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:08:50.564908 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd1ec6-a90d-40a8-a18d-758e80c505e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:50.566765 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd1ec6-a90d-40a8-a18d-758e80c505e6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:50.582075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 766/1551] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:08:50.582538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f30d35-0e9e-438f-af30-eed27258a2ff admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:50.583761 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1ec6-a90d-40a8-a18d-758e80c505e6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:50.588161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647b39f-13c2-49fb-b696-f5755fdd5f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:50.588881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647b39f-13c2-49fb-b696-f5755fdd5f27 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.589169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647b39f-13c2-49fb-b696-f5755fdd5f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.589444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647b39f-13c2-49fb-b696-f5755fdd5f27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.590614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647b39f-13c2-49fb-b696-f5755fdd5f27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:50.592650 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647b39f-13c2-49fb-b696-f5755fdd5f27 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:50.595674 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1ec6-a90d-40a8-a18d-758e80c505e6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:50.602691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8eb50d-fd59-4b05-8618-5986f34c39b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:50.602691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8eb50d-fd59-4b05-8618-5986f34c39b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.602965 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8eb50d-fd59-4b05-8618-5986f34c39b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.603570 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8eb50d-fd59-4b05-8618-5986f34c39b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.604022 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8eb50d-fd59-4b05-8618-5986f34c39b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:08:50.604341 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8eb50d-fd59-4b05-8618-5986f34c39b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:50.605934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8eb50d-fd59-4b05-8618-5986f34c39b5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:50.618815 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 767/1552] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:08:50.620150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b021a-0e2b-4a3f-964c-e9743e91606e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.620370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b021a-0e2b-4a3f-964c-e9743e91606e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.620648 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b021a-0e2b-4a3f-964c-e9743e91606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.637898 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0c6b021a-0e2b-4a3f-964c-e9743e91606e None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:50.639075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0c6b021a-0e2b-4a3f-964c-e9743e91606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:50.646833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 768/1553] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:50.647593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b021a-0e2b-4a3f-964c-e9743e91606e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:50.657028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b021a-0e2b-4a3f-964c-e9743e91606e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:50.661470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac59185-4e05-4ceb-9750-033f6a2d3822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:50.662107 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac59185-4e05-4ceb-9750-033f6a2d3822 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.662392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac59185-4e05-4ceb-9750-033f6a2d3822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.662672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac59185-4e05-4ceb-9750-033f6a2d3822 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.663381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac59185-4e05-4ceb-9750-033f6a2d3822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:50.665518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac59185-4e05-4ceb-9750-033f6a2d3822 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:50.696492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 786/1554] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:50.697967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a5bed-8195-4368-abf3-9dc1e4260c8b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.698259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a5bed-8195-4368-abf3-9dc1e4260c8b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.698535 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a5bed-8195-4368-abf3-9dc1e4260c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.716251 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1e7a5bed-8195-4368-abf3-9dc1e4260c8b None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:50.720840 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1e7a5bed-8195-4368-abf3-9dc1e4260c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:50.779337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 769/1555] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:50.779949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 787/1556] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:50.780600 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a5bed-8195-4368-abf3-9dc1e4260c8b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:50.784136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc327c-efdc-441d-89ef-91af6fbe5bab None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.784432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc327c-efdc-441d-89ef-91af6fbe5bab None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.784717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc327c-efdc-441d-89ef-91af6fbe5bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.799394 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a5bed-8195-4368-abf3-9dc1e4260c8b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:50.803702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-90dc327c-efdc-441d-89ef-91af6fbe5bab None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:50.804059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22752501-4dfa-442e-a971-ce56e9264090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:50.804930 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22752501-4dfa-442e-a971-ce56e9264090 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.805068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-90dc327c-efdc-441d-89ef-91af6fbe5bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:50.805310 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22752501-4dfa-442e-a971-ce56e9264090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.805588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22752501-4dfa-442e-a971-ce56e9264090 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.806260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22752501-4dfa-442e-a971-ce56e9264090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:50.808184 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22752501-4dfa-442e-a971-ce56e9264090 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:50.813057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 770/1557] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:50.814381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e191e3-d622-40c5-af83-65b1fd617d93 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.814670 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e191e3-d622-40c5-af83-65b1fd617d93 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.814947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e191e3-d622-40c5-af83-65b1fd617d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.836711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-32e191e3-d622-40c5-af83-65b1fd617d93 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:50.837905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-32e191e3-d622-40c5-af83-65b1fd617d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:50.845684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 771/1558] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:50.846554 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e191e3-d622-40c5-af83-65b1fd617d93 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:50.855740 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e191e3-d622-40c5-af83-65b1fd617d93 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:50.860165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e5bb5-8ef9-4220-957d-16c15d3f1bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:50.860801 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e5bb5-8ef9-4220-957d-16c15d3f1bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.861085 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e5bb5-8ef9-4220-957d-16c15d3f1bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.861360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e5bb5-8ef9-4220-957d-16c15d3f1bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.862046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e5bb5-8ef9-4220-957d-16c15d3f1bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:50.863044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-c25e5bb5-8ef9-4220-957d-16c15d3f1bd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 22:08:50.863044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: warnings.warn(msg) May 17 22:08:50.863044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: May 17 22:08:50.867723 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e5bb5-8ef9-4220-957d-16c15d3f1bd8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:50.919326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 788/1559] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:50.922260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23273b9-b32c-4db1-9ea5-15d95aace60a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:50.922260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23273b9-b32c-4db1-9ea5-15d95aace60a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:50.922260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23273b9-b32c-4db1-9ea5-15d95aace60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:50.947907 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f23273b9-b32c-4db1-9ea5-15d95aace60a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:50.947907 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f23273b9-b32c-4db1-9ea5-15d95aace60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:50.948753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 772/1560] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:50.949558 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e5bb5-8ef9-4220-957d-16c15d3f1bd8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.000667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 789/1561] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:51.001505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23273b9-b32c-4db1-9ea5-15d95aace60a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.009253 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e5bb5-8ef9-4220-957d-16c15d3f1bd8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.010879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23273b9-b32c-4db1-9ea5-15d95aace60a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.013789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1dffd-bc1c-4cc3-b8e0-bf91ad0e9795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.014452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1dffd-bc1c-4cc3-b8e0-bf91ad0e9795 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.014736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1dffd-bc1c-4cc3-b8e0-bf91ad0e9795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.015014 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1dffd-bc1c-4cc3-b8e0-bf91ad0e9795 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.015442 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0831f48-b0ce-4d1f-a468-3a982ab4948e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.015758 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1dffd-bc1c-4cc3-b8e0-bf91ad0e9795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.016218 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0831f48-b0ce-4d1f-a468-3a982ab4948e admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.016505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0831f48-b0ce-4d1f-a468-3a982ab4948e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.016780 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0831f48-b0ce-4d1f-a468-3a982ab4948e admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.017508 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0831f48-b0ce-4d1f-a468-3a982ab4948e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.017651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1dffd-bc1c-4cc3-b8e0-bf91ad0e9795 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.019207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0831f48-b0ce-4d1f-a468-3a982ab4948e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.029908 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 790/1562] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:51.031172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a149e4-50eb-4599-bd7b-2e445d37ab51 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.031491 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a149e4-50eb-4599-bd7b-2e445d37ab51 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.031763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a149e4-50eb-4599-bd7b-2e445d37ab51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.048874 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-46a149e4-50eb-4599-bd7b-2e445d37ab51 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:51.050067 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-46a149e4-50eb-4599-bd7b-2e445d37ab51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:51.058105 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 791/1563] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:51.059716 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a3cd-c345-47ad-8d56-b9f64b76092d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.060006 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a3cd-c345-47ad-8d56-b9f64b76092d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.060280 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a3cd-c345-47ad-8d56-b9f64b76092d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.077543 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6821a3cd-c345-47ad-8d56-b9f64b76092d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:51.078671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6821a3cd-c345-47ad-8d56-b9f64b76092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:51.086917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 792/1564] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:51.092571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d015d-4dc9-4f9d-9a4d-badf230a1360 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.092571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d015d-4dc9-4f9d-9a4d-badf230a1360 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.092571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d015d-4dc9-4f9d-9a4d-badf230a1360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.106330 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-131d015d-4dc9-4f9d-9a4d-badf230a1360 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:51.107541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-131d015d-4dc9-4f9d-9a4d-badf230a1360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:51.115125 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 793/1565] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:51.115876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d015d-4dc9-4f9d-9a4d-badf230a1360 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.120907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 773/1566] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:08:50 2022] POST /identity/v3/users => generated 282 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:51.120907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1dffd-bc1c-4cc3-b8e0-bf91ad0e9795 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.125228 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d015d-4dc9-4f9d-9a4d-badf230a1360 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.129553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1dffd-bc1c-4cc3-b8e0-bf91ad0e9795 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.133367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a4e57-d7c7-470e-9f34-ecf13c4b5d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.133367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a4e57-d7c7-470e-9f34-ecf13c4b5d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.133367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a4e57-d7c7-470e-9f34-ecf13c4b5d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.133367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a4e57-d7c7-470e-9f34-ecf13c4b5d5e admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.134136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a4e57-d7c7-470e-9f34-ecf13c4b5d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.134136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: WARNING py.warnings [None req-4e6a4e57-d7c7-470e-9f34-ecf13c4b5d5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 22:08:51.134136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: warnings.warn(msg) May 17 22:08:51.134136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: May 17 22:08:51.134502 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a4e57-d7c7-470e-9f34-ecf13c4b5d5e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.134815 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b58a7-3c67-4486-80e7-d28b2949d04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.135502 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b58a7-3c67-4486-80e7-d28b2949d04d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.135791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b58a7-3c67-4486-80e7-d28b2949d04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.136070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b58a7-3c67-4486-80e7-d28b2949d04d admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.136758 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b58a7-3c67-4486-80e7-d28b2949d04d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.138789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b58a7-3c67-4486-80e7-d28b2949d04d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.214590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 794/1567] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:08:51 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:51.215506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a4e57-d7c7-470e-9f34-ecf13c4b5d5e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.224871 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a4e57-d7c7-470e-9f34-ecf13c4b5d5e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.225975 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 774/1568] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:08:51 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:51.226662 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b58a7-3c67-4486-80e7-d28b2949d04d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.230206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c83c9-e2ed-4b57-9060-759db80bd150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.230851 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c83c9-e2ed-4b57-9060-759db80bd150 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.231189 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c83c9-e2ed-4b57-9060-759db80bd150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.231469 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c83c9-e2ed-4b57-9060-759db80bd150 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.232192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c83c9-e2ed-4b57-9060-759db80bd150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:08:51.232495 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c83c9-e2ed-4b57-9060-759db80bd150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.234088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c83c9-e2ed-4b57-9060-759db80bd150 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.236154 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b58a7-3c67-4486-80e7-d28b2949d04d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.240709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734da8b-5c5a-46a5-95ba-bc2eb47dfe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.242868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734da8b-5c5a-46a5-95ba-bc2eb47dfe2a admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.242868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734da8b-5c5a-46a5-95ba-bc2eb47dfe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.242868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734da8b-5c5a-46a5-95ba-bc2eb47dfe2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.243313 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734da8b-5c5a-46a5-95ba-bc2eb47dfe2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.244910 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734da8b-5c5a-46a5-95ba-bc2eb47dfe2a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.246903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 795/1569] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:08:51.247809 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c83c9-e2ed-4b57-9060-759db80bd150 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.257314 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c83c9-e2ed-4b57-9060-759db80bd150 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.263974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 775/1570] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:51.263974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734da8b-5c5a-46a5-95ba-bc2eb47dfe2a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.265915 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262f97e-b645-4ddc-a7bf-94b44c3d8af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.266426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f97e-b645-4ddc-a7bf-94b44c3d8af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.266898 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f97e-b645-4ddc-a7bf-94b44c3d8af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.267232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f97e-b645-4ddc-a7bf-94b44c3d8af8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.267955 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262f97e-b645-4ddc-a7bf-94b44c3d8af8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:08:51.268257 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262f97e-b645-4ddc-a7bf-94b44c3d8af8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.269856 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262f97e-b645-4ddc-a7bf-94b44c3d8af8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.271448 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734da8b-5c5a-46a5-95ba-bc2eb47dfe2a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.276370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb7192-31fc-4b1b-8a5b-98ff57c86dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.277064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb7192-31fc-4b1b-8a5b-98ff57c86dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.277346 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb7192-31fc-4b1b-8a5b-98ff57c86dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.277618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb7192-31fc-4b1b-8a5b-98ff57c86dcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.278329 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb7192-31fc-4b1b-8a5b-98ff57c86dcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:08:51.278631 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb7192-31fc-4b1b-8a5b-98ff57c86dcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.280212 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb7192-31fc-4b1b-8a5b-98ff57c86dcd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.281502 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 796/1571] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:08:51.282101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262f97e-b645-4ddc-a7bf-94b44c3d8af8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.291356 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262f97e-b645-4ddc-a7bf-94b44c3d8af8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.295846 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e38d6-e2d1-4be1-a195-498a4176bf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.296477 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e38d6-e2d1-4be1-a195-498a4176bf90 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.296757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e38d6-e2d1-4be1-a195-498a4176bf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.297028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e38d6-e2d1-4be1-a195-498a4176bf90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.297735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e38d6-e2d1-4be1-a195-498a4176bf90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:08:51.298038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e38d6-e2d1-4be1-a195-498a4176bf90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.306764 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 776/1572] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:08:51.306934 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e38d6-e2d1-4be1-a195-498a4176bf90 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.307056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb7192-31fc-4b1b-8a5b-98ff57c86dcd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.312875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 797/1573] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:08:51.313201 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e38d6-e2d1-4be1-a195-498a4176bf90 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.316475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb7192-31fc-4b1b-8a5b-98ff57c86dcd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.321955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea331c-1dbf-48b1-8d5a-15454c346722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.322621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea331c-1dbf-48b1-8d5a-15454c346722 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.322906 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea331c-1dbf-48b1-8d5a-15454c346722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.323223 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea331c-1dbf-48b1-8d5a-15454c346722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.323324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e38d6-e2d1-4be1-a195-498a4176bf90 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.323953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea331c-1dbf-48b1-8d5a-15454c346722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.325564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea331c-1dbf-48b1-8d5a-15454c346722 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.327756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52f38d-964d-484a-9939-86d2108e3b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.328383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52f38d-964d-484a-9939-86d2108e3b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.328661 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52f38d-964d-484a-9939-86d2108e3b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.328931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52f38d-964d-484a-9939-86d2108e3b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.329897 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52f38d-964d-484a-9939-86d2108e3b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.331487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52f38d-964d-484a-9939-86d2108e3b95 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.335801 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 777/1574] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:51.336590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea331c-1dbf-48b1-8d5a-15454c346722 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.341235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 798/1575] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:51.342206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52f38d-964d-484a-9939-86d2108e3b95 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.348843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea331c-1dbf-48b1-8d5a-15454c346722 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.351208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52f38d-964d-484a-9939-86d2108e3b95 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.353611 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bf6f3-5e63-4103-9936-7345207e01e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.354280 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bf6f3-5e63-4103-9936-7345207e01e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.354568 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bf6f3-5e63-4103-9936-7345207e01e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.354843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bf6f3-5e63-4103-9936-7345207e01e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.355603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bf6f3-5e63-4103-9936-7345207e01e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.356267 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96814b1-1848-405c-a0f9-6b516c83fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.356881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96814b1-1848-405c-a0f9-6b516c83fb8c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.357159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96814b1-1848-405c-a0f9-6b516c83fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.357256 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bf6f3-5e63-4103-9936-7345207e01e7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.357431 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96814b1-1848-405c-a0f9-6b516c83fb8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.358097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96814b1-1848-405c-a0f9-6b516c83fb8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.359996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96814b1-1848-405c-a0f9-6b516c83fb8c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.366910 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 778/1576] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:51.368348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bf6f3-5e63-4103-9936-7345207e01e7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.379412 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bf6f3-5e63-4103-9936-7345207e01e7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.384744 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d3da0-2fad-4b3b-9750-d13f3f6f75f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.391017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d3da0-2fad-4b3b-9750-d13f3f6f75f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.391017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d3da0-2fad-4b3b-9750-d13f3f6f75f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.391017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d3da0-2fad-4b3b-9750-d13f3f6f75f1 admin admin] PATH_INFO: `/v3/projects/422158a05bcb44c8917cf1a6408cd7ad/users/532092f483874f05bc119211b9624492/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.400435 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d3da0-2fad-4b3b-9750-d13f3f6f75f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=422158a05bcb44c8917cf1a6408cd7ad, user_id=532092f483874f05bc119211b9624492, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.401459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-d95d3da0-2fad-4b3b-9750-d13f3f6f75f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 22:08:51.401459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: warnings.warn(msg) May 17 22:08:51.401459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: May 17 22:08:51.403425 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d3da0-2fad-4b3b-9750-d13f3f6f75f1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.444064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 799/1577] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:08:51 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:51.444861 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96814b1-1848-405c-a0f9-6b516c83fb8c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.471644 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 779/1578] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:08:51 2022] PUT /identity/v3/projects/422158a05bcb44c8917cf1a6408cd7ad/users/532092f483874f05bc119211b9624492/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:08:51.472798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d3da0-2fad-4b3b-9750-d13f3f6f75f1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.505537 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96814b1-1848-405c-a0f9-6b516c83fb8c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.533275 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d3da0-2fad-4b3b-9750-d13f3f6f75f1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.537833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25825dc8-40f0-4ed2-a0e1-235e4689de11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.538529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25825dc8-40f0-4ed2-a0e1-235e4689de11 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.538814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25825dc8-40f0-4ed2-a0e1-235e4689de11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.539266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25825dc8-40f0-4ed2-a0e1-235e4689de11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.540136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25825dc8-40f0-4ed2-a0e1-235e4689de11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.542052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25825dc8-40f0-4ed2-a0e1-235e4689de11 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.560348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc9f21-81ae-4274-ad54-31556066adfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.561005 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc9f21-81ae-4274-ad54-31556066adfb admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.561282 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc9f21-81ae-4274-ad54-31556066adfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.561554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc9f21-81ae-4274-ad54-31556066adfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.562232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc9f21-81ae-4274-ad54-31556066adfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.564150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc9f21-81ae-4274-ad54-31556066adfb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.644446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 780/1579] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:08:51 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:51.645102 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25825dc8-40f0-4ed2-a0e1-235e4689de11 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.656024 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 800/1580] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:08:51 2022] POST /identity/v3/projects => generated 379 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:51.657179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc9f21-81ae-4274-ad54-31556066adfb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.705672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25825dc8-40f0-4ed2-a0e1-235e4689de11 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.717431 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc9f21-81ae-4274-ad54-31556066adfb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.722116 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e5edb-f255-4d73-abfd-000f16520f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.722709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e5edb-f255-4d73-abfd-000f16520f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.722988 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e5edb-f255-4d73-abfd-000f16520f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.723296 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e5edb-f255-4d73-abfd-000f16520f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.724028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e5edb-f255-4d73-abfd-000f16520f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.725621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e5edb-f255-4d73-abfd-000f16520f68 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.736516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 801/1581] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:51.737323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e5edb-f255-4d73-abfd-000f16520f68 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.747713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e5edb-f255-4d73-abfd-000f16520f68 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.752417 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b47a14-5107-4ef7-b31f-6e0a8e8e3cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.753061 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b47a14-5107-4ef7-b31f-6e0a8e8e3cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.753343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b47a14-5107-4ef7-b31f-6e0a8e8e3cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.753622 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b47a14-5107-4ef7-b31f-6e0a8e8e3cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.754340 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b47a14-5107-4ef7-b31f-6e0a8e8e3cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.755950 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b47a14-5107-4ef7-b31f-6e0a8e8e3cf0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.764111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8c5eb-50ef-432e-9282-058d897c73c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.764777 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8c5eb-50ef-432e-9282-058d897c73c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.765098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8c5eb-50ef-432e-9282-058d897c73c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.765379 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8c5eb-50ef-432e-9282-058d897c73c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.766378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8c5eb-50ef-432e-9282-058d897c73c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.766497 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 802/1582] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:51.766941 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b47a14-5107-4ef7-b31f-6e0a8e8e3cf0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.768105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8c5eb-50ef-432e-9282-058d897c73c8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.777059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b47a14-5107-4ef7-b31f-6e0a8e8e3cf0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.781651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358ae59-b587-44f6-b2f3-d8a909a4a291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.782293 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358ae59-b587-44f6-b2f3-d8a909a4a291 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.782573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358ae59-b587-44f6-b2f3-d8a909a4a291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.782847 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358ae59-b587-44f6-b2f3-d8a909a4a291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.783633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358ae59-b587-44f6-b2f3-d8a909a4a291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.785329 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358ae59-b587-44f6-b2f3-d8a909a4a291 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.795094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 803/1583] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:51.795946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358ae59-b587-44f6-b2f3-d8a909a4a291 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.805442 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358ae59-b587-44f6-b2f3-d8a909a4a291 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.810331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968d9b3-4b35-41db-94de-4db0017eccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.810956 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968d9b3-4b35-41db-94de-4db0017eccb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.811371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968d9b3-4b35-41db-94de-4db0017eccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.811652 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968d9b3-4b35-41db-94de-4db0017eccb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.812352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968d9b3-4b35-41db-94de-4db0017eccb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.814207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968d9b3-4b35-41db-94de-4db0017eccb7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.895055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 804/1584] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:08:51 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:51.896859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcbcf6-81f0-41aa-baeb-8e35f0620448 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.897051 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 781/1585] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:08:51 2022] POST /identity/v3/projects => generated 391 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:51.897158 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcbcf6-81f0-41aa-baeb-8e35f0620448 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.897403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcbcf6-81f0-41aa-baeb-8e35f0620448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.898233 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8c5eb-50ef-432e-9282-058d897c73c8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.916199 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b3dcbcf6-81f0-41aa-baeb-8e35f0620448 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:51.917379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b3dcbcf6-81f0-41aa-baeb-8e35f0620448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:51.962077 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8c5eb-50ef-432e-9282-058d897c73c8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.968092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ab48d-ef87-4639-820f-0aa1b44cb3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.968755 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ab48d-ef87-4639-820f-0aa1b44cb3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.969036 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ab48d-ef87-4639-820f-0aa1b44cb3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.969311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ab48d-ef87-4639-820f-0aa1b44cb3d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.970031 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ab48d-ef87-4639-820f-0aa1b44cb3d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.972179 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ab48d-ef87-4639-820f-0aa1b44cb3d5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:51.977165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 805/1586] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:51.977974 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcbcf6-81f0-41aa-baeb-8e35f0620448 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:51.986800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcbcf6-81f0-41aa-baeb-8e35f0620448 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:51.991247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5360a-042e-475f-9325-6c8a213a5dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:51.991895 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5360a-042e-475f-9325-6c8a213a5dca admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:51.992836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5360a-042e-475f-9325-6c8a213a5dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:51.993119 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5360a-042e-475f-9325-6c8a213a5dca admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:51.993906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5360a-042e-475f-9325-6c8a213a5dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:51.995977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5360a-042e-475f-9325-6c8a213a5dca admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.047051 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 782/1587] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:08:51 2022] POST /identity/v3/users => generated 291 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:52.047956 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ab48d-ef87-4639-820f-0aa1b44cb3d5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.057869 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ab48d-ef87-4639-820f-0aa1b44cb3d5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.062610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27cf35-0e74-478c-8d1f-72260e78de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.063573 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27cf35-0e74-478c-8d1f-72260e78de32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.063860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27cf35-0e74-478c-8d1f-72260e78de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.064141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27cf35-0e74-478c-8d1f-72260e78de32 admin admin] PATH_INFO: `/v3/projects/df516acee16049529d2b6f0b86cfbba3/users/1bc46eda09df4715b4f3d8974430ea37/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.079454 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 806/1588] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:08:51 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:52.079454 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5360a-042e-475f-9325-6c8a213a5dca admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.083081 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27cf35-0e74-478c-8d1f-72260e78de32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df516acee16049529d2b6f0b86cfbba3, user_id=1bc46eda09df4715b4f3d8974430ea37, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.083218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27cf35-0e74-478c-8d1f-72260e78de32 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.089083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5360a-042e-475f-9325-6c8a213a5dca admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.093631 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881824b-a442-4e7a-bbbf-0dbe00ae8e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.094493 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881824b-a442-4e7a-bbbf-0dbe00ae8e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.094775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881824b-a442-4e7a-bbbf-0dbe00ae8e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.095049 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881824b-a442-4e7a-bbbf-0dbe00ae8e47 admin admin] PATH_INFO: `/v3/projects/72cf162ce59647cb9f3fd6df3ab3b476/users/dd8433ccaad9436a9c4a7eba3bce5eaf/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.109804 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881824b-a442-4e7a-bbbf-0dbe00ae8e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72cf162ce59647cb9f3fd6df3ab3b476, user_id=dd8433ccaad9436a9c4a7eba3bce5eaf, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.112537 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881824b-a442-4e7a-bbbf-0dbe00ae8e47 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.151747 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 783/1589] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:08:52 2022] PUT /identity/v3/projects/df516acee16049529d2b6f0b86cfbba3/users/1bc46eda09df4715b4f3d8974430ea37/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:08:52.152717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27cf35-0e74-478c-8d1f-72260e78de32 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.178434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 807/1590] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:08:52 2022] PUT /identity/v3/projects/72cf162ce59647cb9f3fd6df3ab3b476/users/dd8433ccaad9436a9c4a7eba3bce5eaf/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:08:52.181961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881824b-a442-4e7a-bbbf-0dbe00ae8e47 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.215409 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27cf35-0e74-478c-8d1f-72260e78de32 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.239619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881824b-a442-4e7a-bbbf-0dbe00ae8e47 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.244659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e64746-c148-4ace-ac39-10a32e079ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.245318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e64746-c148-4ace-ac39-10a32e079ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.245594 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e64746-c148-4ace-ac39-10a32e079ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.245865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e64746-c148-4ace-ac39-10a32e079ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.246580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e64746-c148-4ace-ac39-10a32e079ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.248201 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e64746-c148-4ace-ac39-10a32e079ca3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.258706 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 808/1591] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:52.259644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e64746-c148-4ace-ac39-10a32e079ca3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.268746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e64746-c148-4ace-ac39-10a32e079ca3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.271477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c35a66-d3b9-4bc4-b409-b397be94ab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.272368 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c35a66-d3b9-4bc4-b409-b397be94ab8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.272653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c35a66-d3b9-4bc4-b409-b397be94ab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.272930 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c35a66-d3b9-4bc4-b409-b397be94ab8c admin admin] PATH_INFO: `/v3/projects/fe9b23322633464f975b94a2144fa300/users/626cf3ce22fd4d019022b52e21916a2f/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.273186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed29c6a-9f05-473b-86b5-8552d755d174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.273861 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed29c6a-9f05-473b-86b5-8552d755d174 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.274136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed29c6a-9f05-473b-86b5-8552d755d174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.274526 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed29c6a-9f05-473b-86b5-8552d755d174 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.275228 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed29c6a-9f05-473b-86b5-8552d755d174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.277105 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed29c6a-9f05-473b-86b5-8552d755d174 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.287816 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c35a66-d3b9-4bc4-b409-b397be94ab8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9b23322633464f975b94a2144fa300, user_id=626cf3ce22fd4d019022b52e21916a2f, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.290500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c35a66-d3b9-4bc4-b409-b397be94ab8c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.373181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 809/1592] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:08:52 2022] POST /identity/v3/users => generated 296 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:52.374273 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed29c6a-9f05-473b-86b5-8552d755d174 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.386354 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 784/1593] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:08:52 2022] PUT /identity/v3/projects/fe9b23322633464f975b94a2144fa300/users/626cf3ce22fd4d019022b52e21916a2f/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:08:52.387205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c35a66-d3b9-4bc4-b409-b397be94ab8c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.434198 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed29c6a-9f05-473b-86b5-8552d755d174 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.451874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c35a66-d3b9-4bc4-b409-b397be94ab8c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.456703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a61ce0-e30a-4e5e-bc09-84618140585b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.457463 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a61ce0-e30a-4e5e-bc09-84618140585b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.457662 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a61ce0-e30a-4e5e-bc09-84618140585b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.457946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a61ce0-e30a-4e5e-bc09-84618140585b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.458676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a61ce0-e30a-4e5e-bc09-84618140585b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.460308 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a61ce0-e30a-4e5e-bc09-84618140585b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.470409 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 785/1594] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:52.471276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a61ce0-e30a-4e5e-bc09-84618140585b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.481279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a61ce0-e30a-4e5e-bc09-84618140585b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.485944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fa3da-a593-4ccb-bd70-a73528229dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.486125 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96b71c-4ac6-43a3-9f7f-4d7e25bfa72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.486524 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fa3da-a593-4ccb-bd70-a73528229dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.486749 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96b71c-4ac6-43a3-9f7f-4d7e25bfa72f service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.486874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fa3da-a593-4ccb-bd70-a73528229dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.487063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96b71c-4ac6-43a3-9f7f-4d7e25bfa72f service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.487201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fa3da-a593-4ccb-bd70-a73528229dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.487369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96b71c-4ac6-43a3-9f7f-4d7e25bfa72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.487816 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fa3da-a593-4ccb-bd70-a73528229dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.489414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fa3da-a593-4ccb-bd70-a73528229dd4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.498437 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96b71c-4ac6-43a3-9f7f-4d7e25bfa72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.499827 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96b71c-4ac6-43a3-9f7f-4d7e25bfa72f service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.502803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 786/1595] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:52.504126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766e22d-88f9-4af5-8efe-e27950b57c67 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.504424 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766e22d-88f9-4af5-8efe-e27950b57c67 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.504720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766e22d-88f9-4af5-8efe-e27950b57c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.510454 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 810/1596] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:08:52.511906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c86c3f-ba48-4dd4-b048-58d4033d5b8b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.512200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c86c3f-ba48-4dd4-b048-58d4033d5b8b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.512473 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c86c3f-ba48-4dd4-b048-58d4033d5b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.533986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a766e22d-88f9-4af5-8efe-e27950b57c67 None None] MFA Rules not processed for user `1bc46eda09df4715b4f3d8974430ea37`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:52.535282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a766e22d-88f9-4af5-8efe-e27950b57c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:52.538277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-85c86c3f-ba48-4dd4-b048-58d4033d5b8b None None] MFA Rules not processed for user `dd8433ccaad9436a9c4a7eba3bce5eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:52.539961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-85c86c3f-ba48-4dd4-b048-58d4033d5b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:52.599286 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 787/1597] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:52.600157 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766e22d-88f9-4af5-8efe-e27950b57c67 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.604226 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 811/1598] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:52.605115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c86c3f-ba48-4dd4-b048-58d4033d5b8b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.610738 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766e22d-88f9-4af5-8efe-e27950b57c67 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.615123 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c86c3f-ba48-4dd4-b048-58d4033d5b8b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.615905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd6cd8-5db4-4416-9ac7-aa0f417945e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.616557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd6cd8-5db4-4416-9ac7-aa0f417945e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.616837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd6cd8-5db4-4416-9ac7-aa0f417945e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.617878 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd6cd8-5db4-4416-9ac7-aa0f417945e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.618615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd6cd8-5db4-4416-9ac7-aa0f417945e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.620234 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd6cd8-5db4-4416-9ac7-aa0f417945e7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.620350 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be2a2d-e610-4dd8-97cd-71831f5cd4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.620985 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be2a2d-e610-4dd8-97cd-71831f5cd4dd admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.621269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be2a2d-e610-4dd8-97cd-71831f5cd4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.621802 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be2a2d-e610-4dd8-97cd-71831f5cd4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.622536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be2a2d-e610-4dd8-97cd-71831f5cd4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.624156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be2a2d-e610-4dd8-97cd-71831f5cd4dd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.633986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 788/1599] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:52.633986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd083768-c8ba-4c03-8c74-2c7021dc623d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.633986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd083768-c8ba-4c03-8c74-2c7021dc623d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.633986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd083768-c8ba-4c03-8c74-2c7021dc623d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.641348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 812/1600] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:52.641348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be2a2d-e610-4dd8-97cd-71831f5cd4dd admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.650253 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bd083768-c8ba-4c03-8c74-2c7021dc623d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:52.651250 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be2a2d-e610-4dd8-97cd-71831f5cd4dd admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.651477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bd083768-c8ba-4c03-8c74-2c7021dc623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:52.656415 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66f9a7-47b1-4f4c-ae86-f003f0ad73f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.657143 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66f9a7-47b1-4f4c-ae86-f003f0ad73f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.657407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66f9a7-47b1-4f4c-ae86-f003f0ad73f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.658042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66f9a7-47b1-4f4c-ae86-f003f0ad73f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.658404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66f9a7-47b1-4f4c-ae86-f003f0ad73f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.662433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 789/1601] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:52.662587 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66f9a7-47b1-4f4c-ae86-f003f0ad73f5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.662676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd083768-c8ba-4c03-8c74-2c7021dc623d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.671176 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 813/1602] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:52.672176 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66f9a7-47b1-4f4c-ae86-f003f0ad73f5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.673376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd083768-c8ba-4c03-8c74-2c7021dc623d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.678296 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d5a3-a770-4943-8f80-e05b3009f697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.680577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d5a3-a770-4943-8f80-e05b3009f697 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.680577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d5a3-a770-4943-8f80-e05b3009f697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.680577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d5a3-a770-4943-8f80-e05b3009f697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.681606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03d5a3-a770-4943-8f80-e05b3009f697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.682785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03d5a3-a770-4943-8f80-e05b3009f697 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.684214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66f9a7-47b1-4f4c-ae86-f003f0ad73f5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.689799 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74df09e-44d7-4389-be26-f7d721099ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.690535 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74df09e-44d7-4389-be26-f7d721099ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.690823 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74df09e-44d7-4389-be26-f7d721099ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.691131 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74df09e-44d7-4389-be26-f7d721099ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.691871 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74df09e-44d7-4389-be26-f7d721099ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.694033 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74df09e-44d7-4389-be26-f7d721099ac3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.697851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 790/1603] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:52.697851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d5a3-a770-4943-8f80-e05b3009f697 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.707609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d5a3-a770-4943-8f80-e05b3009f697 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.713208 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979271b-89b1-492c-8c5c-1bcae3188238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.714374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979271b-89b1-492c-8c5c-1bcae3188238 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.714654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979271b-89b1-492c-8c5c-1bcae3188238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.714928 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979271b-89b1-492c-8c5c-1bcae3188238 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.715791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979271b-89b1-492c-8c5c-1bcae3188238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.718965 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979271b-89b1-492c-8c5c-1bcae3188238 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.791693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 814/1604] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:08:52 2022] POST /identity/v3/projects => generated 361 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:52.800203 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74df09e-44d7-4389-be26-f7d721099ac3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.853528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 791/1605] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:08:52 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:52.854740 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979271b-89b1-492c-8c5c-1bcae3188238 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.856114 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74df09e-44d7-4389-be26-f7d721099ac3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.939841 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f8e86-7eb5-482d-a107-b0fab2fcdb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.940750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f8e86-7eb5-482d-a107-b0fab2fcdb4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.941032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f8e86-7eb5-482d-a107-b0fab2fcdb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.941894 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f8e86-7eb5-482d-a107-b0fab2fcdb4b admin admin] PATH_INFO: `/v3/projects/ca080b90bf32462b95adafcc9a524e55/users/ae225ab9c2354ad1a60420e3aca1c036/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.957883 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f8e86-7eb5-482d-a107-b0fab2fcdb4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca080b90bf32462b95adafcc9a524e55, user_id=ae225ab9c2354ad1a60420e3aca1c036, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.958199 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979271b-89b1-492c-8c5c-1bcae3188238 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:52.960581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f8e86-7eb5-482d-a107-b0fab2fcdb4b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.964387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c20656-aa9b-4f33-8e8e-60afba8d2b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:52.965114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c20656-aa9b-4f33-8e8e-60afba8d2b10 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:52.965402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c20656-aa9b-4f33-8e8e-60afba8d2b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:52.965677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c20656-aa9b-4f33-8e8e-60afba8d2b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:52.966438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c20656-aa9b-4f33-8e8e-60afba8d2b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:52.968177 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c20656-aa9b-4f33-8e8e-60afba8d2b10 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:52.978975 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 792/1606] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:52.979881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c20656-aa9b-4f33-8e8e-60afba8d2b10 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:52.981571 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-14c20656-aa9b-4f33-8e8e-60afba8d2b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:53.026810 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 815/1607] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:08:52 2022] PUT /identity/v3/projects/ca080b90bf32462b95adafcc9a524e55/users/ae225ab9c2354ad1a60420e3aca1c036/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:08:53.027687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f8e86-7eb5-482d-a107-b0fab2fcdb4b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:53.039874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c20656-aa9b-4f33-8e8e-60afba8d2b10 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:53.090236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cf2eb-57d8-4911-9f78-ebee91b2fea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:53.092554 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cf2eb-57d8-4911-9f78-ebee91b2fea6 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.092554 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cf2eb-57d8-4911-9f78-ebee91b2fea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.092554 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cf2eb-57d8-4911-9f78-ebee91b2fea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.092839 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f8e86-7eb5-482d-a107-b0fab2fcdb4b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:53.097396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39bcce-8a53-4a18-af72-c3e1bf40c8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:53.098418 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39bcce-8a53-4a18-af72-c3e1bf40c8c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.098738 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39bcce-8a53-4a18-af72-c3e1bf40c8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.099022 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39bcce-8a53-4a18-af72-c3e1bf40c8c2 admin admin] PATH_INFO: `/v3/projects/ea0809b61be446a69359b69b50b61710/users/4bbb6a0a08464e738ef0d062dfe87182/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.101591 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cf2eb-57d8-4911-9f78-ebee91b2fea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:53.103174 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cf2eb-57d8-4911-9f78-ebee91b2fea6 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:53.113271 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 793/1608] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:08:53.113848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cf2eb-57d8-4911-9f78-ebee91b2fea6 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:53.122862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39bcce-8a53-4a18-af72-c3e1bf40c8c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0809b61be446a69359b69b50b61710, user_id=4bbb6a0a08464e738ef0d062dfe87182, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:53.123747 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cf2eb-57d8-4911-9f78-ebee91b2fea6 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:53.127316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39bcce-8a53-4a18-af72-c3e1bf40c8c2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:53.128784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4793f-b3d2-47f4-91ee-a2cec8294ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:53.129672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4793f-b3d2-47f4-91ee-a2cec8294ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.129954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4793f-b3d2-47f4-91ee-a2cec8294ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.130231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4793f-b3d2-47f4-91ee-a2cec8294ccb admin admin] PATH_INFO: `/v3/projects/0d2df1e983894585869358afcafd0fb5/users/35ef7a36ac424aa995c44c9eb90bd1d6/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.147932 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4793f-b3d2-47f4-91ee-a2cec8294ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2df1e983894585869358afcafd0fb5, user_id=35ef7a36ac424aa995c44c9eb90bd1d6, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:53.152981 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4793f-b3d2-47f4-91ee-a2cec8294ccb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:53.201914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 816/1609] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:08:53 2022] PUT /identity/v3/projects/ea0809b61be446a69359b69b50b61710/users/4bbb6a0a08464e738ef0d062dfe87182/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:08:53.201914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39bcce-8a53-4a18-af72-c3e1bf40c8c2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:53.260845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 794/1610] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:08:53 2022] PUT /identity/v3/projects/0d2df1e983894585869358afcafd0fb5/users/35ef7a36ac424aa995c44c9eb90bd1d6/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:08:53.261841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4793f-b3d2-47f4-91ee-a2cec8294ccb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:53.269350 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39bcce-8a53-4a18-af72-c3e1bf40c8c2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:53.334229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05495110-a71c-4ca3-9cb0-aace94d921fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:53.334229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05495110-a71c-4ca3-9cb0-aace94d921fd admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.334572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05495110-a71c-4ca3-9cb0-aace94d921fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.334754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05495110-a71c-4ca3-9cb0-aace94d921fd admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.335780 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05495110-a71c-4ca3-9cb0-aace94d921fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:53.338136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05495110-a71c-4ca3-9cb0-aace94d921fd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:53.343008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4793f-b3d2-47f4-91ee-a2cec8294ccb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:53.347974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fa881-c489-4276-bfc5-d5e6d624201b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:53.348763 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fa881-c489-4276-bfc5-d5e6d624201b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.349108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fa881-c489-4276-bfc5-d5e6d624201b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.349390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fa881-c489-4276-bfc5-d5e6d624201b admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.350091 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fa881-c489-4276-bfc5-d5e6d624201b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:53.352677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fa881-c489-4276-bfc5-d5e6d624201b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:53.461822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 817/1611] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:08:53 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:53.462642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05495110-a71c-4ca3-9cb0-aace94d921fd admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:53.474122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05495110-a71c-4ca3-9cb0-aace94d921fd admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:53.479882 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fdeb3-a2a3-4222-93d5-70d7179d3711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:53.487845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fdeb3-a2a3-4222-93d5-70d7179d3711 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.487845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fdeb3-a2a3-4222-93d5-70d7179d3711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.487845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fdeb3-a2a3-4222-93d5-70d7179d3711 admin admin] PATH_INFO: `/v3/projects/7a0d6701b5d5441eb7eaf815d273d4d9/users/8cc69cd4250c436e8b893887604b2273/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.500678 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fdeb3-a2a3-4222-93d5-70d7179d3711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0d6701b5d5441eb7eaf815d273d4d9, user_id=8cc69cd4250c436e8b893887604b2273, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:53.503357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fdeb3-a2a3-4222-93d5-70d7179d3711 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:53.513079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 795/1612] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:08:53 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:53.514378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aa8c2-6e15-4d96-8bcc-7bfef4c740e2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.514669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aa8c2-6e15-4d96-8bcc-7bfef4c740e2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.514948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aa8c2-6e15-4d96-8bcc-7bfef4c740e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.535885 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e31aa8c2-6e15-4d96-8bcc-7bfef4c740e2 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:53.537256 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e31aa8c2-6e15-4d96-8bcc-7bfef4c740e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:53.549063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 796/1613] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:53.549063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fa46d-4b90-4df5-998d-86df89ee7613 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.549063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fa46d-4b90-4df5-998d-86df89ee7613 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.549063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fa46d-4b90-4df5-998d-86df89ee7613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.568332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-564fa46d-4b90-4df5-998d-86df89ee7613 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:53.569605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-564fa46d-4b90-4df5-998d-86df89ee7613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:53.582058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 797/1614] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:53.582058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd5fa7-f5c7-4253-b78f-3c0dbbd587b3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.582058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd5fa7-f5c7-4253-b78f-3c0dbbd587b3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.582058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd5fa7-f5c7-4253-b78f-3c0dbbd587b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.597313 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 818/1615] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:08:53 2022] PUT /identity/v3/projects/7a0d6701b5d5441eb7eaf815d273d4d9/users/8cc69cd4250c436e8b893887604b2273/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:08:53.597313 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fdeb3-a2a3-4222-93d5-70d7179d3711 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:53.602973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5afd5fa7-f5c7-4253-b78f-3c0dbbd587b3 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:53.604210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5afd5fa7-f5c7-4253-b78f-3c0dbbd587b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:53.659310 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fdeb3-a2a3-4222-93d5-70d7179d3711 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:53.663155 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 798/1616] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:53.664553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd5fa7-f5c7-4253-b78f-3c0dbbd587b3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:53.668393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825c16f-3143-4e1a-81a9-e036b13b035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:53.669169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825c16f-3143-4e1a-81a9-e036b13b035d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.669552 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825c16f-3143-4e1a-81a9-e036b13b035d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.669917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825c16f-3143-4e1a-81a9-e036b13b035d admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.670695 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825c16f-3143-4e1a-81a9-e036b13b035d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:53.672421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825c16f-3143-4e1a-81a9-e036b13b035d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:53.675099 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd5fa7-f5c7-4253-b78f-3c0dbbd587b3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:53.681102 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff37ec7-684f-4ee5-86a8-f0f79cfd349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:53.681971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff37ec7-684f-4ee5-86a8-f0f79cfd349b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.682259 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff37ec7-684f-4ee5-86a8-f0f79cfd349b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.682535 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff37ec7-684f-4ee5-86a8-f0f79cfd349b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.683597 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff37ec7-684f-4ee5-86a8-f0f79cfd349b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:53.685267 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 819/1617] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:53.685914 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff37ec7-684f-4ee5-86a8-f0f79cfd349b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:53.686048 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825c16f-3143-4e1a-81a9-e036b13b035d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:53.699046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 799/1618] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:53.700106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff37ec7-684f-4ee5-86a8-f0f79cfd349b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:53.747086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825c16f-3143-4e1a-81a9-e036b13b035d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:53.751600 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382c221-9b6d-4b93-bb1c-d0a1dc4572ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:53.752000 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382c221-9b6d-4b93-bb1c-d0a1dc4572ec service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.752410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382c221-9b6d-4b93-bb1c-d0a1dc4572ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.752751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382c221-9b6d-4b93-bb1c-d0a1dc4572ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.764807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382c221-9b6d-4b93-bb1c-d0a1dc4572ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:53.766439 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382c221-9b6d-4b93-bb1c-d0a1dc4572ec service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:53.766987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff37ec7-684f-4ee5-86a8-f0f79cfd349b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:53.770914 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4c94c-0bcf-4919-9eab-e8ec84200957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:53.771603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4c94c-0bcf-4919-9eab-e8ec84200957 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.771945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4c94c-0bcf-4919-9eab-e8ec84200957 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.772227 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4c94c-0bcf-4919-9eab-e8ec84200957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.780189 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 820/1619] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:08:53.781502 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c577a6b-6558-4615-bae1-40e1bc2f5ab8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.781788 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c577a6b-6558-4615-bae1-40e1bc2f5ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.782058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c577a6b-6558-4615-bae1-40e1bc2f5ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.784826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4c94c-0bcf-4919-9eab-e8ec84200957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:53.792026 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4c94c-0bcf-4919-9eab-e8ec84200957 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:53.797779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 800/1620] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:08:53.799009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4c94c-0bcf-4919-9eab-e8ec84200957 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:53.806876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0c577a6b-6558-4615-bae1-40e1bc2f5ab8 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:53.808251 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0c577a6b-6558-4615-bae1-40e1bc2f5ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:53.809832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4c94c-0bcf-4919-9eab-e8ec84200957 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:53.814736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c603b5-7dd8-4d70-9bc9-233fd399ef11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:53.816459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c603b5-7dd8-4d70-9bc9-233fd399ef11 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.816925 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c603b5-7dd8-4d70-9bc9-233fd399ef11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.817383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c603b5-7dd8-4d70-9bc9-233fd399ef11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.819378 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 821/1621] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:53.820562 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c577a6b-6558-4615-bae1-40e1bc2f5ab8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:53.836049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c603b5-7dd8-4d70-9bc9-233fd399ef11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:53.838687 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c603b5-7dd8-4d70-9bc9-233fd399ef11 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:53.844995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c577a6b-6558-4615-bae1-40e1bc2f5ab8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:53.850475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 801/1622] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:08:53.851856 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c603b5-7dd8-4d70-9bc9-233fd399ef11 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:53.856605 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb23461-c97b-4431-ad17-2e742d3b1379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:53.858216 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb23461-c97b-4431-ad17-2e742d3b1379 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.859796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb23461-c97b-4431-ad17-2e742d3b1379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.860234 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb23461-c97b-4431-ad17-2e742d3b1379 admin admin] PATH_INFO: `/v3/projects/4b6eeee0b89f43289ac6046c12076d9d/users/beea1a9570b849099fc1f8ae46a6f55b/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.861995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c603b5-7dd8-4d70-9bc9-233fd399ef11 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:53.868389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2f6f1-2520-4261-9319-7b16e4f028e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:53.869557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f6f1-2520-4261-9319-7b16e4f028e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:53.869925 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f6f1-2520-4261-9319-7b16e4f028e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:53.870275 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f6f1-2520-4261-9319-7b16e4f028e2 admin admin] PATH_INFO: `/v3/projects/7e9cb2b2b8e942e391eb3f073706a70a/users/5511f3c9ece2460baa80712fb24f57e7/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:53.891517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb23461-c97b-4431-ad17-2e742d3b1379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6eeee0b89f43289ac6046c12076d9d, user_id=beea1a9570b849099fc1f8ae46a6f55b, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:53.892973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2f6f1-2520-4261-9319-7b16e4f028e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e9cb2b2b8e942e391eb3f073706a70a, user_id=5511f3c9ece2460baa80712fb24f57e7, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:53.894567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb23461-c97b-4431-ad17-2e742d3b1379 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:53.896651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2f6f1-2520-4261-9319-7b16e4f028e2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:53.990954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 802/1623] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:08:53 2022] PUT /identity/v3/projects/7e9cb2b2b8e942e391eb3f073706a70a/users/5511f3c9ece2460baa80712fb24f57e7/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:08:53.991883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2f6f1-2520-4261-9319-7b16e4f028e2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:53.997798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 822/1624] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:08:53 2022] PUT /identity/v3/projects/4b6eeee0b89f43289ac6046c12076d9d/users/beea1a9570b849099fc1f8ae46a6f55b/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:08:53.999356 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb23461-c97b-4431-ad17-2e742d3b1379 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:54.088683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2f6f1-2520-4261-9319-7b16e4f028e2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:54.140632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb23461-c97b-4431-ad17-2e742d3b1379 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:54.154284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587f9e1-cdbb-4ee9-8d32-a3c68ceeedfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:54.155022 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587f9e1-cdbb-4ee9-8d32-a3c68ceeedfb admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:54.155356 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587f9e1-cdbb-4ee9-8d32-a3c68ceeedfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:54.155633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587f9e1-cdbb-4ee9-8d32-a3c68ceeedfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:54.156821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587f9e1-cdbb-4ee9-8d32-a3c68ceeedfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:54.156950 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0b578-39e7-4af2-a372-c983684dfb9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:54.157798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0b578-39e7-4af2-a372-c983684dfb9c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:54.158096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0b578-39e7-4af2-a372-c983684dfb9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:54.158381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0b578-39e7-4af2-a372-c983684dfb9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:54.165317 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587f9e1-cdbb-4ee9-8d32-a3c68ceeedfb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:54.174178 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0b578-39e7-4af2-a372-c983684dfb9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:54.176858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0b578-39e7-4af2-a372-c983684dfb9c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:54.188773 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 823/1625] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:54.188773 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587f9e1-cdbb-4ee9-8d32-a3c68ceeedfb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:54.193218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 803/1626] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:08:54.194234 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0b578-39e7-4af2-a372-c983684dfb9c service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:54.198243 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587f9e1-cdbb-4ee9-8d32-a3c68ceeedfb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:54.208150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dfeb1-f81e-4be0-852a-3b3ff2dd2425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:54.208805 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0b578-39e7-4af2-a372-c983684dfb9c service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:54.208920 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dfeb1-f81e-4be0-852a-3b3ff2dd2425 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:54.209160 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dfeb1-f81e-4be0-852a-3b3ff2dd2425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:54.209360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dfeb1-f81e-4be0-852a-3b3ff2dd2425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:54.210098 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251dfeb1-f81e-4be0-852a-3b3ff2dd2425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:54.212677 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251dfeb1-f81e-4be0-852a-3b3ff2dd2425 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:54.214703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040eeb5-6883-48f6-a6d8-213c3b80d019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:54.215789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040eeb5-6883-48f6-a6d8-213c3b80d019 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:54.216171 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040eeb5-6883-48f6-a6d8-213c3b80d019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:54.216528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040eeb5-6883-48f6-a6d8-213c3b80d019 admin admin] PATH_INFO: `/v3/projects/7e9cb2b2b8e942e391eb3f073706a70a/users/5511f3c9ece2460baa80712fb24f57e7/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:54.219750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040eeb5-6883-48f6-a6d8-213c3b80d019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e9cb2b2b8e942e391eb3f073706a70a, user_id=5511f3c9ece2460baa80712fb24f57e7, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:54.223691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040eeb5-6883-48f6-a6d8-213c3b80d019 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:54.248336 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 804/1627] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:08:54 2022] PUT /identity/v3/projects/7e9cb2b2b8e942e391eb3f073706a70a/users/5511f3c9ece2460baa80712fb24f57e7/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:08:54.248583 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 824/1628] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:54.248689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040eeb5-6883-48f6-a6d8-213c3b80d019 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:54.257377 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ecb41-f550-4e9f-a92b-15f0f090438d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:54.257802 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ecb41-f550-4e9f-a92b-15f0f090438d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:54.258142 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ecb41-f550-4e9f-a92b-15f0f090438d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:54.321846 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1b3ecb41-f550-4e9f-a92b-15f0f090438d None None] MFA Rules not processed for user `5511f3c9ece2460baa80712fb24f57e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:54.323293 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1b3ecb41-f550-4e9f-a92b-15f0f090438d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:54.380169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040eeb5-6883-48f6-a6d8-213c3b80d019 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:54.380169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2cc03-1745-4a66-a671-da69cb79864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:54.380169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2cc03-1745-4a66-a671-da69cb79864f admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:54.380541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2cc03-1745-4a66-a671-da69cb79864f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:54.380709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2cc03-1745-4a66-a671-da69cb79864f admin admin] PATH_INFO: `/v3/projects/4b6eeee0b89f43289ac6046c12076d9d/users/beea1a9570b849099fc1f8ae46a6f55b/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:54.382789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2cc03-1745-4a66-a671-da69cb79864f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6eeee0b89f43289ac6046c12076d9d, user_id=beea1a9570b849099fc1f8ae46a6f55b, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:54.386639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2cc03-1745-4a66-a671-da69cb79864f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:54.402268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 805/1629] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:08:54 2022] PUT /identity/v3/projects/4b6eeee0b89f43289ac6046c12076d9d/users/beea1a9570b849099fc1f8ae46a6f55b/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:08:54.407890 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 825/1630] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:54.419722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b2b02-b0c3-410c-8088-a527ec9a6b67 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:54.420705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b2b02-b0c3-410c-8088-a527ec9a6b67 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:54.421478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b2b02-b0c3-410c-8088-a527ec9a6b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:54.426583 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ecb41-f550-4e9f-a92b-15f0f090438d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:54.458271 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2b0b2b02-b0c3-410c-8088-a527ec9a6b67 None None] MFA Rules not processed for user `beea1a9570b849099fc1f8ae46a6f55b`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:54.459841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2b0b2b02-b0c3-410c-8088-a527ec9a6b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:54.506281 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ecb41-f550-4e9f-a92b-15f0f090438d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:54.572629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 806/1631] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:54 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:08:54.585420 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2a5e0-61d2-41ef-a198-16a3888a59f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:54.586870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2a5e0-61d2-41ef-a198-16a3888a59f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:54.587278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b2b02-b0c3-410c-8088-a527ec9a6b67 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:54.587667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2a5e0-61d2-41ef-a198-16a3888a59f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:54.588203 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2a5e0-61d2-41ef-a198-16a3888a59f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:54.616039 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b2b02-b0c3-410c-8088-a527ec9a6b67 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:54.628192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a75ec-544e-489b-85ff-f00116c34240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:54.634165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a75ec-544e-489b-85ff-f00116c34240 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:54.634455 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a75ec-544e-489b-85ff-f00116c34240 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:54.634700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a75ec-544e-489b-85ff-f00116c34240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:54.667867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a75ec-544e-489b-85ff-f00116c34240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:54.668245 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2a5e0-61d2-41ef-a198-16a3888a59f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:54.669346 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a75ec-544e-489b-85ff-f00116c34240 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:54.669820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2a5e0-61d2-41ef-a198-16a3888a59f9 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:54.696387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 807/1632] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:08:54 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:08:54.709775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 826/1633] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:08:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:08:54.969965 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a75ec-544e-489b-85ff-f00116c34240 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:54.980360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a75ec-544e-489b-85ff-f00116c34240 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:54.984599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0f25a-5eef-46ea-afb6-d407d8ef1217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:54.985221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0f25a-5eef-46ea-afb6-d407d8ef1217 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:54.985684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0f25a-5eef-46ea-afb6-d407d8ef1217 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:54.985968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0f25a-5eef-46ea-afb6-d407d8ef1217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:55.050333 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0f25a-5eef-46ea-afb6-d407d8ef1217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:55.051976 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0f25a-5eef-46ea-afb6-d407d8ef1217 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:55.064659 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 808/1634] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:08:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:08:56.238863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2a5e0-61d2-41ef-a198-16a3888a59f9 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:56.325847 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2a5e0-61d2-41ef-a198-16a3888a59f9 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:56.332938 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1c552-1b11-4747-b374-7d8d2d1ed971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:56.333941 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1c552-1b11-4747-b374-7d8d2d1ed971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:56.335217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1c552-1b11-4747-b374-7d8d2d1ed971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:56.335614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1c552-1b11-4747-b374-7d8d2d1ed971 admin admin] PATH_INFO: `/v3/users/1bc46eda09df4715b4f3d8974430ea37` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:56.337498 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1c552-1b11-4747-b374-7d8d2d1ed971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bc46eda09df4715b4f3d8974430ea37)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:56.339696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1c552-1b11-4747-b374-7d8d2d1ed971 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:56.592507 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f2f1c552-1b11-4747-b374-7d8d2d1ed971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bc46eda09df4715b4f3d8974430ea37'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:08:56.614539 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f2f1c552-1b11-4747-b374-7d8d2d1ed971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bc46eda09df4715b4f3d8974430ea37'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:08:56.719516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f2f1c552-1b11-4747-b374-7d8d2d1ed971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bc46eda09df4715b4f3d8974430ea37'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:08:56.723219 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f2f1c552-1b11-4747-b374-7d8d2d1ed971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bc46eda09df4715b4f3d8974430ea37'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:08:56.723219 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f2f1c552-1b11-4747-b374-7d8d2d1ed971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bc46eda09df4715b4f3d8974430ea37'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:08:56.761625 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 827/1635] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:08:56 2022] DELETE /identity/v3/users/1bc46eda09df4715b4f3d8974430ea37 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:08:56.762243 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d0e96-c006-4ee9-9594-626c7b86b9f8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:56.762722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d0e96-c006-4ee9-9594-626c7b86b9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:56.762805 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d0e96-c006-4ee9-9594-626c7b86b9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:56.794057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7e0d0e96-c006-4ee9-9594-626c7b86b9f8 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:56.795852 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7e0d0e96-c006-4ee9-9594-626c7b86b9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:57.011024 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab559c4-9045-44e1-98d8-4ca3c97ffa23 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:57.011024 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab559c4-9045-44e1-98d8-4ca3c97ffa23 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:57.011024 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab559c4-9045-44e1-98d8-4ca3c97ffa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:57.030654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 809/1636] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:57.031832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a67f7-412f-4894-b6f9-dddbb45e463f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:57.032124 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a67f7-412f-4894-b6f9-dddbb45e463f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:57.032403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a67f7-412f-4894-b6f9-dddbb45e463f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:57.104687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9ab559c4-9045-44e1-98d8-4ca3c97ffa23 None None] MFA Rules not processed for user `ae225ab9c2354ad1a60420e3aca1c036`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:57.105916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9ab559c4-9045-44e1-98d8-4ca3c97ffa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:57.108195 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9a6a67f7-412f-4894-b6f9-dddbb45e463f None None] MFA Rules not processed for user `35ef7a36ac424aa995c44c9eb90bd1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:57.112656 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9a6a67f7-412f-4894-b6f9-dddbb45e463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:57.245547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 828/1637] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:57.245547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab559c4-9045-44e1-98d8-4ca3c97ffa23 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:57.247442 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9ab559c4-9045-44e1-98d8-4ca3c97ffa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:57.264671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 810/1638] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:57.278084 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a67f7-412f-4894-b6f9-dddbb45e463f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:57.290531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9a6a67f7-412f-4894-b6f9-dddbb45e463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:57.313604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a67f7-412f-4894-b6f9-dddbb45e463f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:57.329792 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e86a9b-a33b-4908-8d56-380bab426237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:57.330684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e86a9b-a33b-4908-8d56-380bab426237 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:57.330684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e86a9b-a33b-4908-8d56-380bab426237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:57.330884 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e86a9b-a33b-4908-8d56-380bab426237 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:57.331675 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e86a9b-a33b-4908-8d56-380bab426237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:57.333612 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e86a9b-a33b-4908-8d56-380bab426237 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:57.385994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab559c4-9045-44e1-98d8-4ca3c97ffa23 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:57.395940 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf44f9-aebc-4768-9fec-12690a3c1c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:57.397464 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf44f9-aebc-4768-9fec-12690a3c1c06 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:57.399135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf44f9-aebc-4768-9fec-12690a3c1c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:57.400312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf44f9-aebc-4768-9fec-12690a3c1c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:57.422603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf44f9-aebc-4768-9fec-12690a3c1c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:57.424237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf44f9-aebc-4768-9fec-12690a3c1c06 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:57.441764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 829/1639] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:08:57.442061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 811/1640] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:08:57 2022] POST /identity/v3/projects => generated 405 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:08:57.446046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e86a9b-a33b-4908-8d56-380bab426237 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:57.447840 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2977d-c6b7-46f1-9131-9ddf27c02afd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:57.448208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2977d-c6b7-46f1-9131-9ddf27c02afd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:57.448503 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2977d-c6b7-46f1-9131-9ddf27c02afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:57.498310 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-eff2977d-c6b7-46f1-9131-9ddf27c02afd None None] MFA Rules not processed for user `35ef7a36ac424aa995c44c9eb90bd1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:57.501542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-eff2977d-c6b7-46f1-9131-9ddf27c02afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:57.598676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e86a9b-a33b-4908-8d56-380bab426237 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:57.607983 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 830/1641] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:08:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:57.615726 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5909b7-1629-4b32-bfdb-613832ff9997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:57.618121 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5909b7-1629-4b32-bfdb-613832ff9997 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:57.618414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5909b7-1629-4b32-bfdb-613832ff9997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:57.618699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5909b7-1629-4b32-bfdb-613832ff9997 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:57.628124 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5909b7-1629-4b32-bfdb-613832ff9997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:57.628124 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5909b7-1629-4b32-bfdb-613832ff9997 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:57.630849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610fb0d-9a0b-48b6-8135-dc637e7e0744 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:57.631250 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610fb0d-9a0b-48b6-8135-dc637e7e0744 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:57.631670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610fb0d-9a0b-48b6-8135-dc637e7e0744 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:57.636320 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 831/1642] 10.222.0.24 () {54 vars in 961 bytes} [Tue May 17 22:08:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 22:08:57.646049 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59259929-2798-4071-bce7-3d56761b0f53 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:57.646402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59259929-2798-4071-bce7-3d56761b0f53 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:57.646614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59259929-2798-4071-bce7-3d56761b0f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:57.675016 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-59259929-2798-4071-bce7-3d56761b0f53 None None] MFA Rules not processed for user `8d06113649924eae83d04bc22337bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:57.676291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-59259929-2798-4071-bce7-3d56761b0f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:57.765374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 812/1643] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:08:57 2022] POST /identity/v3/users => generated 309 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:08:57.766740 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5909b7-1629-4b32-bfdb-613832ff9997 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:57.792698 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5909b7-1629-4b32-bfdb-613832ff9997 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:57.803316 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45f7d1-d49f-4544-93a7-c6d0932898fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:57.804325 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45f7d1-d49f-4544-93a7-c6d0932898fe admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:57.805022 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45f7d1-d49f-4544-93a7-c6d0932898fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:57.805566 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45f7d1-d49f-4544-93a7-c6d0932898fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:57.806713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45f7d1-d49f-4544-93a7-c6d0932898fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:57.809115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45f7d1-d49f-4544-93a7-c6d0932898fe admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:57.826843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 813/1644] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:57.828010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45f7d1-d49f-4544-93a7-c6d0932898fe admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:57.848504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 832/1645] 10.222.0.24 () {58 vars in 1058 bytes} [Tue May 17 22:08:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:57.848677 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59259929-2798-4071-bce7-3d56761b0f53 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:57.858739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45f7d1-d49f-4544-93a7-c6d0932898fe admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:57.863518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59259929-2798-4071-bce7-3d56761b0f53 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:57.882167 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db364b8-2537-4f4a-8f23-589dd4753980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:57.885717 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db364b8-2537-4f4a-8f23-589dd4753980 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:57.886011 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db364b8-2537-4f4a-8f23-589dd4753980 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:57.887933 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db364b8-2537-4f4a-8f23-589dd4753980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:57.892287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893b265-5f2f-4dd5-a0f3-abe3f40f2f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:57.896283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893b265-5f2f-4dd5-a0f3-abe3f40f2f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:57.896612 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893b265-5f2f-4dd5-a0f3-abe3f40f2f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:57.896892 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893b265-5f2f-4dd5-a0f3-abe3f40f2f37 admin admin] PATH_INFO: `/v3/projects/a98b0fa389424c618d88497bd22ec38f/users/f11d8342b1094682aa8a7bbee127d918/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:57.904490 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db364b8-2537-4f4a-8f23-589dd4753980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:57.906375 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db364b8-2537-4f4a-8f23-589dd4753980 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:57.919490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893b265-5f2f-4dd5-a0f3-abe3f40f2f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98b0fa389424c618d88497bd22ec38f, user_id=f11d8342b1094682aa8a7bbee127d918, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:57.923143 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893b265-5f2f-4dd5-a0f3-abe3f40f2f37 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:57.934880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 833/1646] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:08:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:08:58.045942 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 814/1647] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:08:57 2022] PUT /identity/v3/projects/a98b0fa389424c618d88497bd22ec38f/users/f11d8342b1094682aa8a7bbee127d918/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:08:58.049789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db364b8-2537-4f4a-8f23-589dd4753980 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:58.072366 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db364b8-2537-4f4a-8f23-589dd4753980 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:58.260332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acb6e5-cadf-48c5-aa16-45f1e4120bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:58.261241 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb6e5-cadf-48c5-aa16-45f1e4120bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:58.261534 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb6e5-cadf-48c5-aa16-45f1e4120bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:58.261861 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb6e5-cadf-48c5-aa16-45f1e4120bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:58.263535 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acb6e5-cadf-48c5-aa16-45f1e4120bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:58.264546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acb6e5-cadf-48c5-aa16-45f1e4120bdc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:58.569409 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 834/1648] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:08:58.579201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893b265-5f2f-4dd5-a0f3-abe3f40f2f37 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:58.579201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893b265-5f2f-4dd5-a0f3-abe3f40f2f37 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:58.579201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1ed70-9af7-422b-9f6b-9dd418bd1649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:58.579201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1ed70-9af7-422b-9f6b-9dd418bd1649 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:58.580907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1ed70-9af7-422b-9f6b-9dd418bd1649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:58.580907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1ed70-9af7-422b-9f6b-9dd418bd1649 admin admin] PATH_INFO: `/v3/projects/a98b0fa389424c618d88497bd22ec38f/users/f11d8342b1094682aa8a7bbee127d918/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:58.580907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1ed70-9af7-422b-9f6b-9dd418bd1649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98b0fa389424c618d88497bd22ec38f, user_id=f11d8342b1094682aa8a7bbee127d918, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:58.580907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1ed70-9af7-422b-9f6b-9dd418bd1649 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:58.580907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 815/1649] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:08:58 2022] PUT /identity/v3/projects/a98b0fa389424c618d88497bd22ec38f/users/f11d8342b1094682aa8a7bbee127d918/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:08:58.581771 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070990-ce70-4944-b478-30bdd1e8458e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:58.581771 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070990-ce70-4944-b478-30bdd1e8458e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:58.581771 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070990-ce70-4944-b478-30bdd1e8458e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:58.581771 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 835/1650] 10.222.0.24 () {54 vars in 912 bytes} [Tue May 17 22:08:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 22:08:58.582415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf78b4-8652-4b18-865d-e75c7786d678 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:58.582415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf78b4-8652-4b18-865d-e75c7786d678 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:58.582415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf78b4-8652-4b18-865d-e75c7786d678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:58.616416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e7cf78b4-8652-4b18-865d-e75c7786d678 None None] MFA Rules not processed for user `8d06113649924eae83d04bc22337bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:08:58.620532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e7cf78b4-8652-4b18-865d-e75c7786d678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:58.824075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 816/1651] 10.222.0.24 () {58 vars in 1009 bytes} [Tue May 17 22:08:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:08:58.838917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c070990-ce70-4944-b478-30bdd1e8458e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:08:58.840512 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0c070990-ce70-4944-b478-30bdd1e8458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:08:59.042185 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c070990-ce70-4944-b478-30bdd1e8458e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:08:59.053614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbb994-0d27-4903-a107-303ffa7a46f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68748827b9f14eb7958d5b202c5d6877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:08:59.054976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbb994-0d27-4903-a107-303ffa7a46f8 service glance] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:59.055548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbb994-0d27-4903-a107-303ffa7a46f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:59.056175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbb994-0d27-4903-a107-303ffa7a46f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:59.087379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbb994-0d27-4903-a107-303ffa7a46f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:08:59.088935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbb994-0d27-4903-a107-303ffa7a46f8 service glance] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:08:59.124435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 836/1652] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:08:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:08:59.988864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363dc2e-cd4c-467a-81ed-679ebca37c4c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:08:59.989440 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363dc2e-cd4c-467a-81ed-679ebca37c4c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:08:59.989440 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363dc2e-cd4c-467a-81ed-679ebca37c4c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:08:59.990977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 817/1653] 10.222.0.24 () {54 vars in 912 bytes} [Tue May 17 22:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:09:00.011945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e478abf-b946-4684-9df2-0b55aa0578b7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:00.012998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e478abf-b946-4684-9df2-0b55aa0578b7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:00.013956 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e478abf-b946-4684-9df2-0b55aa0578b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:00.087389 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9e478abf-b946-4684-9df2-0b55aa0578b7 None None] MFA Rules not processed for user `c084b56d682c44119654743809109bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:00.093596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9e478abf-b946-4684-9df2-0b55aa0578b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:00.262563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 837/1654] 10.222.0.24 () {58 vars in 1009 bytes} [Tue May 17 22:09:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:00.348896 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363dc2e-cd4c-467a-81ed-679ebca37c4c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:00.350737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e363dc2e-cd4c-467a-81ed-679ebca37c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:00.380313 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363dc2e-cd4c-467a-81ed-679ebca37c4c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:00.393033 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cebe4-1f4b-4461-a0d4-54a9a58ea6f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:00.397036 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cebe4-1f4b-4461-a0d4-54a9a58ea6f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:00.397515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cebe4-1f4b-4461-a0d4-54a9a58ea6f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:00.415618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cebe4-1f4b-4461-a0d4-54a9a58ea6f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:00.418135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e478abf-b946-4684-9df2-0b55aa0578b7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:00.419674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9e478abf-b946-4684-9df2-0b55aa0578b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:00.439944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cebe4-1f4b-4461-a0d4-54a9a58ea6f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:00.443271 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cebe4-1f4b-4461-a0d4-54a9a58ea6f6 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:00.468564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 818/1655] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:00.559584 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e478abf-b946-4684-9df2-0b55aa0578b7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:00.567640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296cf78-e4c4-435c-83db-7588972ae04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:00.570860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296cf78-e4c4-435c-83db-7588972ae04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:00.572814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296cf78-e4c4-435c-83db-7588972ae04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:00.572916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296cf78-e4c4-435c-83db-7588972ae04e admin admin] PATH_INFO: `/v3/projects/df516acee16049529d2b6f0b86cfbba3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:00.574644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296cf78-e4c4-435c-83db-7588972ae04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=df516acee16049529d2b6f0b86cfbba3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:00.577200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: WARNING py.warnings [None req-f296cf78-e4c4-435c-83db-7588972ae04e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 22:09:00.577200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: warnings.warn(msg) May 17 22:09:00.577200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: May 17 22:09:00.578030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296cf78-e4c4-435c-83db-7588972ae04e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:00.773870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f296cf78-e4c4-435c-83db-7588972ae04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df516acee16049529d2b6f0b86cfbba3', 'request_id': 'req-f296cf78-e4c4-435c-83db-7588972ae04e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:00.793602 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f296cf78-e4c4-435c-83db-7588972ae04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df516acee16049529d2b6f0b86cfbba3', 'request_id': 'req-f296cf78-e4c4-435c-83db-7588972ae04e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:00.808814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f296cf78-e4c4-435c-83db-7588972ae04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df516acee16049529d2b6f0b86cfbba3', 'request_id': 'req-f296cf78-e4c4-435c-83db-7588972ae04e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:00.916289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f296cf78-e4c4-435c-83db-7588972ae04e admin admin] The token cache is being invalidate because project df516acee16049529d2b6f0b86cfbba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:00.916289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f296cf78-e4c4-435c-83db-7588972ae04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:00.918967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f296cf78-e4c4-435c-83db-7588972ae04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:00.924037 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 838/1656] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:00 2022] DELETE /identity/v3/projects/df516acee16049529d2b6f0b86cfbba3 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:00.925253 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cebe4-1f4b-4461-a0d4-54a9a58ea6f6 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:00.942708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cebe4-1f4b-4461-a0d4-54a9a58ea6f6 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:01.054732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ab7b2-60bc-4148-96a6-e7fb2212c48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:01.060441 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ab7b2-60bc-4148-96a6-e7fb2212c48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:01.061843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ab7b2-60bc-4148-96a6-e7fb2212c48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:01.062538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ab7b2-60bc-4148-96a6-e7fb2212c48a admin admin] PATH_INFO: `/v3/users/beea1a9570b849099fc1f8ae46a6f55b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:01.065498 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ab7b2-60bc-4148-96a6-e7fb2212c48a admin admin] RBAC: Authorizing `identity:delete_user(user_id=beea1a9570b849099fc1f8ae46a6f55b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:01.088888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: WARNING py.warnings [None req-650ab7b2-60bc-4148-96a6-e7fb2212c48a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 22:09:01.088888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: warnings.warn(msg) May 17 22:09:01.088888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: May 17 22:09:01.110656 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ab7b2-60bc-4148-96a6-e7fb2212c48a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:01.436167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-650ab7b2-60bc-4148-96a6-e7fb2212c48a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beea1a9570b849099fc1f8ae46a6f55b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:01.500403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-650ab7b2-60bc-4148-96a6-e7fb2212c48a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beea1a9570b849099fc1f8ae46a6f55b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:01.502445 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-650ab7b2-60bc-4148-96a6-e7fb2212c48a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beea1a9570b849099fc1f8ae46a6f55b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:01.641528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-650ab7b2-60bc-4148-96a6-e7fb2212c48a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beea1a9570b849099fc1f8ae46a6f55b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:01.642586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-650ab7b2-60bc-4148-96a6-e7fb2212c48a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beea1a9570b849099fc1f8ae46a6f55b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:01.706317 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 819/1657] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:00 2022] DELETE /identity/v3/users/beea1a9570b849099fc1f8ae46a6f55b => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:01.940146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae70756-f825-4144-b806-05ddbab80115 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:01.940676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae70756-f825-4144-b806-05ddbab80115 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:01.944084 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae70756-f825-4144-b806-05ddbab80115 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:01.948859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 839/1658] 10.222.0.24 () {54 vars in 960 bytes} [Tue May 17 22:09:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:09:01.957718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e706-b018-4da8-8ed4-f5af39e9e666 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:01.958202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e706-b018-4da8-8ed4-f5af39e9e666 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:01.958585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e706-b018-4da8-8ed4-f5af39e9e666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:02.052521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c471e706-b018-4da8-8ed4-f5af39e9e666 None None] MFA Rules not processed for user `2cbd89f9b7a24b6cb993ca86e964c54d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:02.059923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c471e706-b018-4da8-8ed4-f5af39e9e666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:02.267005 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae70756-f825-4144-b806-05ddbab80115 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:02.267408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 820/1659] 10.222.0.24 () {58 vars in 1057 bytes} [Tue May 17 22:09:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:02.318279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae70756-f825-4144-b806-05ddbab80115 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:02.341775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d506e7e-4601-440c-a66f-9402223288e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cbd89f9b7a24b6cb993ca86e964c54d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:02.342616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d506e7e-4601-440c-a66f-9402223288e5 service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:02.343008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d506e7e-4601-440c-a66f-9402223288e5 service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:02.343407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d506e7e-4601-440c-a66f-9402223288e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:02.355184 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9d506e7e-4601-440c-a66f-9402223288e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:02.414719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d506e7e-4601-440c-a66f-9402223288e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:02.442276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d506e7e-4601-440c-a66f-9402223288e5 service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:02.482167 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 840/1660] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:09:02.577044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653b7ca-b728-4ec8-ba4c-8e62ec9b6fdf None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:02.577337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653b7ca-b728-4ec8-ba4c-8e62ec9b6fdf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:02.577618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653b7ca-b728-4ec8-ba4c-8e62ec9b6fdf None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:02.583519 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 821/1661] 10.222.0.24 () {54 vars in 961 bytes} [Tue May 17 22:09:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:09:02.591693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c7255-b6ee-41e5-8e33-5fd777d8fee1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:02.592519 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c7255-b6ee-41e5-8e33-5fd777d8fee1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:02.593935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c7255-b6ee-41e5-8e33-5fd777d8fee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:02.612369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db021d-e23d-45ef-bfc1-2d88b7520f5d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:02.613029 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db021d-e23d-45ef-bfc1-2d88b7520f5d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:02.613458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db021d-e23d-45ef-bfc1-2d88b7520f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:02.638550 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-448c7255-b6ee-41e5-8e33-5fd777d8fee1 None None] MFA Rules not processed for user `8d06113649924eae83d04bc22337bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:02.639805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-448c7255-b6ee-41e5-8e33-5fd777d8fee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:02.677485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-63db021d-e23d-45ef-bfc1-2d88b7520f5d None None] MFA Rules not processed for user `f11d8342b1094682aa8a7bbee127d918`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:02.680942 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-63db021d-e23d-45ef-bfc1-2d88b7520f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:02.864519 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 841/1662] 10.222.0.24 () {58 vars in 1058 bytes} [Tue May 17 22:09:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:02.870971 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88114ef6-b86c-4fd2-9c2f-b84cbab2e91f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:02.875191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88114ef6-b86c-4fd2-9c2f-b84cbab2e91f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:02.876012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88114ef6-b86c-4fd2-9c2f-b84cbab2e91f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:02.881838 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 842/1663] 10.222.0.24 () {54 vars in 912 bytes} [Tue May 17 22:09:02 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:09:02.883733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72892d4-fc61-4cd9-bf23-7e3bb2f620fe None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:02.884095 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72892d4-fc61-4cd9-bf23-7e3bb2f620fe None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:02.884445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72892d4-fc61-4cd9-bf23-7e3bb2f620fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:02.918695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 822/1664] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:02 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:02.943968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e72892d4-fc61-4cd9-bf23-7e3bb2f620fe None None] MFA Rules not processed for user `8d06113649924eae83d04bc22337bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:02.945892 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e72892d4-fc61-4cd9-bf23-7e3bb2f620fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:02.982809 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 843/1665] 10.222.0.24 () {58 vars in 1009 bytes} [Tue May 17 22:09:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:03.044425 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db021d-e23d-45ef-bfc1-2d88b7520f5d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:03.049186 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-63db021d-e23d-45ef-bfc1-2d88b7520f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:03.193563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db021d-e23d-45ef-bfc1-2d88b7520f5d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:03.199452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e26866-2ac7-4aff-99d7-59eb1b851e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:03.217127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26866-2ac7-4aff-99d7-59eb1b851e20 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:03.217671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26866-2ac7-4aff-99d7-59eb1b851e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:03.218590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26866-2ac7-4aff-99d7-59eb1b851e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:03.234623 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e26866-2ac7-4aff-99d7-59eb1b851e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:03.237739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e26866-2ac7-4aff-99d7-59eb1b851e20 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:03.270289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 823/1666] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:04.750764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72892d4-fc61-4cd9-bf23-7e3bb2f620fe None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:04.753085 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e72892d4-fc61-4cd9-bf23-7e3bb2f620fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:04.892861 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72892d4-fc61-4cd9-bf23-7e3bb2f620fe None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:04.898149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5913d00-e610-4145-95a7-0682d8026f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:04.899232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5913d00-e610-4145-95a7-0682d8026f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:04.899541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5913d00-e610-4145-95a7-0682d8026f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:04.899903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5913d00-e610-4145-95a7-0682d8026f99 admin admin] PATH_INFO: `/v3/projects/4b6eeee0b89f43289ac6046c12076d9d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:04.906338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5913d00-e610-4145-95a7-0682d8026f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b6eeee0b89f43289ac6046c12076d9d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:04.908849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5913d00-e610-4145-95a7-0682d8026f99 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:05.098517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e5913d00-e610-4145-95a7-0682d8026f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b6eeee0b89f43289ac6046c12076d9d', 'request_id': 'req-e5913d00-e610-4145-95a7-0682d8026f99'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:05.120547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e5913d00-e610-4145-95a7-0682d8026f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b6eeee0b89f43289ac6046c12076d9d', 'request_id': 'req-e5913d00-e610-4145-95a7-0682d8026f99'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:05.126713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e5913d00-e610-4145-95a7-0682d8026f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b6eeee0b89f43289ac6046c12076d9d', 'request_id': 'req-e5913d00-e610-4145-95a7-0682d8026f99'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:05.235512 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e5913d00-e610-4145-95a7-0682d8026f99 admin admin] The token cache is being invalidate because project 4b6eeee0b89f43289ac6046c12076d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:05.235512 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e5913d00-e610-4145-95a7-0682d8026f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:05.236493 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e5913d00-e610-4145-95a7-0682d8026f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:05.247306 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe38545-70da-434c-bfa9-54e6a8ee16f5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:05.247867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe38545-70da-434c-bfa9-54e6a8ee16f5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:05.247867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe38545-70da-434c-bfa9-54e6a8ee16f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:05.259704 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 844/1667] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:04 2022] DELETE /identity/v3/projects/4b6eeee0b89f43289ac6046c12076d9d => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:09:05.295354 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fbe38545-70da-434c-bfa9-54e6a8ee16f5 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:05.299279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fbe38545-70da-434c-bfa9-54e6a8ee16f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:05.404531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 824/1668] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:05.408234 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5e4a1-bb41-4da3-a46c-cdbd039c370b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:05.408790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5e4a1-bb41-4da3-a46c-cdbd039c370b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:05.409236 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5e4a1-bb41-4da3-a46c-cdbd039c370b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:05.439456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a2b5e4a1-bb41-4da3-a46c-cdbd039c370b None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:05.442162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a2b5e4a1-bb41-4da3-a46c-cdbd039c370b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:05.459431 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe38545-70da-434c-bfa9-54e6a8ee16f5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:05.460076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 845/1669] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:05.474694 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe38545-70da-434c-bfa9-54e6a8ee16f5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:05.481885 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cc125-765e-4497-a14e-873f280749b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:05.482579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cc125-765e-4497-a14e-873f280749b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:05.482857 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cc125-765e-4497-a14e-873f280749b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:05.483227 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cc125-765e-4497-a14e-873f280749b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:05.483971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cc125-765e-4497-a14e-873f280749b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:09:05.484287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cc125-765e-4497-a14e-873f280749b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:05.486445 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cc125-765e-4497-a14e-873f280749b9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:05.518169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 825/1670] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:09:05.521288 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5e4a1-bb41-4da3-a46c-cdbd039c370b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:05.537247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5e4a1-bb41-4da3-a46c-cdbd039c370b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:05.545989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f42827-7b74-463d-8b79-fc83e08c96aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:05.549589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f42827-7b74-463d-8b79-fc83e08c96aa admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:05.550971 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f42827-7b74-463d-8b79-fc83e08c96aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:05.551505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f42827-7b74-463d-8b79-fc83e08c96aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:05.553484 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f42827-7b74-463d-8b79-fc83e08c96aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:05.559326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f42827-7b74-463d-8b79-fc83e08c96aa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:05.668836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cc125-765e-4497-a14e-873f280749b9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:05.671077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 846/1671] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:05 2022] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:05.686056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cc125-765e-4497-a14e-873f280749b9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:05.817458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73ee09-1082-4a04-a94a-131680b75aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:05.818185 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73ee09-1082-4a04-a94a-131680b75aaa admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:05.818437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73ee09-1082-4a04-a94a-131680b75aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:05.818723 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73ee09-1082-4a04-a94a-131680b75aaa admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:05.819554 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73ee09-1082-4a04-a94a-131680b75aaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:05.821735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73ee09-1082-4a04-a94a-131680b75aaa admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:05.956532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 826/1672] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:05 2022] POST /identity/v3/users => generated 296 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:05.961071 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f42827-7b74-463d-8b79-fc83e08c96aa admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:05.977505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f42827-7b74-463d-8b79-fc83e08c96aa admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:05.994569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8471e9c-4ad4-48f0-b9ad-d602b4812265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:05.995466 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8471e9c-4ad4-48f0-b9ad-d602b4812265 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:05.995962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8471e9c-4ad4-48f0-b9ad-d602b4812265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:05.996242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8471e9c-4ad4-48f0-b9ad-d602b4812265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:05.996981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8471e9c-4ad4-48f0-b9ad-d602b4812265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:05.998851 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8471e9c-4ad4-48f0-b9ad-d602b4812265 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:06.021975 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 847/1673] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:06.023956 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73ee09-1082-4a04-a94a-131680b75aaa admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:06.039054 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73ee09-1082-4a04-a94a-131680b75aaa admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:06.050206 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4b92a-03f7-4e98-9167-cde78274908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:06.050913 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4b92a-03f7-4e98-9167-cde78274908d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:06.051285 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4b92a-03f7-4e98-9167-cde78274908d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:06.051750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4b92a-03f7-4e98-9167-cde78274908d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:06.052867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4b92a-03f7-4e98-9167-cde78274908d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:06.055268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4b92a-03f7-4e98-9167-cde78274908d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:06.079197 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 827/1674] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:06.084190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8471e9c-4ad4-48f0-b9ad-d602b4812265 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:06.131556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8471e9c-4ad4-48f0-b9ad-d602b4812265 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:06.143959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10fe8e-8442-4cab-a420-db367fbd0f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:06.144863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10fe8e-8442-4cab-a420-db367fbd0f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:06.147342 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10fe8e-8442-4cab-a420-db367fbd0f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:06.147342 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10fe8e-8442-4cab-a420-db367fbd0f67 admin admin] PATH_INFO: `/v3/projects/21f0cc2426ff462e8f8c71ad302296b4/users/f7ebd31d62e94aa7b0cf1012adf6bce5/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:06.191200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10fe8e-8442-4cab-a420-db367fbd0f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f0cc2426ff462e8f8c71ad302296b4, user_id=f7ebd31d62e94aa7b0cf1012adf6bce5, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:06.194139 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10fe8e-8442-4cab-a420-db367fbd0f67 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:06.303752 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 848/1675] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:06 2022] PUT /identity/v3/projects/21f0cc2426ff462e8f8c71ad302296b4/users/f7ebd31d62e94aa7b0cf1012adf6bce5/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:09:06.314514 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312162e-33cb-48b0-a188-a99fe2f22aa5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:06.315027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312162e-33cb-48b0-a188-a99fe2f22aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:06.315141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312162e-33cb-48b0-a188-a99fe2f22aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:06.376676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5312162e-33cb-48b0-a188-a99fe2f22aa5 None None] MFA Rules not processed for user `f7ebd31d62e94aa7b0cf1012adf6bce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:06.377943 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5312162e-33cb-48b0-a188-a99fe2f22aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:06.536803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 828/1676] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:06.541686 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10fe8e-8442-4cab-a420-db367fbd0f67 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:06.731045 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10fe8e-8442-4cab-a420-db367fbd0f67 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:06.739445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e717d-b640-467d-a0de-a66f966c9b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:06.740910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e717d-b640-467d-a0de-a66f966c9b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:06.741441 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e717d-b640-467d-a0de-a66f966c9b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:06.742169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e717d-b640-467d-a0de-a66f966c9b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:06.743066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e717d-b640-467d-a0de-a66f966c9b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:06.746285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e717d-b640-467d-a0de-a66f966c9b0a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:06.878583 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 849/1677] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:06 2022] POST /identity/v3/projects => generated 391 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:06.881871 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312162e-33cb-48b0-a188-a99fe2f22aa5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:06.900782 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312162e-33cb-48b0-a188-a99fe2f22aa5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:07.052449 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281ba5c-bc86-4b3f-9b9f-1381726b540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:07.053625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281ba5c-bc86-4b3f-9b9f-1381726b540f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:07.054678 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281ba5c-bc86-4b3f-9b9f-1381726b540f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:07.055204 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281ba5c-bc86-4b3f-9b9f-1381726b540f admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:07.056132 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281ba5c-bc86-4b3f-9b9f-1381726b540f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:07.058288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281ba5c-bc86-4b3f-9b9f-1381726b540f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:07.160887 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08493b21-39e4-4cc3-aef4-5aee8b7f07f1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:07.161843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08493b21-39e4-4cc3-aef4-5aee8b7f07f1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:07.162297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08493b21-39e4-4cc3-aef4-5aee8b7f07f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:07.181216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 829/1678] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:06 2022] POST /identity/v3/users => generated 302 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:07.185380 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281ba5c-bc86-4b3f-9b9f-1381726b540f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:07.216016 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281ba5c-bc86-4b3f-9b9f-1381726b540f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:07.232638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c2de4-ca50-4192-a223-3f5cbc8636e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:07.233700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c2de4-ca50-4192-a223-3f5cbc8636e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:07.234100 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c2de4-ca50-4192-a223-3f5cbc8636e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:07.234481 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c2de4-ca50-4192-a223-3f5cbc8636e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:07.235368 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c2de4-ca50-4192-a223-3f5cbc8636e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:07.237139 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c2de4-ca50-4192-a223-3f5cbc8636e5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:07.264825 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 830/1679] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:09:07.269275 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c2de4-ca50-4192-a223-3f5cbc8636e5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:07.295606 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-08493b21-39e4-4cc3-aef4-5aee8b7f07f1 None None] MFA Rules not processed for user `532092f483874f05bc119211b9624492`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:07.297195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-08493b21-39e4-4cc3-aef4-5aee8b7f07f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:07.302929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c2de4-ca50-4192-a223-3f5cbc8636e5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:07.326489 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae860ec-2706-4b9f-9129-6bf98dc4cb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:07.328452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae860ec-2706-4b9f-9129-6bf98dc4cb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:07.330485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae860ec-2706-4b9f-9129-6bf98dc4cb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:07.330485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae860ec-2706-4b9f-9129-6bf98dc4cb70 admin admin] PATH_INFO: `/v3/projects/5678724554af4e2c852b73173fe68bc8/users/658daf1c089048dd88973fd6fda1bba0/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:07.377752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae860ec-2706-4b9f-9129-6bf98dc4cb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5678724554af4e2c852b73173fe68bc8, user_id=658daf1c089048dd88973fd6fda1bba0, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:07.383677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae860ec-2706-4b9f-9129-6bf98dc4cb70 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:07.484380 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 831/1680] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:07 2022] PUT /identity/v3/projects/5678724554af4e2c852b73173fe68bc8/users/658daf1c089048dd88973fd6fda1bba0/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:07.485758 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd4313-df60-40f2-8241-59e9fcc1c4fd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:07.486052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd4313-df60-40f2-8241-59e9fcc1c4fd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:07.486526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd4313-df60-40f2-8241-59e9fcc1c4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:07.533290 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 850/1681] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:07.536958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08493b21-39e4-4cc3-aef4-5aee8b7f07f1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:07.551594 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bfcd4313-df60-40f2-8241-59e9fcc1c4fd None None] MFA Rules not processed for user `4bbb6a0a08464e738ef0d062dfe87182`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:07.553309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bfcd4313-df60-40f2-8241-59e9fcc1c4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:07.577419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08493b21-39e4-4cc3-aef4-5aee8b7f07f1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:07.821706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 832/1682] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:07.824810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd4313-df60-40f2-8241-59e9fcc1c4fd None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:07.828665 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382800c-7753-4060-9160-c81fb55f754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:07.830101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bfcd4313-df60-40f2-8241-59e9fcc1c4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:07.831713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382800c-7753-4060-9160-c81fb55f754b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:07.834509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382800c-7753-4060-9160-c81fb55f754b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:07.838566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382800c-7753-4060-9160-c81fb55f754b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:07.840782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382800c-7753-4060-9160-c81fb55f754b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:07.842772 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382800c-7753-4060-9160-c81fb55f754b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:07.899523 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 851/1683] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:07.900937 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382800c-7753-4060-9160-c81fb55f754b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:07.926630 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382800c-7753-4060-9160-c81fb55f754b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:07.943378 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdd517-b4de-44e8-b776-9501beb54e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:07.945904 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdd517-b4de-44e8-b776-9501beb54e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:07.946901 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdd517-b4de-44e8-b776-9501beb54e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:07.947887 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdd517-b4de-44e8-b776-9501beb54e87 admin admin] PATH_INFO: `/v3/projects/5678724554af4e2c852b73173fe68bc8/users/658daf1c089048dd88973fd6fda1bba0/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:07.955344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdd517-b4de-44e8-b776-9501beb54e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5678724554af4e2c852b73173fe68bc8, user_id=658daf1c089048dd88973fd6fda1bba0, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:07.962284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdd517-b4de-44e8-b776-9501beb54e87 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:08.002719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 852/1684] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:07 2022] PUT /identity/v3/projects/5678724554af4e2c852b73173fe68bc8/users/658daf1c089048dd88973fd6fda1bba0/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:08.008612 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171d93-1d10-4f17-bffc-4d387eaec83d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:08.008855 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171d93-1d10-4f17-bffc-4d387eaec83d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:08.009119 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171d93-1d10-4f17-bffc-4d387eaec83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:08.055973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd4313-df60-40f2-8241-59e9fcc1c4fd None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:08.064777 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-25171d93-1d10-4f17-bffc-4d387eaec83d None None] MFA Rules not processed for user `658daf1c089048dd88973fd6fda1bba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:08.066282 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-25171d93-1d10-4f17-bffc-4d387eaec83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:08.249206 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d0c7b-bf59-4a50-b2f5-ee5542c1ad64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:08.250034 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d0c7b-bf59-4a50-b2f5-ee5542c1ad64 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:08.250458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d0c7b-bf59-4a50-b2f5-ee5542c1ad64 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:08.250954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d0c7b-bf59-4a50-b2f5-ee5542c1ad64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:08.255309 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 853/1685] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:08.256634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25171d93-1d10-4f17-bffc-4d387eaec83d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:08.260589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-25171d93-1d10-4f17-bffc-4d387eaec83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:08.286963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25171d93-1d10-4f17-bffc-4d387eaec83d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:08.304433 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0ffc2-3ab6-4366-9548-06b697c857e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:08.305097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0ffc2-3ab6-4366-9548-06b697c857e2 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:08.305528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0ffc2-3ab6-4366-9548-06b697c857e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:08.305806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0ffc2-3ab6-4366-9548-06b697c857e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:08.420299 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0ffc2-3ab6-4366-9548-06b697c857e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:08.421931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0ffc2-3ab6-4366-9548-06b697c857e2 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:08.434562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d0c7b-bf59-4a50-b2f5-ee5542c1ad64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:08.436240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d0c7b-bf59-4a50-b2f5-ee5542c1ad64 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:08.446909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 854/1686] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:08.447672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0ffc2-3ab6-4366-9548-06b697c857e2 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:08.455988 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2aa0ffc2-3ab6-4366-9548-06b697c857e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:08.466851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 833/1687] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:08.468394 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50597d5e-86e7-4dc7-bf83-cb0fd752b888 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:08.468691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50597d5e-86e7-4dc7-bf83-cb0fd752b888 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:08.468990 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50597d5e-86e7-4dc7-bf83-cb0fd752b888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:08.599579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-50597d5e-86e7-4dc7-bf83-cb0fd752b888 None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:08.611481 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-50597d5e-86e7-4dc7-bf83-cb0fd752b888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:08.686233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0ffc2-3ab6-4366-9548-06b697c857e2 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:08.720169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8bf47-8673-45ff-9fcc-3530f07fc0a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:08.720169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8bf47-8673-45ff-9fcc-3530f07fc0a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:08.720169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8bf47-8673-45ff-9fcc-3530f07fc0a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:08.720169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8bf47-8673-45ff-9fcc-3530f07fc0a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:08.752486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8bf47-8673-45ff-9fcc-3530f07fc0a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:08.758648 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8bf47-8673-45ff-9fcc-3530f07fc0a8 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:08.806672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 855/1688] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:08.865249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 834/1689] 10.222.0.24 () {58 vars in 1009 bytes} [Tue May 17 22:09:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:09.057486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8bf47-8673-45ff-9fcc-3530f07fc0a8 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:09.066616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8bf47-8673-45ff-9fcc-3530f07fc0a8 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:09.095899 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8527d3-d0c1-40e6-9f03-ab44b5e19903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:09.096913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8527d3-d0c1-40e6-9f03-ab44b5e19903 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:09.097342 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8527d3-d0c1-40e6-9f03-ab44b5e19903 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:09.097760 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8527d3-d0c1-40e6-9f03-ab44b5e19903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:09.260275 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50597d5e-86e7-4dc7-bf83-cb0fd752b888 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:09.268056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-50597d5e-86e7-4dc7-bf83-cb0fd752b888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:09.394034 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8527d3-d0c1-40e6-9f03-ab44b5e19903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:09.407902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8527d3-d0c1-40e6-9f03-ab44b5e19903 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:09.469051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 856/1690] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:09.472541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8527d3-d0c1-40e6-9f03-ab44b5e19903 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:09.479136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8a8527d3-d0c1-40e6-9f03-ab44b5e19903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:09.543853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50597d5e-86e7-4dc7-bf83-cb0fd752b888 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:09.568166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819df4a-1055-4ad6-aeab-7e7a9a06f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:09.569629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819df4a-1055-4ad6-aeab-7e7a9a06f435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:09.572184 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819df4a-1055-4ad6-aeab-7e7a9a06f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:09.572665 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819df4a-1055-4ad6-aeab-7e7a9a06f435 admin admin] PATH_INFO: `/v3/users/ae225ab9c2354ad1a60420e3aca1c036` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:09.575375 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819df4a-1055-4ad6-aeab-7e7a9a06f435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae225ab9c2354ad1a60420e3aca1c036)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:09.581965 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819df4a-1055-4ad6-aeab-7e7a9a06f435 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:09.589566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8527d3-d0c1-40e6-9f03-ab44b5e19903 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:09.596398 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c1125-77e0-4609-9f73-9324ccb0fbbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:09.598328 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c1125-77e0-4609-9f73-9324ccb0fbbb service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:09.598709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c1125-77e0-4609-9f73-9324ccb0fbbb service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:09.599640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c1125-77e0-4609-9f73-9324ccb0fbbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:09.648225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c1125-77e0-4609-9f73-9324ccb0fbbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:09.650198 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c1125-77e0-4609-9f73-9324ccb0fbbb service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:09.684793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 857/1691] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:09:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 22:09:09.875557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0819df4a-1055-4ad6-aeab-7e7a9a06f435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae225ab9c2354ad1a60420e3aca1c036'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:09.916070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0819df4a-1055-4ad6-aeab-7e7a9a06f435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae225ab9c2354ad1a60420e3aca1c036'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:09.917076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0819df4a-1055-4ad6-aeab-7e7a9a06f435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae225ab9c2354ad1a60420e3aca1c036'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:10.014685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0819df4a-1055-4ad6-aeab-7e7a9a06f435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae225ab9c2354ad1a60420e3aca1c036'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:10.015675 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0819df4a-1055-4ad6-aeab-7e7a9a06f435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae225ab9c2354ad1a60420e3aca1c036'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:10.040079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 835/1692] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:09 2022] DELETE /identity/v3/users/ae225ab9c2354ad1a60420e3aca1c036 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:10.914383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c1125-77e0-4609-9f73-9324ccb0fbbb service swift] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:10.974168 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c1125-77e0-4609-9f73-9324ccb0fbbb service swift] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:11.227824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ba021-8b7b-499b-bbc9-714b442f65c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:11.227824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ba021-8b7b-499b-bbc9-714b442f65c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:11.227824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ba021-8b7b-499b-bbc9-714b442f65c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:11.227824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ba021-8b7b-499b-bbc9-714b442f65c1 admin admin] PATH_INFO: `/v3/projects/ca080b90bf32462b95adafcc9a524e55` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:11.228177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ba021-8b7b-499b-bbc9-714b442f65c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca080b90bf32462b95adafcc9a524e55)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:11.232735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ba021-8b7b-499b-bbc9-714b442f65c1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:11.553589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bf8ba021-8b7b-499b-bbc9-714b442f65c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca080b90bf32462b95adafcc9a524e55', 'request_id': 'req-bf8ba021-8b7b-499b-bbc9-714b442f65c1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:11.597377 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bf8ba021-8b7b-499b-bbc9-714b442f65c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca080b90bf32462b95adafcc9a524e55', 'request_id': 'req-bf8ba021-8b7b-499b-bbc9-714b442f65c1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:11.623163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bf8ba021-8b7b-499b-bbc9-714b442f65c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca080b90bf32462b95adafcc9a524e55', 'request_id': 'req-bf8ba021-8b7b-499b-bbc9-714b442f65c1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:11.717705 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df0b69-cdd5-4751-a3ba-6487c41e525d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:11.718294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df0b69-cdd5-4751-a3ba-6487c41e525d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:11.718294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df0b69-cdd5-4751-a3ba-6487c41e525d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:11.724079 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bf8ba021-8b7b-499b-bbc9-714b442f65c1 admin admin] The token cache is being invalidate because project ca080b90bf32462b95adafcc9a524e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:11.726319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bf8ba021-8b7b-499b-bbc9-714b442f65c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:11.727754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bf8ba021-8b7b-499b-bbc9-714b442f65c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:11.731897 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 858/1693] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:10 2022] DELETE /identity/v3/projects/ca080b90bf32462b95adafcc9a524e55 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:11.735873 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ba021-8b7b-499b-bbc9-714b442f65c1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:11.746969 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bf8ba021-8b7b-499b-bbc9-714b442f65c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:11.769205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-94df0b69-cdd5-4751-a3ba-6487c41e525d None None] MFA Rules not processed for user `c084b56d682c44119654743809109bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:11.769205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-94df0b69-cdd5-4751-a3ba-6487c41e525d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:11.953382 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 836/1694] 10.222.0.52 () {58 vars in 1015 bytes} [Tue May 17 22:09:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:11.973110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ba021-8b7b-499b-bbc9-714b442f65c1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:11.991828 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df0b69-cdd5-4751-a3ba-6487c41e525d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:11.993501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-94df0b69-cdd5-4751-a3ba-6487c41e525d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:12.012345 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df0b69-cdd5-4751-a3ba-6487c41e525d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:12.018189 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846f4b9-6dc1-426c-96cc-5a6865923331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:12.019349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846f4b9-6dc1-426c-96cc-5a6865923331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:12.021034 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846f4b9-6dc1-426c-96cc-5a6865923331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:12.022264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846f4b9-6dc1-426c-96cc-5a6865923331 admin admin] PATH_INFO: `/v3/users/f11d8342b1094682aa8a7bbee127d918` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:12.028252 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846f4b9-6dc1-426c-96cc-5a6865923331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11d8342b1094682aa8a7bbee127d918)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:12.032551 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd4ae0-740d-4aea-b4d2-9ce69b9140ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:12.033606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd4ae0-740d-4aea-b4d2-9ce69b9140ec service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:12.034928 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd4ae0-740d-4aea-b4d2-9ce69b9140ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:12.035339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd4ae0-740d-4aea-b4d2-9ce69b9140ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:12.036893 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846f4b9-6dc1-426c-96cc-5a6865923331 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:12.066720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd4ae0-740d-4aea-b4d2-9ce69b9140ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:12.068655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd4ae0-740d-4aea-b4d2-9ce69b9140ec service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:12.150310 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 837/1695] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:12.358118 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2846f4b9-6dc1-426c-96cc-5a6865923331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11d8342b1094682aa8a7bbee127d918'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:12.418986 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2846f4b9-6dc1-426c-96cc-5a6865923331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11d8342b1094682aa8a7bbee127d918'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:12.503916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2846f4b9-6dc1-426c-96cc-5a6865923331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11d8342b1094682aa8a7bbee127d918'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:12.504610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2846f4b9-6dc1-426c-96cc-5a6865923331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11d8342b1094682aa8a7bbee127d918'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:12.505314 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2846f4b9-6dc1-426c-96cc-5a6865923331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11d8342b1094682aa8a7bbee127d918'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:12.543243 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 859/1696] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:11 2022] DELETE /identity/v3/users/f11d8342b1094682aa8a7bbee127d918 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:12.974737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4749c3-6991-4393-bf0c-5a5f72337f23 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:12.975297 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4749c3-6991-4393-bf0c-5a5f72337f23 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:12.975382 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4749c3-6991-4393-bf0c-5a5f72337f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:13.067746 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7d4749c3-6991-4393-bf0c-5a5f72337f23 None None] MFA Rules not processed for user `626cf3ce22fd4d019022b52e21916a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:13.069013 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7d4749c3-6991-4393-bf0c-5a5f72337f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:13.319716 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 838/1697] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:13.336097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846f4b9-6dc1-426c-96cc-5a6865923331 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:13.338219 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2846f4b9-6dc1-426c-96cc-5a6865923331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:13.606605 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846f4b9-6dc1-426c-96cc-5a6865923331 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:13.618754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc238f6-f365-442f-8925-705ddaa3c5f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:13.620759 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc238f6-f365-442f-8925-705ddaa3c5f9 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:13.621201 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc238f6-f365-442f-8925-705ddaa3c5f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:13.621618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc238f6-f365-442f-8925-705ddaa3c5f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:13.646155 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc238f6-f365-442f-8925-705ddaa3c5f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:13.651959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc238f6-f365-442f-8925-705ddaa3c5f9 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:13.675666 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 860/1698] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:13.706194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4749c3-6991-4393-bf0c-5a5f72337f23 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:13.708528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7d4749c3-6991-4393-bf0c-5a5f72337f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:14.078438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4749c3-6991-4393-bf0c-5a5f72337f23 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:14.117189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e58ce0-d635-405f-87a7-0fa6da362835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:14.118615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e58ce0-d635-405f-87a7-0fa6da362835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:14.122433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e58ce0-d635-405f-87a7-0fa6da362835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:14.122433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e58ce0-d635-405f-87a7-0fa6da362835 admin admin] PATH_INFO: `/v3/projects/a98b0fa389424c618d88497bd22ec38f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:14.132576 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e58ce0-d635-405f-87a7-0fa6da362835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98b0fa389424c618d88497bd22ec38f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:14.154355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e58ce0-d635-405f-87a7-0fa6da362835 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:14.440906 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d1e58ce0-d635-405f-87a7-0fa6da362835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98b0fa389424c618d88497bd22ec38f', 'request_id': 'req-d1e58ce0-d635-405f-87a7-0fa6da362835'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:14.524981 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d1e58ce0-d635-405f-87a7-0fa6da362835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98b0fa389424c618d88497bd22ec38f', 'request_id': 'req-d1e58ce0-d635-405f-87a7-0fa6da362835'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:14.533347 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d1e58ce0-d635-405f-87a7-0fa6da362835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98b0fa389424c618d88497bd22ec38f', 'request_id': 'req-d1e58ce0-d635-405f-87a7-0fa6da362835'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:14.578055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d1e58ce0-d635-405f-87a7-0fa6da362835 admin admin] The token cache is being invalidate because project a98b0fa389424c618d88497bd22ec38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:14.581677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d1e58ce0-d635-405f-87a7-0fa6da362835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:14.581677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d1e58ce0-d635-405f-87a7-0fa6da362835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:14.583744 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 839/1699] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:13 2022] DELETE /identity/v3/projects/a98b0fa389424c618d88497bd22ec38f => generated 0 bytes in 879 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:14.589323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda4daa-dd15-4081-9b35-86f212ec0693 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:14.590253 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda4daa-dd15-4081-9b35-86f212ec0693 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:14.590672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda4daa-dd15-4081-9b35-86f212ec0693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:14.673859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3dda4daa-dd15-4081-9b35-86f212ec0693 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:14.678073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3dda4daa-dd15-4081-9b35-86f212ec0693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:14.904140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 861/1700] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:14.910477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df94846-bfd7-4a30-bd23-8a7fd7d0e205 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:14.910683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df94846-bfd7-4a30-bd23-8a7fd7d0e205 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:14.911518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df94846-bfd7-4a30-bd23-8a7fd7d0e205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:14.989610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5df94846-bfd7-4a30-bd23-8a7fd7d0e205 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:15.000515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5df94846-bfd7-4a30-bd23-8a7fd7d0e205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:15.032613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 840/1701] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:15.037037 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda4daa-dd15-4081-9b35-86f212ec0693 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:15.062528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda4daa-dd15-4081-9b35-86f212ec0693 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:15.071841 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0bb78-bf38-4b66-9a04-ad4840699e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:15.072885 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0bb78-bf38-4b66-9a04-ad4840699e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:15.075309 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0bb78-bf38-4b66-9a04-ad4840699e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:15.075859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0bb78-bf38-4b66-9a04-ad4840699e68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:15.076842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0bb78-bf38-4b66-9a04-ad4840699e68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:09:15.079440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0bb78-bf38-4b66-9a04-ad4840699e68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:15.086983 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0bb78-bf38-4b66-9a04-ad4840699e68 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:15.142104 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 862/1702] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:09:15.144019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df94846-bfd7-4a30-bd23-8a7fd7d0e205 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:15.181652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df94846-bfd7-4a30-bd23-8a7fd7d0e205 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:15.223936 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2708969-666b-42d6-86e5-dbe010f91577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:15.225247 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2708969-666b-42d6-86e5-dbe010f91577 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:15.226117 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2708969-666b-42d6-86e5-dbe010f91577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:15.226416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2708969-666b-42d6-86e5-dbe010f91577 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:15.238460 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2708969-666b-42d6-86e5-dbe010f91577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:15.248805 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2708969-666b-42d6-86e5-dbe010f91577 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:15.446822 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 841/1703] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:15 2022] POST /identity/v3/projects => generated 363 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:15.449028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0bb78-bf38-4b66-9a04-ad4840699e68 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:15.520449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0bb78-bf38-4b66-9a04-ad4840699e68 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:15.852845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264da980-dd50-48ab-b40e-da92e3074b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:15.857100 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264da980-dd50-48ab-b40e-da92e3074b78 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:15.861336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264da980-dd50-48ab-b40e-da92e3074b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:15.862000 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264da980-dd50-48ab-b40e-da92e3074b78 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:15.863097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264da980-dd50-48ab-b40e-da92e3074b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:15.865806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264da980-dd50-48ab-b40e-da92e3074b78 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:15.999233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 863/1704] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:15 2022] POST /identity/v3/users => generated 282 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:16.004562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2708969-666b-42d6-86e5-dbe010f91577 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:16.043985 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2708969-666b-42d6-86e5-dbe010f91577 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:16.095239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b809e-2152-4397-a094-e6bd4540f2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:16.096472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b809e-2152-4397-a094-e6bd4540f2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:16.099249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b809e-2152-4397-a094-e6bd4540f2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:16.099566 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b809e-2152-4397-a094-e6bd4540f2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:16.102398 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b809e-2152-4397-a094-e6bd4540f2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:16.105274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b809e-2152-4397-a094-e6bd4540f2cd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:16.153147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264da980-dd50-48ab-b40e-da92e3074b78 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:16.153628 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 842/1705] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:16.228724 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264da980-dd50-48ab-b40e-da92e3074b78 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:16.240237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756efd4-b062-4f52-9421-e12fde341c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:16.247598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756efd4-b062-4f52-9421-e12fde341c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:16.247598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756efd4-b062-4f52-9421-e12fde341c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:16.247598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756efd4-b062-4f52-9421-e12fde341c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:16.247598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756efd4-b062-4f52-9421-e12fde341c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:16.247598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756efd4-b062-4f52-9421-e12fde341c80 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:16.268076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 864/1706] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:16.274032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b809e-2152-4397-a094-e6bd4540f2cd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:16.291772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b809e-2152-4397-a094-e6bd4540f2cd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:16.297873 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc0a62-59c9-4edb-ace1-b9a70265a0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:16.299437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc0a62-59c9-4edb-ace1-b9a70265a0ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:16.299863 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc0a62-59c9-4edb-ace1-b9a70265a0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:16.300277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc0a62-59c9-4edb-ace1-b9a70265a0ea admin admin] PATH_INFO: `/v3/projects/2c2f16cf39e7413ab1edbc470dc20176/users/3fe9f956ca21488cae8120c7bd717bc1/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:16.330738 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc0a62-59c9-4edb-ace1-b9a70265a0ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2f16cf39e7413ab1edbc470dc20176, user_id=3fe9f956ca21488cae8120c7bd717bc1, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:16.335829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc0a62-59c9-4edb-ace1-b9a70265a0ea admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:16.464259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce0204-ef40-4e98-8b89-b34bae9ceb44 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:16.464542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce0204-ef40-4e98-8b89-b34bae9ceb44 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:16.464828 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce0204-ef40-4e98-8b89-b34bae9ceb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:16.465457 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 843/1707] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:16 2022] PUT /identity/v3/projects/2c2f16cf39e7413ab1edbc470dc20176/users/3fe9f956ca21488cae8120c7bd717bc1/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:16.479174 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9954c25-556f-46f0-a0f6-59110dca64e4 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:16.479706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9954c25-556f-46f0-a0f6-59110dca64e4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:16.480178 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9954c25-556f-46f0-a0f6-59110dca64e4 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:16.482551 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 844/1708] 10.222.0.24 () {54 vars in 921 bytes} [Tue May 17 22:09:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:09:16.538584 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-60ce0204-ef40-4e98-8b89-b34bae9ceb44 None None] MFA Rules not processed for user `3fe9f956ca21488cae8120c7bd717bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:16.539937 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-60ce0204-ef40-4e98-8b89-b34bae9ceb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:16.541358 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eecd1-15cb-4c47-945e-e78e0dbf8f6d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:16.541714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eecd1-15cb-4c47-945e-e78e0dbf8f6d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:16.541921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eecd1-15cb-4c47-945e-e78e0dbf8f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:16.635269 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4d3eecd1-15cb-4c47-945e-e78e0dbf8f6d None None] MFA Rules not processed for user `8d06113649924eae83d04bc22337bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:16.646471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4d3eecd1-15cb-4c47-945e-e78e0dbf8f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:16.855635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 865/1709] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:16.865157 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 845/1710] 10.222.0.24 () {58 vars in 1018 bytes} [Tue May 17 22:09:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:16.871121 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce0204-ef40-4e98-8b89-b34bae9ceb44 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:16.941004 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3eecd1-15cb-4c47-945e-e78e0dbf8f6d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:16.943714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4d3eecd1-15cb-4c47-945e-e78e0dbf8f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:16.984037 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3eecd1-15cb-4c47-945e-e78e0dbf8f6d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:17.020906 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72322e5-6c8e-479c-9fa3-45fe258d43c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:17.021582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72322e5-6c8e-479c-9fa3-45fe258d43c5 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:17.027444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72322e5-6c8e-479c-9fa3-45fe258d43c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:17.031311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72322e5-6c8e-479c-9fa3-45fe258d43c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:17.084227 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72322e5-6c8e-479c-9fa3-45fe258d43c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:17.086101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72322e5-6c8e-479c-9fa3-45fe258d43c5 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:17.095190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce0204-ef40-4e98-8b89-b34bae9ceb44 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:17.099896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e63a4b-229e-4c24-9b11-3f78e1d0507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:17.101987 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e63a4b-229e-4c24-9b11-3f78e1d0507c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:17.102478 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e63a4b-229e-4c24-9b11-3f78e1d0507c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:17.103174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e63a4b-229e-4c24-9b11-3f78e1d0507c admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:17.104310 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e63a4b-229e-4c24-9b11-3f78e1d0507c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:17.107660 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e63a4b-229e-4c24-9b11-3f78e1d0507c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:17.123291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 846/1711] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:09:17.327529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 866/1712] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:16 2022] POST /identity/v3/projects => generated 363 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:17.336432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72322e5-6c8e-479c-9fa3-45fe258d43c5 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:17.364426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72322e5-6c8e-479c-9fa3-45fe258d43c5 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:17.572508 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d67f3-912f-4e35-82c6-7eac92192dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:17.573220 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d67f3-912f-4e35-82c6-7eac92192dcd admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:17.573515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d67f3-912f-4e35-82c6-7eac92192dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:17.573783 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d67f3-912f-4e35-82c6-7eac92192dcd admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:17.574497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d67f3-912f-4e35-82c6-7eac92192dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:17.576470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d67f3-912f-4e35-82c6-7eac92192dcd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:17.702201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 847/1713] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:17 2022] POST /identity/v3/users => generated 288 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:17.706286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e63a4b-229e-4c24-9b11-3f78e1d0507c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:17.740251 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e63a4b-229e-4c24-9b11-3f78e1d0507c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:17.769588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f6353-ac51-4085-a94e-67901c297ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:17.780774 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f6353-ac51-4085-a94e-67901c297ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:17.781153 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f6353-ac51-4085-a94e-67901c297ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:17.782897 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f6353-ac51-4085-a94e-67901c297ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:17.783810 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f6353-ac51-4085-a94e-67901c297ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:17.786547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f6353-ac51-4085-a94e-67901c297ef3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:17.803904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d67f3-912f-4e35-82c6-7eac92192dcd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:17.805794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-828d67f3-912f-4e35-82c6-7eac92192dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:17.844588 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d67f3-912f-4e35-82c6-7eac92192dcd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:17.864277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac544f-a4bc-4ad1-991d-bea67931b8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:17.865152 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 867/1714] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:17.869680 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f6353-ac51-4085-a94e-67901c297ef3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:17.874015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac544f-a4bc-4ad1-991d-bea67931b8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:17.875276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac544f-a4bc-4ad1-991d-bea67931b8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:17.875709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac544f-a4bc-4ad1-991d-bea67931b8a1 admin admin] PATH_INFO: `/v3/users/f7ebd31d62e94aa7b0cf1012adf6bce5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:17.891792 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac544f-a4bc-4ad1-991d-bea67931b8a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ebd31d62e94aa7b0cf1012adf6bce5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:17.895495 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac544f-a4bc-4ad1-991d-bea67931b8a1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:17.930660 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f6353-ac51-4085-a94e-67901c297ef3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:17.949608 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be8dfb-7bf4-458f-a910-e44271ed9619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:17.957405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8dfb-7bf4-458f-a910-e44271ed9619 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:17.963395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8dfb-7bf4-458f-a910-e44271ed9619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:17.963395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8dfb-7bf4-458f-a910-e44271ed9619 admin admin] PATH_INFO: `/v3/projects/1c66df6e88db4fe0a02ecf642edbb5a4/users/3d0c55b9977a49b5a0b492e45b476ad6/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:18.016580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be8dfb-7bf4-458f-a910-e44271ed9619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c66df6e88db4fe0a02ecf642edbb5a4, user_id=3d0c55b9977a49b5a0b492e45b476ad6, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:18.030101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be8dfb-7bf4-458f-a910-e44271ed9619 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:18.117269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 868/1715] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:17 2022] PUT /identity/v3/projects/1c66df6e88db4fe0a02ecf642edbb5a4/users/3d0c55b9977a49b5a0b492e45b476ad6/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:18.123174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be8dfb-7bf4-458f-a910-e44271ed9619 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:18.183778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a9ac544f-a4bc-4ad1-991d-bea67931b8a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ebd31d62e94aa7b0cf1012adf6bce5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:18.213320 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a9ac544f-a4bc-4ad1-991d-bea67931b8a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ebd31d62e94aa7b0cf1012adf6bce5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:18.215634 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a9ac544f-a4bc-4ad1-991d-bea67931b8a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ebd31d62e94aa7b0cf1012adf6bce5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:18.280545 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be8dfb-7bf4-458f-a910-e44271ed9619 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:18.289081 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a9ac544f-a4bc-4ad1-991d-bea67931b8a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ebd31d62e94aa7b0cf1012adf6bce5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:18.289727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a9ac544f-a4bc-4ad1-991d-bea67931b8a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ebd31d62e94aa7b0cf1012adf6bce5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:18.294481 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b7613-bc77-4e27-806d-cb5eb397c2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:18.295786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b7613-bc77-4e27-806d-cb5eb397c2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:18.296247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b7613-bc77-4e27-806d-cb5eb397c2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:18.298546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b7613-bc77-4e27-806d-cb5eb397c2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:18.299541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b7613-bc77-4e27-806d-cb5eb397c2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:18.301151 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b7613-bc77-4e27-806d-cb5eb397c2e9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:18.329511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 869/1716] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:18.334361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b7613-bc77-4e27-806d-cb5eb397c2e9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:18.340372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-692b7613-bc77-4e27-806d-cb5eb397c2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:18.367844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b7613-bc77-4e27-806d-cb5eb397c2e9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:18.372043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 848/1717] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:17 2022] DELETE /identity/v3/users/f7ebd31d62e94aa7b0cf1012adf6bce5 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:09:18.377901 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30799333-359b-45cd-a587-fd401a866902 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:18.380125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30799333-359b-45cd-a587-fd401a866902 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:18.380668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30799333-359b-45cd-a587-fd401a866902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:18.442770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-30799333-359b-45cd-a587-fd401a866902 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:18.456642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-30799333-359b-45cd-a587-fd401a866902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:18.502917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99840675-6c40-4c09-af73-a5767d357043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:18.503855 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99840675-6c40-4c09-af73-a5767d357043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:18.514352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99840675-6c40-4c09-af73-a5767d357043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:18.514352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99840675-6c40-4c09-af73-a5767d357043 admin admin] PATH_INFO: `/v3/projects/1c66df6e88db4fe0a02ecf642edbb5a4/users/3d0c55b9977a49b5a0b492e45b476ad6/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:18.514352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99840675-6c40-4c09-af73-a5767d357043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c66df6e88db4fe0a02ecf642edbb5a4, user_id=3d0c55b9977a49b5a0b492e45b476ad6, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:18.514352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99840675-6c40-4c09-af73-a5767d357043 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:18.540089 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 870/1718] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:18 2022] PUT /identity/v3/projects/1c66df6e88db4fe0a02ecf642edbb5a4/users/3d0c55b9977a49b5a0b492e45b476ad6/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:18.554229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55226234-a10c-4e98-8854-f2b8c346b4bf None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:18.554526 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55226234-a10c-4e98-8854-f2b8c346b4bf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:18.554847 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55226234-a10c-4e98-8854-f2b8c346b4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:18.621364 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-55226234-a10c-4e98-8854-f2b8c346b4bf None None] MFA Rules not processed for user `3d0c55b9977a49b5a0b492e45b476ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:18.622913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-55226234-a10c-4e98-8854-f2b8c346b4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:18.656798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 849/1719] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:18.703003 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30799333-359b-45cd-a587-fd401a866902 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:18.704859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-30799333-359b-45cd-a587-fd401a866902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:18.743126 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 871/1720] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:18 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:18.766800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55226234-a10c-4e98-8854-f2b8c346b4bf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:18.775578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-55226234-a10c-4e98-8854-f2b8c346b4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:18.844565 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30799333-359b-45cd-a587-fd401a866902 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:18.886319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55226234-a10c-4e98-8854-f2b8c346b4bf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:18.905333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e75b9-4968-4f5a-b212-56c142f48a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:18.906307 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e75b9-4968-4f5a-b212-56c142f48a93 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:18.906871 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e75b9-4968-4f5a-b212-56c142f48a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:18.907450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e75b9-4968-4f5a-b212-56c142f48a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:18.941579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e75b9-4968-4f5a-b212-56c142f48a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:18.943956 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e75b9-4968-4f5a-b212-56c142f48a93 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:18.973558 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 872/1721] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:18 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:18.994178 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a583366-aaa5-4b7a-856d-f446e3e1ffbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:18.994878 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a583366-aaa5-4b7a-856d-f446e3e1ffbd service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:18.995193 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a583366-aaa5-4b7a-856d-f446e3e1ffbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:18.998552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a583366-aaa5-4b7a-856d-f446e3e1ffbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:19.176231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a583366-aaa5-4b7a-856d-f446e3e1ffbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:19.184933 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a583366-aaa5-4b7a-856d-f446e3e1ffbd service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:19.219658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 850/1722] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:19.279345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e75b9-4968-4f5a-b212-56c142f48a93 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:19.296094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e75b9-4968-4f5a-b212-56c142f48a93 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:19.298095 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e730dd1-bda6-4c8c-82ac-a544f736e5fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:19.298755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e730dd1-bda6-4c8c-82ac-a544f736e5fd service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:19.299151 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e730dd1-bda6-4c8c-82ac-a544f736e5fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:19.299520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e730dd1-bda6-4c8c-82ac-a544f736e5fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:19.305664 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7e730dd1-bda6-4c8c-82ac-a544f736e5fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:19.440344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e730dd1-bda6-4c8c-82ac-a544f736e5fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:19.441948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e730dd1-bda6-4c8c-82ac-a544f736e5fd service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:19.462224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 873/1723] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:19 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:19.530593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3209304-57bb-4ce9-b6af-67fd8d74b974 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:19.531074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3209304-57bb-4ce9-b6af-67fd8d74b974 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:19.531173 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3209304-57bb-4ce9-b6af-67fd8d74b974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:19.600982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a3209304-57bb-4ce9-b6af-67fd8d74b974 None None] MFA Rules not processed for user `8cc69cd4250c436e8b893887604b2273`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:19.620116 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a3209304-57bb-4ce9-b6af-67fd8d74b974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:19.780840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 851/1724] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:19.783518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e02f76-a23b-44e1-ab90-1b77250bf7a9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:19.784073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e02f76-a23b-44e1-ab90-1b77250bf7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:19.784361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e02f76-a23b-44e1-ab90-1b77250bf7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:19.841478 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d5e02f76-a23b-44e1-ab90-1b77250bf7a9 None None] MFA Rules not processed for user `8cc69cd4250c436e8b893887604b2273`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:19.842938 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d5e02f76-a23b-44e1-ab90-1b77250bf7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:19.864035 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 874/1725] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:19.880225 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3209304-57bb-4ce9-b6af-67fd8d74b974 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:19.882288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a3209304-57bb-4ce9-b6af-67fd8d74b974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:20.020893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3209304-57bb-4ce9-b6af-67fd8d74b974 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:20.020893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94a70d-ce42-4f3b-a288-cc8a77cb379d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:20.020893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94a70d-ce42-4f3b-a288-cc8a77cb379d service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:20.020893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94a70d-ce42-4f3b-a288-cc8a77cb379d service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:20.021308 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94a70d-ce42-4f3b-a288-cc8a77cb379d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:20.045400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94a70d-ce42-4f3b-a288-cc8a77cb379d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:20.050370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94a70d-ce42-4f3b-a288-cc8a77cb379d service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:20.108917 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 852/1726] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:21.112929 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a84b4-d514-44f4-9d6f-075e070179d7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:21.113929 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a84b4-d514-44f4-9d6f-075e070179d7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:21.114591 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a84b4-d514-44f4-9d6f-075e070179d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:21.178841 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c44a84b4-d514-44f4-9d6f-075e070179d7 None None] MFA Rules not processed for user `c084b56d682c44119654743809109bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:21.185466 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c44a84b4-d514-44f4-9d6f-075e070179d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:21.206256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 875/1727] 10.222.0.24 () {58 vars in 1009 bytes} [Tue May 17 22:09:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:21.211680 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d932c-cda2-4166-bca1-d487649c4214 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:21.211680 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d932c-cda2-4166-bca1-d487649c4214 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:21.211680 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d932c-cda2-4166-bca1-d487649c4214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:21.309930 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6f2d932c-cda2-4166-bca1-d487649c4214 None None] MFA Rules not processed for user `532092f483874f05bc119211b9624492`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:21.319651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6f2d932c-cda2-4166-bca1-d487649c4214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:21.338328 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a84b4-d514-44f4-9d6f-075e070179d7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:21.340118 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c44a84b4-d514-44f4-9d6f-075e070179d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:21.366475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a84b4-d514-44f4-9d6f-075e070179d7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:21.383923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bfe2d-1afc-4292-9f40-3f8054ba8e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:21.384723 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bfe2d-1afc-4292-9f40-3f8054ba8e36 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:21.385113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bfe2d-1afc-4292-9f40-3f8054ba8e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:21.385525 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bfe2d-1afc-4292-9f40-3f8054ba8e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:21.413862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bfe2d-1afc-4292-9f40-3f8054ba8e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:21.424613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bfe2d-1afc-4292-9f40-3f8054ba8e36 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:21.443098 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 876/1728] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:09:21.484646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 853/1729] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:21.900112 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bfe2d-1afc-4292-9f40-3f8054ba8e36 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:21.901742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-313bfe2d-1afc-4292-9f40-3f8054ba8e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:21.924945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8f58-4730-41d0-9d92-6535038f10ff None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:21.931040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8f58-4730-41d0-9d92-6535038f10ff None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:21.931040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8f58-4730-41d0-9d92-6535038f10ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:21.956467 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bfe2d-1afc-4292-9f40-3f8054ba8e36 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:21.970175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8aa969-4c17-444d-8d41-00bf376756a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:21.970175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aa969-4c17-444d-8d41-00bf376756a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:21.970175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aa969-4c17-444d-8d41-00bf376756a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:21.970175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aa969-4c17-444d-8d41-00bf376756a4 admin admin] PATH_INFO: `/v3/projects/21f0cc2426ff462e8f8c71ad302296b4` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:21.974569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8aa969-4c17-444d-8d41-00bf376756a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f0cc2426ff462e8f8c71ad302296b4)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:21.977756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8aa969-4c17-444d-8d41-00bf376756a4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:22.020317 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-955d8f58-4730-41d0-9d92-6535038f10ff None None] MFA Rules not processed for user `4bbb6a0a08464e738ef0d062dfe87182`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:22.025494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-955d8f58-4730-41d0-9d92-6535038f10ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:22.162552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 854/1730] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:22.166724 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc8aa969-4c17-444d-8d41-00bf376756a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f0cc2426ff462e8f8c71ad302296b4', 'request_id': 'req-cc8aa969-4c17-444d-8d41-00bf376756a4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:22.175202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc8aa969-4c17-444d-8d41-00bf376756a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f0cc2426ff462e8f8c71ad302296b4', 'request_id': 'req-cc8aa969-4c17-444d-8d41-00bf376756a4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:22.215278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc8aa969-4c17-444d-8d41-00bf376756a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f0cc2426ff462e8f8c71ad302296b4', 'request_id': 'req-cc8aa969-4c17-444d-8d41-00bf376756a4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:22.311847 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc8aa969-4c17-444d-8d41-00bf376756a4 admin admin] The token cache is being invalidate because project 21f0cc2426ff462e8f8c71ad302296b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:22.312421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc8aa969-4c17-444d-8d41-00bf376756a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:22.313302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc8aa969-4c17-444d-8d41-00bf376756a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:22.316294 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 877/1731] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:21 2022] DELETE /identity/v3/projects/21f0cc2426ff462e8f8c71ad302296b4 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:22.320845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8f58-4730-41d0-9d92-6535038f10ff None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:22.336018 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8f58-4730-41d0-9d92-6535038f10ff None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:22.439911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda91c0a-e639-4866-81f0-bd3d58f37a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:22.446635 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda91c0a-e639-4866-81f0-bd3d58f37a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:22.446635 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda91c0a-e639-4866-81f0-bd3d58f37a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:22.446635 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda91c0a-e639-4866-81f0-bd3d58f37a70 admin admin] PATH_INFO: `/v3/users/658daf1c089048dd88973fd6fda1bba0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:22.446635 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda91c0a-e639-4866-81f0-bd3d58f37a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658daf1c089048dd88973fd6fda1bba0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:22.447288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda91c0a-e639-4866-81f0-bd3d58f37a70 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:22.699727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bda91c0a-e639-4866-81f0-bd3d58f37a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658daf1c089048dd88973fd6fda1bba0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:22.786531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bda91c0a-e639-4866-81f0-bd3d58f37a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658daf1c089048dd88973fd6fda1bba0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:22.786917 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bda91c0a-e639-4866-81f0-bd3d58f37a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658daf1c089048dd88973fd6fda1bba0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:22.927843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bda91c0a-e639-4866-81f0-bd3d58f37a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658daf1c089048dd88973fd6fda1bba0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:22.928750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bda91c0a-e639-4866-81f0-bd3d58f37a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658daf1c089048dd88973fd6fda1bba0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:22.974508 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 855/1732] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:22 2022] DELETE /identity/v3/users/658daf1c089048dd88973fd6fda1bba0 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:23.745962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8aa969-4c17-444d-8d41-00bf376756a4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:23.748428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cc8aa969-4c17-444d-8d41-00bf376756a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:23.779332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8aa969-4c17-444d-8d41-00bf376756a4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:24.027663 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb4cda-9c71-4f61-a83e-5afe0a903afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:24.029615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb4cda-9c71-4f61-a83e-5afe0a903afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:24.030069 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb4cda-9c71-4f61-a83e-5afe0a903afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:24.030510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb4cda-9c71-4f61-a83e-5afe0a903afe admin admin] PATH_INFO: `/v3/projects/5678724554af4e2c852b73173fe68bc8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:24.032117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb4cda-9c71-4f61-a83e-5afe0a903afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5678724554af4e2c852b73173fe68bc8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:24.035036 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb4cda-9c71-4f61-a83e-5afe0a903afe admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:24.140867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd1e8c-add8-4511-a5c6-4d7be0803c50 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:24.141343 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd1e8c-add8-4511-a5c6-4d7be0803c50 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:24.141431 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd1e8c-add8-4511-a5c6-4d7be0803c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:24.183766 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-25dd1e8c-add8-4511-a5c6-4d7be0803c50 None None] MFA Rules not processed for user `626cf3ce22fd4d019022b52e21916a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:24.189014 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-25dd1e8c-add8-4511-a5c6-4d7be0803c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:24.205611 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f0bb4cda-9c71-4f61-a83e-5afe0a903afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5678724554af4e2c852b73173fe68bc8', 'request_id': 'req-f0bb4cda-9c71-4f61-a83e-5afe0a903afe'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:24.241781 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f0bb4cda-9c71-4f61-a83e-5afe0a903afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5678724554af4e2c852b73173fe68bc8', 'request_id': 'req-f0bb4cda-9c71-4f61-a83e-5afe0a903afe'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:24.249872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f0bb4cda-9c71-4f61-a83e-5afe0a903afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5678724554af4e2c852b73173fe68bc8', 'request_id': 'req-f0bb4cda-9c71-4f61-a83e-5afe0a903afe'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:24.323639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 856/1733] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:24.380378 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f0bb4cda-9c71-4f61-a83e-5afe0a903afe admin admin] The token cache is being invalidate because project 5678724554af4e2c852b73173fe68bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:24.380708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f0bb4cda-9c71-4f61-a83e-5afe0a903afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:24.382099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f0bb4cda-9c71-4f61-a83e-5afe0a903afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:24.387668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd1e8c-add8-4511-a5c6-4d7be0803c50 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:24.389369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-25dd1e8c-add8-4511-a5c6-4d7be0803c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:24.403842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 878/1734] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:23 2022] DELETE /identity/v3/projects/5678724554af4e2c852b73173fe68bc8 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:24.416853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150b898-020d-4148-8386-db9c09eec29a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:24.417361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150b898-020d-4148-8386-db9c09eec29a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:24.417981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150b898-020d-4148-8386-db9c09eec29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:24.476349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0150b898-020d-4148-8386-db9c09eec29a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:24.478342 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0150b898-020d-4148-8386-db9c09eec29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:24.603972 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd1e8c-add8-4511-a5c6-4d7be0803c50 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:24.619126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cefa85-ed69-42dc-8d4e-f4a6824ba148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:24.620191 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cefa85-ed69-42dc-8d4e-f4a6824ba148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:24.621052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cefa85-ed69-42dc-8d4e-f4a6824ba148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:24.621401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cefa85-ed69-42dc-8d4e-f4a6824ba148 admin admin] PATH_INFO: `/v3/users/3fe9f956ca21488cae8120c7bd717bc1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:24.639973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cefa85-ed69-42dc-8d4e-f4a6824ba148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe9f956ca21488cae8120c7bd717bc1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:24.655057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cefa85-ed69-42dc-8d4e-f4a6824ba148 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:24.728465 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 879/1735] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:24.736463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f8c83-995f-49fe-b8bd-368e91db97ff None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:24.736762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f8c83-995f-49fe-b8bd-368e91db97ff None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:24.748798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f8c83-995f-49fe-b8bd-368e91db97ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:24.841076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-401f8c83-995f-49fe-b8bd-368e91db97ff None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:24.842501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-401f8c83-995f-49fe-b8bd-368e91db97ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:24.874822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 880/1736] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:24.879213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f8c83-995f-49fe-b8bd-368e91db97ff None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:24.891612 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f8c83-995f-49fe-b8bd-368e91db97ff None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:24.909217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c342c-1a2c-4924-920b-5bfebbfdd086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:24.909217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c342c-1a2c-4924-920b-5bfebbfdd086 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:24.909217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c342c-1a2c-4924-920b-5bfebbfdd086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:24.909217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c342c-1a2c-4924-920b-5bfebbfdd086 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:24.909557 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c342c-1a2c-4924-920b-5bfebbfdd086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:09:24.909557 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c342c-1a2c-4924-920b-5bfebbfdd086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:24.909557 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c342c-1a2c-4924-920b-5bfebbfdd086 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:24.932610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f5cefa85-ed69-42dc-8d4e-f4a6824ba148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe9f956ca21488cae8120c7bd717bc1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:24.933947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 881/1737] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:09:24.937668 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c342c-1a2c-4924-920b-5bfebbfdd086 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:24.963438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f5cefa85-ed69-42dc-8d4e-f4a6824ba148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe9f956ca21488cae8120c7bd717bc1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:24.964698 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f5cefa85-ed69-42dc-8d4e-f4a6824ba148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe9f956ca21488cae8120c7bd717bc1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:24.977294 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c342c-1a2c-4924-920b-5bfebbfdd086 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:25.029173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e2f21-48d7-4b72-9675-7068f3100ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:25.032104 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e2f21-48d7-4b72-9675-7068f3100ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:25.034616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e2f21-48d7-4b72-9675-7068f3100ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:25.035128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e2f21-48d7-4b72-9675-7068f3100ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:25.036170 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e2f21-48d7-4b72-9675-7068f3100ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:25.040763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e2f21-48d7-4b72-9675-7068f3100ec8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:25.055087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f5cefa85-ed69-42dc-8d4e-f4a6824ba148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe9f956ca21488cae8120c7bd717bc1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:25.056055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f5cefa85-ed69-42dc-8d4e-f4a6824ba148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe9f956ca21488cae8120c7bd717bc1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:25.082648 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 857/1738] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:24 2022] DELETE /identity/v3/users/3fe9f956ca21488cae8120c7bd717bc1 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:25.084179 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf347e-2fdc-4d43-bf6b-8d3738865e8c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:25.084571 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf347e-2fdc-4d43-bf6b-8d3738865e8c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:25.084855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf347e-2fdc-4d43-bf6b-8d3738865e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:25.169605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-13bf347e-2fdc-4d43-bf6b-8d3738865e8c None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:25.171047 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 882/1739] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:24 2022] POST /identity/v3/projects => generated 387 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:25.176701 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-13bf347e-2fdc-4d43-bf6b-8d3738865e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:25.177606 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96542bba-8d99-4a2b-aaad-bcc426856fd1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:25.185409 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96542bba-8d99-4a2b-aaad-bcc426856fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:25.185768 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96542bba-8d99-4a2b-aaad-bcc426856fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:25.365583 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-96542bba-8d99-4a2b-aaad-bcc426856fd1 None None] MFA Rules not processed for user `8cc69cd4250c436e8b893887604b2273`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:25.384664 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-96542bba-8d99-4a2b-aaad-bcc426856fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:25.485251 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 858/1740] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:25.516742 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf347e-2fdc-4d43-bf6b-8d3738865e8c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:25.523755 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-13bf347e-2fdc-4d43-bf6b-8d3738865e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:25.541507 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 883/1741] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:25.545476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96542bba-8d99-4a2b-aaad-bcc426856fd1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:25.566271 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf347e-2fdc-4d43-bf6b-8d3738865e8c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:25.574720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4065d-a138-424f-a659-ad05d5764bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:25.576656 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-96542bba-8d99-4a2b-aaad-bcc426856fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:25.578784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4065d-a138-424f-a659-ad05d5764bcc admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:25.579207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4065d-a138-424f-a659-ad05d5764bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:25.579562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4065d-a138-424f-a659-ad05d5764bcc admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:25.580922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4065d-a138-424f-a659-ad05d5764bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:25.589153 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4065d-a138-424f-a659-ad05d5764bcc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:25.679752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 859/1742] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:25 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:25.682600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4065d-a138-424f-a659-ad05d5764bcc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:25.710421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96542bba-8d99-4a2b-aaad-bcc426856fd1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:25.716038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc8881-e6dc-4932-8436-855db551e486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:25.717038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc8881-e6dc-4932-8436-855db551e486 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:25.717402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc8881-e6dc-4932-8436-855db551e486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:25.717830 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc8881-e6dc-4932-8436-855db551e486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:25.719133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4065d-a138-424f-a659-ad05d5764bcc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:25.736491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a1c4c-42ac-4ee6-9469-35ffd535c8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:25.742164 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a1c4c-42ac-4ee6-9469-35ffd535c8ef admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:25.742516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a1c4c-42ac-4ee6-9469-35ffd535c8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:25.742800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a1c4c-42ac-4ee6-9469-35ffd535c8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:25.743895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a1c4c-42ac-4ee6-9469-35ffd535c8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:25.752459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a1c4c-42ac-4ee6-9469-35ffd535c8ef admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:25.775624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 860/1743] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:25.777368 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc8881-e6dc-4932-8436-855db551e486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:25.786138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a1c4c-42ac-4ee6-9469-35ffd535c8ef admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:25.787485 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc8881-e6dc-4932-8436-855db551e486 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:25.816821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 884/1744] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:25.821064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a1c4c-42ac-4ee6-9469-35ffd535c8ef admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:25.852643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fb40b-b3cb-425f-99cf-562c7778a868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:25.852643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb40b-b3cb-425f-99cf-562c7778a868 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:25.852643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb40b-b3cb-425f-99cf-562c7778a868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:25.852643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb40b-b3cb-425f-99cf-562c7778a868 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:25.869130 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fb40b-b3cb-425f-99cf-562c7778a868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:25.872799 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fb40b-b3cb-425f-99cf-562c7778a868 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:25.938268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 861/1745] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:25.939524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc8881-e6dc-4932-8436-855db551e486 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:25.953635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc8881-e6dc-4932-8436-855db551e486 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:25.970379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57085474-963b-412d-b3e4-b12333b5543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:25.970582 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57085474-963b-412d-b3e4-b12333b5543f admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:25.971676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57085474-963b-412d-b3e4-b12333b5543f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:25.973692 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57085474-963b-412d-b3e4-b12333b5543f admin admin] PATH_INFO: `/v3/projects/7c3737a89b52491880532569018a624c/users/8986fe3662f14cad99762284dd7658b5/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:26.040920 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57085474-963b-412d-b3e4-b12333b5543f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3737a89b52491880532569018a624c, user_id=8986fe3662f14cad99762284dd7658b5, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:26.046075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57085474-963b-412d-b3e4-b12333b5543f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:26.166310 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 885/1746] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:25 2022] PUT /identity/v3/projects/7c3737a89b52491880532569018a624c/users/8986fe3662f14cad99762284dd7658b5/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:26.179321 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e76756-4c86-41db-be50-82c52aa75baa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:26.179871 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e76756-4c86-41db-be50-82c52aa75baa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:26.179871 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e76756-4c86-41db-be50-82c52aa75baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:26.264607 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-22e76756-4c86-41db-be50-82c52aa75baa None None] MFA Rules not processed for user `8986fe3662f14cad99762284dd7658b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:26.266267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-22e76756-4c86-41db-be50-82c52aa75baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:26.363647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57085474-963b-412d-b3e4-b12333b5543f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:26.369767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 862/1747] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:26.575154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57085474-963b-412d-b3e4-b12333b5543f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:26.582292 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e979e-bebf-485f-afcc-aeb077cba2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:26.582970 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e979e-bebf-485f-afcc-aeb077cba2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:26.583278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e979e-bebf-485f-afcc-aeb077cba2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:26.583558 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e979e-bebf-485f-afcc-aeb077cba2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:26.584305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e979e-bebf-485f-afcc-aeb077cba2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:26.599795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e979e-bebf-485f-afcc-aeb077cba2d7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:26.731088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 886/1748] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:26 2022] POST /identity/v3/projects => generated 387 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:26.732343 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e76756-4c86-41db-be50-82c52aa75baa None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:26.745331 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e76756-4c86-41db-be50-82c52aa75baa None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:26.775098 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e979e-bebf-485f-afcc-aeb077cba2d7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:26.778099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ad2e979e-bebf-485f-afcc-aeb077cba2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:26.912138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8a660-72bb-44c9-a7be-eb75b8c398c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:26.914666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8a660-72bb-44c9-a7be-eb75b8c398c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:26.914961 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8a660-72bb-44c9-a7be-eb75b8c398c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:26.915332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8a660-72bb-44c9-a7be-eb75b8c398c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:26.916393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8a660-72bb-44c9-a7be-eb75b8c398c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:26.918356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8a660-72bb-44c9-a7be-eb75b8c398c6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:26.963147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e979e-bebf-485f-afcc-aeb077cba2d7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:26.968766 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19e664-c739-4867-9aa9-3d34c04d2b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:26.969625 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19e664-c739-4867-9aa9-3d34c04d2b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:26.969900 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19e664-c739-4867-9aa9-3d34c04d2b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:26.970171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19e664-c739-4867-9aa9-3d34c04d2b28 admin admin] PATH_INFO: `/v3/projects/2c2f16cf39e7413ab1edbc470dc20176` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:26.971503 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19e664-c739-4867-9aa9-3d34c04d2b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c2f16cf39e7413ab1edbc470dc20176)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:26.979936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19e664-c739-4867-9aa9-3d34c04d2b28 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:27.055299 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 863/1749] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:26 2022] POST /identity/v3/users => generated 300 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:27.059665 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8a660-72bb-44c9-a7be-eb75b8c398c6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:27.083540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8a660-72bb-44c9-a7be-eb75b8c398c6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:27.103679 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9e19e664-c739-4867-9aa9-3d34c04d2b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c2f16cf39e7413ab1edbc470dc20176', 'request_id': 'req-9e19e664-c739-4867-9aa9-3d34c04d2b28'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:27.120631 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9e19e664-c739-4867-9aa9-3d34c04d2b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c2f16cf39e7413ab1edbc470dc20176', 'request_id': 'req-9e19e664-c739-4867-9aa9-3d34c04d2b28'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:27.153438 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9e19e664-c739-4867-9aa9-3d34c04d2b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c2f16cf39e7413ab1edbc470dc20176', 'request_id': 'req-9e19e664-c739-4867-9aa9-3d34c04d2b28'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:27.209997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d4c97-1863-4d85-a60d-e8114d76dc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:27.210671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d4c97-1863-4d85-a60d-e8114d76dc7c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:27.210955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d4c97-1863-4d85-a60d-e8114d76dc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:27.211277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d4c97-1863-4d85-a60d-e8114d76dc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:27.212010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d4c97-1863-4d85-a60d-e8114d76dc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:27.213823 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d4c97-1863-4d85-a60d-e8114d76dc7c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:27.228936 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 864/1750] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:09:27.230033 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d4c97-1863-4d85-a60d-e8114d76dc7c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:27.245242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9e19e664-c739-4867-9aa9-3d34c04d2b28 admin admin] The token cache is being invalidate because project 2c2f16cf39e7413ab1edbc470dc20176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:27.245356 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9e19e664-c739-4867-9aa9-3d34c04d2b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:27.246504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9e19e664-c739-4867-9aa9-3d34c04d2b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:27.251309 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 887/1751] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:26 2022] DELETE /identity/v3/projects/2c2f16cf39e7413ab1edbc470dc20176 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:27.252567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19e664-c739-4867-9aa9-3d34c04d2b28 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:27.258726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9e19e664-c739-4867-9aa9-3d34c04d2b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:27.258989 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d4c97-1863-4d85-a60d-e8114d76dc7c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:27.272517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a7d87-6e77-4048-a636-23c7e2f67b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:27.272517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a7d87-6e77-4048-a636-23c7e2f67b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:27.272517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a7d87-6e77-4048-a636-23c7e2f67b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:27.272517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a7d87-6e77-4048-a636-23c7e2f67b91 admin admin] PATH_INFO: `/v3/projects/2577c84ec4124b7eb56347d184737014/users/131c5964bf5c439cb32b4c2dae9bf77e/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:27.287552 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19e664-c739-4867-9aa9-3d34c04d2b28 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:27.304787 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83967e-5d93-42d7-8004-301f13964bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:27.305855 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83967e-5d93-42d7-8004-301f13964bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:27.306149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83967e-5d93-42d7-8004-301f13964bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:27.306860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83967e-5d93-42d7-8004-301f13964bcf admin admin] PATH_INFO: `/v3/users/3d0c55b9977a49b5a0b492e45b476ad6` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:27.308176 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83967e-5d93-42d7-8004-301f13964bcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0c55b9977a49b5a0b492e45b476ad6)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:27.310218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a7d87-6e77-4048-a636-23c7e2f67b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2577c84ec4124b7eb56347d184737014, user_id=131c5964bf5c439cb32b4c2dae9bf77e, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:27.310451 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83967e-5d93-42d7-8004-301f13964bcf admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:27.315615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a7d87-6e77-4048-a636-23c7e2f67b91 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:27.411196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 865/1752] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:27 2022] PUT /identity/v3/projects/2577c84ec4124b7eb56347d184737014/users/131c5964bf5c439cb32b4c2dae9bf77e/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:27.418068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a7d87-6e77-4048-a636-23c7e2f67b91 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:27.418068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1c9a7d87-6e77-4048-a636-23c7e2f67b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:27.503034 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a7d87-6e77-4048-a636-23c7e2f67b91 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:27.516734 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dee97-36a1-44c9-8a96-3571b8037975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:27.517436 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dee97-36a1-44c9-8a96-3571b8037975 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:27.517726 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dee97-36a1-44c9-8a96-3571b8037975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:27.518021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dee97-36a1-44c9-8a96-3571b8037975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:27.518888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dee97-36a1-44c9-8a96-3571b8037975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:27.520392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dee97-36a1-44c9-8a96-3571b8037975 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:27.522744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-1f83967e-5d93-42d7-8004-301f13964bcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0c55b9977a49b5a0b492e45b476ad6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:27.539030 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 866/1753] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:27.545344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-1f83967e-5d93-42d7-8004-301f13964bcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0c55b9977a49b5a0b492e45b476ad6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:27.549668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dee97-36a1-44c9-8a96-3571b8037975 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:27.567977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dee97-36a1-44c9-8a96-3571b8037975 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:27.573263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aeecaf-4835-415d-bd06-d1608bb36978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:27.574148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aeecaf-4835-415d-bd06-d1608bb36978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:27.584911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aeecaf-4835-415d-bd06-d1608bb36978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:27.584911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aeecaf-4835-415d-bd06-d1608bb36978 admin admin] PATH_INFO: `/v3/projects/2577c84ec4124b7eb56347d184737014/users/131c5964bf5c439cb32b4c2dae9bf77e/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:27.584911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aeecaf-4835-415d-bd06-d1608bb36978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2577c84ec4124b7eb56347d184737014, user_id=131c5964bf5c439cb32b4c2dae9bf77e, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:27.584911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aeecaf-4835-415d-bd06-d1608bb36978 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:27.589501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 867/1754] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:27 2022] PUT /identity/v3/projects/2577c84ec4124b7eb56347d184737014/users/131c5964bf5c439cb32b4c2dae9bf77e/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:09:27.600677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30e97c-4e1b-4d7c-b099-6343e2912fbc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:27.600876 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30e97c-4e1b-4d7c-b099-6343e2912fbc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:27.601203 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30e97c-4e1b-4d7c-b099-6343e2912fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:27.627045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-eb30e97c-4e1b-4d7c-b099-6343e2912fbc None None] MFA Rules not processed for user `131c5964bf5c439cb32b4c2dae9bf77e`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:27.628272 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-eb30e97c-4e1b-4d7c-b099-6343e2912fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:27.636967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-1f83967e-5d93-42d7-8004-301f13964bcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0c55b9977a49b5a0b492e45b476ad6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:27.638016 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-1f83967e-5d93-42d7-8004-301f13964bcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0c55b9977a49b5a0b492e45b476ad6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:27.638896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-1f83967e-5d93-42d7-8004-301f13964bcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0c55b9977a49b5a0b492e45b476ad6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:27.652435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 888/1755] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:27 2022] DELETE /identity/v3/users/3d0c55b9977a49b5a0b492e45b476ad6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:09:27.711544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 868/1756] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:27.722757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83967e-5d93-42d7-8004-301f13964bcf admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:27.723591 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1f83967e-5d93-42d7-8004-301f13964bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:27.780248 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83967e-5d93-42d7-8004-301f13964bcf admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:27.783786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5789fbf-f46d-4acc-8c97-387bf5587a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:27.784429 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5789fbf-f46d-4acc-8c97-387bf5587a72 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:27.784714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5789fbf-f46d-4acc-8c97-387bf5587a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:27.784988 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5789fbf-f46d-4acc-8c97-387bf5587a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:27.845309 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5789fbf-f46d-4acc-8c97-387bf5587a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:27.846733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5789fbf-f46d-4acc-8c97-387bf5587a72 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:27.857029 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 889/1757] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:28.014391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30e97c-4e1b-4d7c-b099-6343e2912fbc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:28.016816 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-eb30e97c-4e1b-4d7c-b099-6343e2912fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:28.129847 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30e97c-4e1b-4d7c-b099-6343e2912fbc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:28.200059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5789fbf-f46d-4acc-8c97-387bf5587a72 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:28.204856 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b5789fbf-f46d-4acc-8c97-387bf5587a72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:28.242775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b311e3-5fd9-4ca2-8aae-0d8f2a7ea059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:28.243777 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b311e3-5fd9-4ca2-8aae-0d8f2a7ea059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:28.244205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b311e3-5fd9-4ca2-8aae-0d8f2a7ea059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:28.244490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b311e3-5fd9-4ca2-8aae-0d8f2a7ea059 admin admin] PATH_INFO: `/v3/users/8986fe3662f14cad99762284dd7658b5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:28.255053 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b311e3-5fd9-4ca2-8aae-0d8f2a7ea059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8986fe3662f14cad99762284dd7658b5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:28.258188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b311e3-5fd9-4ca2-8aae-0d8f2a7ea059 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:28.357597 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5789fbf-f46d-4acc-8c97-387bf5587a72 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:28.359898 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5084a0-45a1-4035-9072-09e9aec11079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:28.361559 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5084a0-45a1-4035-9072-09e9aec11079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:28.361858 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5084a0-45a1-4035-9072-09e9aec11079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:28.362138 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5084a0-45a1-4035-9072-09e9aec11079 admin admin] PATH_INFO: `/v3/projects/1c66df6e88db4fe0a02ecf642edbb5a4` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:28.364015 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5084a0-45a1-4035-9072-09e9aec11079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c66df6e88db4fe0a02ecf642edbb5a4)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:28.366602 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5084a0-45a1-4035-9072-09e9aec11079 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:28.526939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90b311e3-5fd9-4ca2-8aae-0d8f2a7ea059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8986fe3662f14cad99762284dd7658b5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:28.542590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9a5084a0-45a1-4035-9072-09e9aec11079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c66df6e88db4fe0a02ecf642edbb5a4', 'request_id': 'req-9a5084a0-45a1-4035-9072-09e9aec11079'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:28.542858 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9a5084a0-45a1-4035-9072-09e9aec11079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c66df6e88db4fe0a02ecf642edbb5a4', 'request_id': 'req-9a5084a0-45a1-4035-9072-09e9aec11079'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:28.544175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90b311e3-5fd9-4ca2-8aae-0d8f2a7ea059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8986fe3662f14cad99762284dd7658b5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:28.544924 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90b311e3-5fd9-4ca2-8aae-0d8f2a7ea059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8986fe3662f14cad99762284dd7658b5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:28.549429 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9a5084a0-45a1-4035-9072-09e9aec11079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c66df6e88db4fe0a02ecf642edbb5a4', 'request_id': 'req-9a5084a0-45a1-4035-9072-09e9aec11079'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:28.649100 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90b311e3-5fd9-4ca2-8aae-0d8f2a7ea059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8986fe3662f14cad99762284dd7658b5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:28.649750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90b311e3-5fd9-4ca2-8aae-0d8f2a7ea059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8986fe3662f14cad99762284dd7658b5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:28.664488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 869/1758] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:28 2022] DELETE /identity/v3/users/8986fe3662f14cad99762284dd7658b5 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:28.668821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445deb2a-7370-4c27-b09a-a806084db76a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:28.669258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445deb2a-7370-4c27-b09a-a806084db76a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:28.669544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445deb2a-7370-4c27-b09a-a806084db76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:28.687198 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-445deb2a-7370-4c27-b09a-a806084db76a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:28.688420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-445deb2a-7370-4c27-b09a-a806084db76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:28.749195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9a5084a0-45a1-4035-9072-09e9aec11079 admin admin] The token cache is being invalidate because project 1c66df6e88db4fe0a02ecf642edbb5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:28.749839 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9a5084a0-45a1-4035-9072-09e9aec11079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:28.750773 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9a5084a0-45a1-4035-9072-09e9aec11079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:28.753015 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 890/1759] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:28 2022] DELETE /identity/v3/projects/1c66df6e88db4fe0a02ecf642edbb5a4 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:28.757875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e713b-5972-4104-8926-3b9d13cbec83 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:28.760015 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e713b-5972-4104-8926-3b9d13cbec83 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:28.760546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e713b-5972-4104-8926-3b9d13cbec83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:28.769395 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 870/1760] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:28.782911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445deb2a-7370-4c27-b09a-a806084db76a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:28.785227 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-445deb2a-7370-4c27-b09a-a806084db76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:28.791052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f39e713b-5972-4104-8926-3b9d13cbec83 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:28.793242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f39e713b-5972-4104-8926-3b9d13cbec83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:28.810377 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 891/1761] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:28.818010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924e088-9337-4e63-a8b4-a204211eaca1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:28.818274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924e088-9337-4e63-a8b4-a204211eaca1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:28.818753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924e088-9337-4e63-a8b4-a204211eaca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:28.862809 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f924e088-9337-4e63-a8b4-a204211eaca1 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:28.865047 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445deb2a-7370-4c27-b09a-a806084db76a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:28.865162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f924e088-9337-4e63-a8b4-a204211eaca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:28.868596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93f793-8d2c-4630-9a85-7fe08ddfa3a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:28.869328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93f793-8d2c-4630-9a85-7fe08ddfa3a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:28.869684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93f793-8d2c-4630-9a85-7fe08ddfa3a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:28.870023 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93f793-8d2c-4630-9a85-7fe08ddfa3a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:28.875058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 892/1762] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:28.878778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924e088-9337-4e63-a8b4-a204211eaca1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:28.881679 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93f793-8d2c-4630-9a85-7fe08ddfa3a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:28.883223 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93f793-8d2c-4630-9a85-7fe08ddfa3a8 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:28.889789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924e088-9337-4e63-a8b4-a204211eaca1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:28.896005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 871/1763] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:28.918486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acda428-7fda-4898-8dda-a7f529ffb4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:28.919287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acda428-7fda-4898-8dda-a7f529ffb4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:28.919636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acda428-7fda-4898-8dda-a7f529ffb4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:28.920077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acda428-7fda-4898-8dda-a7f529ffb4f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:28.921144 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acda428-7fda-4898-8dda-a7f529ffb4f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:09:28.921460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acda428-7fda-4898-8dda-a7f529ffb4f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:28.935640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acda428-7fda-4898-8dda-a7f529ffb4f6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:28.961028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 893/1764] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:09:28.965616 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93f793-8d2c-4630-9a85-7fe08ddfa3a8 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:28.978497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93f793-8d2c-4630-9a85-7fe08ddfa3a8 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:28.985814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881d661-9e61-4f79-bccf-754a2fb5a26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:28.986803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881d661-9e61-4f79-bccf-754a2fb5a26f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:28.987095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881d661-9e61-4f79-bccf-754a2fb5a26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:28.987414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881d661-9e61-4f79-bccf-754a2fb5a26f admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:28.988306 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881d661-9e61-4f79-bccf-754a2fb5a26f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:28.990134 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881d661-9e61-4f79-bccf-754a2fb5a26f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:29.109346 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 872/1765] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:28 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:29.113140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acda428-7fda-4898-8dda-a7f529ffb4f6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:29.128640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acda428-7fda-4898-8dda-a7f529ffb4f6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:29.227312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124fc5b-17ad-43f4-823b-353f7f2cace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:29.229484 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124fc5b-17ad-43f4-823b-353f7f2cace8 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:29.230005 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124fc5b-17ad-43f4-823b-353f7f2cace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:29.230534 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124fc5b-17ad-43f4-823b-353f7f2cace8 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:29.231650 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124fc5b-17ad-43f4-823b-353f7f2cace8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:29.234551 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124fc5b-17ad-43f4-823b-353f7f2cace8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:29.352253 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 894/1766] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:29 2022] POST /identity/v3/users => generated 284 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:09:29.353401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881d661-9e61-4f79-bccf-754a2fb5a26f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:29.369084 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881d661-9e61-4f79-bccf-754a2fb5a26f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:29.383056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829ea12-edb9-4a63-b014-592f4a60c369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:29.384140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829ea12-edb9-4a63-b014-592f4a60c369 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:29.384639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829ea12-edb9-4a63-b014-592f4a60c369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:29.385244 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829ea12-edb9-4a63-b014-592f4a60c369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:29.386260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829ea12-edb9-4a63-b014-592f4a60c369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:29.388283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829ea12-edb9-4a63-b014-592f4a60c369 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:29.427355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 873/1767] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:09:29.430473 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124fc5b-17ad-43f4-823b-353f7f2cace8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:29.447385 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124fc5b-17ad-43f4-823b-353f7f2cace8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:29.455541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38359623-046a-4889-96c9-15b9ac569765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:29.456316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38359623-046a-4889-96c9-15b9ac569765 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:29.456603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38359623-046a-4889-96c9-15b9ac569765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:29.456877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38359623-046a-4889-96c9-15b9ac569765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:29.457612 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38359623-046a-4889-96c9-15b9ac569765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:29.459426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38359623-046a-4889-96c9-15b9ac569765 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:29.479585 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 895/1768] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:29.480966 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829ea12-edb9-4a63-b014-592f4a60c369 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:29.500480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829ea12-edb9-4a63-b014-592f4a60c369 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:29.519353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67675f76-b283-407a-beb8-a4c7e0b2729a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:29.520411 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67675f76-b283-407a-beb8-a4c7e0b2729a admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:29.520793 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67675f76-b283-407a-beb8-a4c7e0b2729a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:29.522378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67675f76-b283-407a-beb8-a4c7e0b2729a admin admin] PATH_INFO: `/v3/projects/58524081427d456495717525dc880e20/users/5bed9974f52b4bd5b1fe98252a53692b/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:29.542385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67675f76-b283-407a-beb8-a4c7e0b2729a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58524081427d456495717525dc880e20, user_id=5bed9974f52b4bd5b1fe98252a53692b, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:29.545093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67675f76-b283-407a-beb8-a4c7e0b2729a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:29.602905 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38359623-046a-4889-96c9-15b9ac569765 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:29.604691 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-38359623-046a-4889-96c9-15b9ac569765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:29.627407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 874/1769] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:29 2022] PUT /identity/v3/projects/58524081427d456495717525dc880e20/users/5bed9974f52b4bd5b1fe98252a53692b/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:29.637536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38359623-046a-4889-96c9-15b9ac569765 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:29.641709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64843e-352f-408b-bec4-456fae4d5a36 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:29.641867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64843e-352f-408b-bec4-456fae4d5a36 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:29.642111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64843e-352f-408b-bec4-456fae4d5a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:29.681848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6c64843e-352f-408b-bec4-456fae4d5a36 None None] MFA Rules not processed for user `5bed9974f52b4bd5b1fe98252a53692b`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:29.683335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6c64843e-352f-408b-bec4-456fae4d5a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:29.726709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6f234-8311-4c5e-b543-5436d7c6d8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:29.726889 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6f234-8311-4c5e-b543-5436d7c6d8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:29.727214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6f234-8311-4c5e-b543-5436d7c6d8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:29.727495 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6f234-8311-4c5e-b543-5436d7c6d8bb admin admin] PATH_INFO: `/v3/projects/7c3737a89b52491880532569018a624c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:29.728720 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6f234-8311-4c5e-b543-5436d7c6d8bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3737a89b52491880532569018a624c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:29.730891 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6f234-8311-4c5e-b543-5436d7c6d8bb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:29.814788 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 875/1770] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:29.818207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64843e-352f-408b-bec4-456fae4d5a36 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:29.865311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64843e-352f-408b-bec4-456fae4d5a36 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:29.876525 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-33a6f234-8311-4c5e-b543-5436d7c6d8bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3737a89b52491880532569018a624c', 'request_id': 'req-33a6f234-8311-4c5e-b543-5436d7c6d8bb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:29.898214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-33a6f234-8311-4c5e-b543-5436d7c6d8bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3737a89b52491880532569018a624c', 'request_id': 'req-33a6f234-8311-4c5e-b543-5436d7c6d8bb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:29.919062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-33a6f234-8311-4c5e-b543-5436d7c6d8bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3737a89b52491880532569018a624c', 'request_id': 'req-33a6f234-8311-4c5e-b543-5436d7c6d8bb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:30.026703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10b47f-6f7d-4917-85bb-c2dd3e9d4176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:30.027138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10b47f-6f7d-4917-85bb-c2dd3e9d4176 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:30.027426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10b47f-6f7d-4917-85bb-c2dd3e9d4176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:30.027713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10b47f-6f7d-4917-85bb-c2dd3e9d4176 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:30.028406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10b47f-6f7d-4917-85bb-c2dd3e9d4176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:30.030486 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10b47f-6f7d-4917-85bb-c2dd3e9d4176 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:30.057329 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-33a6f234-8311-4c5e-b543-5436d7c6d8bb admin admin] The token cache is being invalidate because project 7c3737a89b52491880532569018a624c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:30.059055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-33a6f234-8311-4c5e-b543-5436d7c6d8bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:30.061084 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-33a6f234-8311-4c5e-b543-5436d7c6d8bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:30.065239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 896/1771] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:29 2022] DELETE /identity/v3/projects/7c3737a89b52491880532569018a624c => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:09:30.069567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6f234-8311-4c5e-b543-5436d7c6d8bb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:30.076201 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-33a6f234-8311-4c5e-b543-5436d7c6d8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:30.103146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6f234-8311-4c5e-b543-5436d7c6d8bb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:30.109537 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef2366-bc5a-4d38-b0a1-d9663f30fc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:30.110800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2366-bc5a-4d38-b0a1-d9663f30fc9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:30.111231 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2366-bc5a-4d38-b0a1-d9663f30fc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:30.111605 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2366-bc5a-4d38-b0a1-d9663f30fc9b admin admin] PATH_INFO: `/v3/users/131c5964bf5c439cb32b4c2dae9bf77e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:30.113130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef2366-bc5a-4d38-b0a1-d9663f30fc9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=131c5964bf5c439cb32b4c2dae9bf77e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:30.116568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef2366-bc5a-4d38-b0a1-d9663f30fc9b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:30.174012 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 876/1772] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:29 2022] POST /identity/v3/projects => generated 367 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:09:30.181368 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10b47f-6f7d-4917-85bb-c2dd3e9d4176 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:30.187778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2e10b47f-6f7d-4917-85bb-c2dd3e9d4176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:30.322641 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10b47f-6f7d-4917-85bb-c2dd3e9d4176 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:30.328508 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d2b8c-4075-4ada-9ff8-239d2cf30341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:30.329319 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d2b8c-4075-4ada-9ff8-239d2cf30341 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:30.329610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d2b8c-4075-4ada-9ff8-239d2cf30341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:30.329886 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d2b8c-4075-4ada-9ff8-239d2cf30341 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:30.330891 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d2b8c-4075-4ada-9ff8-239d2cf30341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:30.332772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d2b8c-4075-4ada-9ff8-239d2cf30341 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:30.368257 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ccef2366-bc5a-4d38-b0a1-d9663f30fc9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131c5964bf5c439cb32b4c2dae9bf77e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:30.398714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ccef2366-bc5a-4d38-b0a1-d9663f30fc9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131c5964bf5c439cb32b4c2dae9bf77e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:30.429168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 877/1773] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:30 2022] POST /identity/v3/users => generated 290 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:30.433509 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d2b8c-4075-4ada-9ff8-239d2cf30341 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:30.446723 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d2b8c-4075-4ada-9ff8-239d2cf30341 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:30.451969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e0f8f-2822-4504-8840-539fe2f8605c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:30.452906 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e0f8f-2822-4504-8840-539fe2f8605c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:30.453378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e0f8f-2822-4504-8840-539fe2f8605c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:30.453831 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e0f8f-2822-4504-8840-539fe2f8605c admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:30.454748 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e0f8f-2822-4504-8840-539fe2f8605c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:30.456642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e0f8f-2822-4504-8840-539fe2f8605c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:30.469524 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 878/1774] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:30.474079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e0f8f-2822-4504-8840-539fe2f8605c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:30.489954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e0f8f-2822-4504-8840-539fe2f8605c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:30.509904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb1bc9-650a-4e09-96ee-670f3434d32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:30.510836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb1bc9-650a-4e09-96ee-670f3434d32b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:30.511131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb1bc9-650a-4e09-96ee-670f3434d32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:30.511527 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb1bc9-650a-4e09-96ee-670f3434d32b admin admin] PATH_INFO: `/v3/projects/17157a8bc60d4ec1af31b0ee8212cc94/users/a372933321fb42de853d56c93fa17da4/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:30.516853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ccef2366-bc5a-4d38-b0a1-d9663f30fc9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131c5964bf5c439cb32b4c2dae9bf77e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:30.517501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ccef2366-bc5a-4d38-b0a1-d9663f30fc9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131c5964bf5c439cb32b4c2dae9bf77e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:30.518100 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ccef2366-bc5a-4d38-b0a1-d9663f30fc9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131c5964bf5c439cb32b4c2dae9bf77e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:30.546118 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 897/1775] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:30 2022] DELETE /identity/v3/users/131c5964bf5c439cb32b4c2dae9bf77e => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:30.561513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb1bc9-650a-4e09-96ee-670f3434d32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=17157a8bc60d4ec1af31b0ee8212cc94, user_id=a372933321fb42de853d56c93fa17da4, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:30.565336 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb1bc9-650a-4e09-96ee-670f3434d32b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:31.067213 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 879/1776] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:30 2022] PUT /identity/v3/projects/17157a8bc60d4ec1af31b0ee8212cc94/users/a372933321fb42de853d56c93fa17da4/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:31.095295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef2366-bc5a-4d38-b0a1-d9663f30fc9b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:31.098267 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ccef2366-bc5a-4d38-b0a1-d9663f30fc9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:31.198612 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef2366-bc5a-4d38-b0a1-d9663f30fc9b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:31.279079 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549e97d-9c6e-4d5b-9172-72bf2d79db82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:31.288052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549e97d-9c6e-4d5b-9172-72bf2d79db82 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:31.288052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549e97d-9c6e-4d5b-9172-72bf2d79db82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:31.288052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549e97d-9c6e-4d5b-9172-72bf2d79db82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:31.288052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549e97d-9c6e-4d5b-9172-72bf2d79db82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:31.288052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549e97d-9c6e-4d5b-9172-72bf2d79db82 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:31.294080 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 898/1777] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:31.298425 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb1bc9-650a-4e09-96ee-670f3434d32b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:31.308123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb1bc9-650a-4e09-96ee-670f3434d32b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:31.317113 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30787caa-3d2f-463e-bdf0-80ad0942165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:31.318152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30787caa-3d2f-463e-bdf0-80ad0942165e admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:31.318660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30787caa-3d2f-463e-bdf0-80ad0942165e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:31.319036 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30787caa-3d2f-463e-bdf0-80ad0942165e admin admin] PATH_INFO: `/v3/projects/17157a8bc60d4ec1af31b0ee8212cc94/users/a372933321fb42de853d56c93fa17da4/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:31.321554 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30787caa-3d2f-463e-bdf0-80ad0942165e admin admin] RBAC: Authorizing `identity:create_grant(project_id=17157a8bc60d4ec1af31b0ee8212cc94, user_id=a372933321fb42de853d56c93fa17da4, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:31.324396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30787caa-3d2f-463e-bdf0-80ad0942165e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:31.337645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 880/1778] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:31 2022] PUT /identity/v3/projects/17157a8bc60d4ec1af31b0ee8212cc94/users/a372933321fb42de853d56c93fa17da4/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:31.350411 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e1c0-37b7-420a-805b-b305dff8cd3e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:31.351034 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e1c0-37b7-420a-805b-b305dff8cd3e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:31.351491 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e1c0-37b7-420a-805b-b305dff8cd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:31.378326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1b42e1c0-37b7-420a-805b-b305dff8cd3e None None] MFA Rules not processed for user `a372933321fb42de853d56c93fa17da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:31.379626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1b42e1c0-37b7-420a-805b-b305dff8cd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:31.460491 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 899/1779] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:31.471753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30787caa-3d2f-463e-bdf0-80ad0942165e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:31.473503 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-30787caa-3d2f-463e-bdf0-80ad0942165e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:31.530557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30787caa-3d2f-463e-bdf0-80ad0942165e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:31.534402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88822255-6d07-4592-90ae-11be802695d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:31.535062 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88822255-6d07-4592-90ae-11be802695d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:31.535386 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88822255-6d07-4592-90ae-11be802695d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:31.535681 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88822255-6d07-4592-90ae-11be802695d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:31.550657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88822255-6d07-4592-90ae-11be802695d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:31.550657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88822255-6d07-4592-90ae-11be802695d2 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:31.557559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 881/1780] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:32.250238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42e1c0-37b7-420a-805b-b305dff8cd3e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:32.251759 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1b42e1c0-37b7-420a-805b-b305dff8cd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:32.378660 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42e1c0-37b7-420a-805b-b305dff8cd3e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:32.384520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f7701-4dd6-4bf3-909b-ef772505354e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:32.385561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f7701-4dd6-4bf3-909b-ef772505354e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:32.385870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f7701-4dd6-4bf3-909b-ef772505354e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:32.386281 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f7701-4dd6-4bf3-909b-ef772505354e admin admin] PATH_INFO: `/v3/projects/2577c84ec4124b7eb56347d184737014` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:32.387492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f7701-4dd6-4bf3-909b-ef772505354e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2577c84ec4124b7eb56347d184737014)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:32.389374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f7701-4dd6-4bf3-909b-ef772505354e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:32.516491 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-764f7701-4dd6-4bf3-909b-ef772505354e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2577c84ec4124b7eb56347d184737014', 'request_id': 'req-764f7701-4dd6-4bf3-909b-ef772505354e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:32.523592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-764f7701-4dd6-4bf3-909b-ef772505354e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2577c84ec4124b7eb56347d184737014', 'request_id': 'req-764f7701-4dd6-4bf3-909b-ef772505354e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:32.528974 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-764f7701-4dd6-4bf3-909b-ef772505354e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2577c84ec4124b7eb56347d184737014', 'request_id': 'req-764f7701-4dd6-4bf3-909b-ef772505354e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:32.620816 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-764f7701-4dd6-4bf3-909b-ef772505354e admin admin] The token cache is being invalidate because project 2577c84ec4124b7eb56347d184737014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:32.626556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-764f7701-4dd6-4bf3-909b-ef772505354e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:32.626556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-764f7701-4dd6-4bf3-909b-ef772505354e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:32.628156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 900/1781] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:32 2022] DELETE /identity/v3/projects/2577c84ec4124b7eb56347d184737014 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:32.629476 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ffa13-45c8-4f0c-bc51-28fc71410a4d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:32.629939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ffa13-45c8-4f0c-bc51-28fc71410a4d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:32.630165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ffa13-45c8-4f0c-bc51-28fc71410a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:32.657541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c12ffa13-45c8-4f0c-bc51-28fc71410a4d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:32.659661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c12ffa13-45c8-4f0c-bc51-28fc71410a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:32.743478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 882/1782] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:32.748235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb655d-2558-4ec5-bbbf-32b459f8a70d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:32.748528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb655d-2558-4ec5-bbbf-32b459f8a70d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:32.748824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb655d-2558-4ec5-bbbf-32b459f8a70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:32.768681 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6ceb655d-2558-4ec5-bbbf-32b459f8a70d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:32.772453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6ceb655d-2558-4ec5-bbbf-32b459f8a70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:32.780486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 901/1783] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:32.784508 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ffa13-45c8-4f0c-bc51-28fc71410a4d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:32.796388 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ffa13-45c8-4f0c-bc51-28fc71410a4d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:32.801466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32cf79-8142-43d8-a818-7a038aa8d297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:32.802222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32cf79-8142-43d8-a818-7a038aa8d297 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:32.802574 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32cf79-8142-43d8-a818-7a038aa8d297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:32.803244 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32cf79-8142-43d8-a818-7a038aa8d297 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:32.804071 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32cf79-8142-43d8-a818-7a038aa8d297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:09:32.804378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32cf79-8142-43d8-a818-7a038aa8d297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:32.805998 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32cf79-8142-43d8-a818-7a038aa8d297 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:32.822320 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 883/1784] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:09:32.823881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb655d-2558-4ec5-bbbf-32b459f8a70d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:32.834937 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb655d-2558-4ec5-bbbf-32b459f8a70d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:32.839986 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d0dd1-c132-422e-8666-6686271e096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:32.840682 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d0dd1-c132-422e-8666-6686271e096a admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:32.846996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d0dd1-c132-422e-8666-6686271e096a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:32.846996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d0dd1-c132-422e-8666-6686271e096a admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:32.846996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d0dd1-c132-422e-8666-6686271e096a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:32.846996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d0dd1-c132-422e-8666-6686271e096a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:32.975785 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 902/1785] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:32 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:32.981662 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32cf79-8142-43d8-a818-7a038aa8d297 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:32.995896 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32cf79-8142-43d8-a818-7a038aa8d297 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:33.081800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a854aa6-cb98-4556-a8ac-6a7aba51ff67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:33.082477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a854aa6-cb98-4556-a8ac-6a7aba51ff67 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:33.082766 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a854aa6-cb98-4556-a8ac-6a7aba51ff67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:33.083045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a854aa6-cb98-4556-a8ac-6a7aba51ff67 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:33.083770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a854aa6-cb98-4556-a8ac-6a7aba51ff67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:33.085771 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a854aa6-cb98-4556-a8ac-6a7aba51ff67 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:33.237157 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 884/1786] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:32 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:33.242528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d0dd1-c132-422e-8666-6686271e096a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:33.252572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d0dd1-c132-422e-8666-6686271e096a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:33.258021 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56900f55-f9ba-4780-9ed5-5a44e85b309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:33.258664 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56900f55-f9ba-4780-9ed5-5a44e85b309d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:33.258946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56900f55-f9ba-4780-9ed5-5a44e85b309d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:33.259263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56900f55-f9ba-4780-9ed5-5a44e85b309d admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:33.259981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56900f55-f9ba-4780-9ed5-5a44e85b309d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:33.261571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56900f55-f9ba-4780-9ed5-5a44e85b309d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:33.272263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 903/1787] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:33.276198 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a854aa6-cb98-4556-a8ac-6a7aba51ff67 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:33.286011 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a854aa6-cb98-4556-a8ac-6a7aba51ff67 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:33.290731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699475c-2d1a-4186-9d6c-485c928bc0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:33.291426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699475c-2d1a-4186-9d6c-485c928bc0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:33.291714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699475c-2d1a-4186-9d6c-485c928bc0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:33.292007 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699475c-2d1a-4186-9d6c-485c928bc0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:33.292828 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699475c-2d1a-4186-9d6c-485c928bc0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:33.294414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699475c-2d1a-4186-9d6c-485c928bc0ed admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:33.305112 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 885/1788] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:09:33.309349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56900f55-f9ba-4780-9ed5-5a44e85b309d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:33.321465 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56900f55-f9ba-4780-9ed5-5a44e85b309d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:33.327596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a8d3b-845e-417a-b360-7cae09ac73cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:33.327596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a8d3b-845e-417a-b360-7cae09ac73cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:33.327596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a8d3b-845e-417a-b360-7cae09ac73cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:33.328043 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a8d3b-845e-417a-b360-7cae09ac73cb admin admin] PATH_INFO: `/v3/projects/13b55c8de5014239b40d42bccd0d41f6/users/312dea7575a44de593c0ce200cd3812d/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:33.342799 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a8d3b-845e-417a-b360-7cae09ac73cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b55c8de5014239b40d42bccd0d41f6, user_id=312dea7575a44de593c0ce200cd3812d, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:33.345495 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a8d3b-845e-417a-b360-7cae09ac73cb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:33.414249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 904/1789] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:33 2022] PUT /identity/v3/projects/13b55c8de5014239b40d42bccd0d41f6/users/312dea7575a44de593c0ce200cd3812d/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:09:33.425483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e8328-751c-4465-9138-b3dda1ca997b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:33.425782 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e8328-751c-4465-9138-b3dda1ca997b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:33.426065 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e8328-751c-4465-9138-b3dda1ca997b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:33.455379 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d74e8328-751c-4465-9138-b3dda1ca997b None None] MFA Rules not processed for user `312dea7575a44de593c0ce200cd3812d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:33.456763 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d74e8328-751c-4465-9138-b3dda1ca997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:33.556459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 886/1790] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:33.645343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a8d3b-845e-417a-b360-7cae09ac73cb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:33.647172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-368a8d3b-845e-417a-b360-7cae09ac73cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:33.768467 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a8d3b-845e-417a-b360-7cae09ac73cb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:33.780311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c706fd-af0f-40ac-89fb-c9192b27a562 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68748827b9f14eb7958d5b202c5d6877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:33.780311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c706fd-af0f-40ac-89fb-c9192b27a562 service glance] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:33.780311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c706fd-af0f-40ac-89fb-c9192b27a562 service glance] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:33.780311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c706fd-af0f-40ac-89fb-c9192b27a562 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:33.784911 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c706fd-af0f-40ac-89fb-c9192b27a562 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:33.786629 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c706fd-af0f-40ac-89fb-c9192b27a562 service glance] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:33.798381 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 905/1791] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:34.265441 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417ad54-5943-4cd9-8254-20580900d855 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:34.266354 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417ad54-5943-4cd9-8254-20580900d855 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:34.266962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417ad54-5943-4cd9-8254-20580900d855 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:34.270300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 887/1792] 10.222.0.24 () {54 vars in 921 bytes} [Tue May 17 22:09:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:09:34.279554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9675a6-bd32-41c8-94b9-319ef7477e0f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:34.280103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9675a6-bd32-41c8-94b9-319ef7477e0f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:34.280190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9675a6-bd32-41c8-94b9-319ef7477e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:34.311323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1e9675a6-bd32-41c8-94b9-319ef7477e0f None None] MFA Rules not processed for user `8d06113649924eae83d04bc22337bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:34.314640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1e9675a6-bd32-41c8-94b9-319ef7477e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:34.401901 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 906/1793] 10.222.0.24 () {58 vars in 1018 bytes} [Tue May 17 22:09:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:34.445547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417ad54-5943-4cd9-8254-20580900d855 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:34.447280 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d417ad54-5943-4cd9-8254-20580900d855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:34.482543 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417ad54-5943-4cd9-8254-20580900d855 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:34.504050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d8cb0-aa26-4406-88d7-ab7868e07c34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:34.504818 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d8cb0-aa26-4406-88d7-ab7868e07c34 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:34.505107 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d8cb0-aa26-4406-88d7-ab7868e07c34 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:34.510113 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d8cb0-aa26-4406-88d7-ab7868e07c34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:34.516921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d8cb0-aa26-4406-88d7-ab7868e07c34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:34.518679 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d8cb0-aa26-4406-88d7-ab7868e07c34 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:34.531188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 888/1794] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:35.494124 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9675a6-bd32-41c8-94b9-319ef7477e0f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:35.495796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1e9675a6-bd32-41c8-94b9-319ef7477e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:35.591762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9675a6-bd32-41c8-94b9-319ef7477e0f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:35.597504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae80efa-c48a-4cfe-a6b0-53d9cc870e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:35.599719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae80efa-c48a-4cfe-a6b0-53d9cc870e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:35.600036 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae80efa-c48a-4cfe-a6b0-53d9cc870e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:35.600284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae80efa-c48a-4cfe-a6b0-53d9cc870e47 admin admin] PATH_INFO: `/v3/users/5bed9974f52b4bd5b1fe98252a53692b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:35.602051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae80efa-c48a-4cfe-a6b0-53d9cc870e47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bed9974f52b4bd5b1fe98252a53692b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:35.604558 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae80efa-c48a-4cfe-a6b0-53d9cc870e47 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:35.630485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b952bfe-361c-4f81-9416-1dfa62180144 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:35.631079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b952bfe-361c-4f81-9416-1dfa62180144 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:35.631279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b952bfe-361c-4f81-9416-1dfa62180144 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:35.633379 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 889/1795] 10.222.0.24 () {54 vars in 921 bytes} [Tue May 17 22:09:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:09:35.651675 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959682e6-bf03-47d4-bcd5-34bc8433e9a3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:35.651675 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959682e6-bf03-47d4-bcd5-34bc8433e9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:35.651675 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959682e6-bf03-47d4-bcd5-34bc8433e9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:35.691311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-959682e6-bf03-47d4-bcd5-34bc8433e9a3 None None] MFA Rules not processed for user `8d06113649924eae83d04bc22337bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:35.692687 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-959682e6-bf03-47d4-bcd5-34bc8433e9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:35.711616 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 890/1796] 10.222.0.24 () {58 vars in 1018 bytes} [Tue May 17 22:09:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:35.842926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8ae80efa-c48a-4cfe-a6b0-53d9cc870e47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bed9974f52b4bd5b1fe98252a53692b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:35.860921 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8ae80efa-c48a-4cfe-a6b0-53d9cc870e47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bed9974f52b4bd5b1fe98252a53692b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:35.976842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8ae80efa-c48a-4cfe-a6b0-53d9cc870e47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bed9974f52b4bd5b1fe98252a53692b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:35.976842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8ae80efa-c48a-4cfe-a6b0-53d9cc870e47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bed9974f52b4bd5b1fe98252a53692b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:35.976842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8ae80efa-c48a-4cfe-a6b0-53d9cc870e47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bed9974f52b4bd5b1fe98252a53692b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:35.991623 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 907/1797] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:35 2022] DELETE /identity/v3/users/5bed9974f52b4bd5b1fe98252a53692b => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:35.997022 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8ba9d-9161-4be4-986d-f65a23e9ff16 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:35.997321 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8ba9d-9161-4be4-986d-f65a23e9ff16 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:36.000974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8ba9d-9161-4be4-986d-f65a23e9ff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:36.023757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b0b8ba9d-9161-4be4-986d-f65a23e9ff16 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:36.025178 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b0b8ba9d-9161-4be4-986d-f65a23e9ff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:36.093900 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae80efa-c48a-4cfe-a6b0-53d9cc870e47 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:36.095694 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8ae80efa-c48a-4cfe-a6b0-53d9cc870e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:36.134960 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 891/1798] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:36.144016 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8ba9d-9161-4be4-986d-f65a23e9ff16 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:36.145840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b0b8ba9d-9161-4be4-986d-f65a23e9ff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:36.199320 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae80efa-c48a-4cfe-a6b0-53d9cc870e47 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:36.205277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8623e0-9593-4e73-a6d0-64cb258eed94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:36.206059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8623e0-9593-4e73-a6d0-64cb258eed94 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:36.206446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8623e0-9593-4e73-a6d0-64cb258eed94 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:36.206831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8623e0-9593-4e73-a6d0-64cb258eed94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:36.208837 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7a8623e0-9593-4e73-a6d0-64cb258eed94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:36.223453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8623e0-9593-4e73-a6d0-64cb258eed94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:36.225198 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8623e0-9593-4e73-a6d0-64cb258eed94 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:36.234250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8ba9d-9161-4be4-986d-f65a23e9ff16 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:36.236841 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 908/1799] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:09:36.239220 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15512abc-baf7-44a0-9b58-6116720bd8ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:36.240620 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15512abc-baf7-44a0-9b58-6116720bd8ba service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:36.240973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15512abc-baf7-44a0-9b58-6116720bd8ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:36.241248 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15512abc-baf7-44a0-9b58-6116720bd8ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:36.251459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15512abc-baf7-44a0-9b58-6116720bd8ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:36.252957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15512abc-baf7-44a0-9b58-6116720bd8ba service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:36.277803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 892/1800] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:37.647565 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8623e0-9593-4e73-a6d0-64cb258eed94 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:37.649790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7a8623e0-9593-4e73-a6d0-64cb258eed94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:37.675474 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8623e0-9593-4e73-a6d0-64cb258eed94 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:37.689022 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da1808-11a7-4fc7-82b6-c74d6c338dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:37.690259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da1808-11a7-4fc7-82b6-c74d6c338dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:37.690755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da1808-11a7-4fc7-82b6-c74d6c338dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:37.691152 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da1808-11a7-4fc7-82b6-c74d6c338dd7 admin admin] PATH_INFO: `/v3/projects/58524081427d456495717525dc880e20` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:37.697159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da1808-11a7-4fc7-82b6-c74d6c338dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58524081427d456495717525dc880e20)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:37.699337 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da1808-11a7-4fc7-82b6-c74d6c338dd7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:37.850909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-05da1808-11a7-4fc7-82b6-c74d6c338dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58524081427d456495717525dc880e20', 'request_id': 'req-05da1808-11a7-4fc7-82b6-c74d6c338dd7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:37.860859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-05da1808-11a7-4fc7-82b6-c74d6c338dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58524081427d456495717525dc880e20', 'request_id': 'req-05da1808-11a7-4fc7-82b6-c74d6c338dd7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:37.875646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-05da1808-11a7-4fc7-82b6-c74d6c338dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58524081427d456495717525dc880e20', 'request_id': 'req-05da1808-11a7-4fc7-82b6-c74d6c338dd7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:38.002623 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-05da1808-11a7-4fc7-82b6-c74d6c338dd7 admin admin] The token cache is being invalidate because project 58524081427d456495717525dc880e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:38.003233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-05da1808-11a7-4fc7-82b6-c74d6c338dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:38.003943 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-05da1808-11a7-4fc7-82b6-c74d6c338dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:38.009787 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 909/1801] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:37 2022] DELETE /identity/v3/projects/58524081427d456495717525dc880e20 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:38.012349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15512abc-baf7-44a0-9b58-6116720bd8ba service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:38.025196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15512abc-baf7-44a0-9b58-6116720bd8ba service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:38.299490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9d8f9-bd44-467f-bc88-9103e052fab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:38.300985 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9d8f9-bd44-467f-bc88-9103e052fab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:38.301276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9d8f9-bd44-467f-bc88-9103e052fab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:38.301552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9d8f9-bd44-467f-bc88-9103e052fab2 admin admin] PATH_INFO: `/v3/users/a372933321fb42de853d56c93fa17da4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:38.303937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9d8f9-bd44-467f-bc88-9103e052fab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a372933321fb42de853d56c93fa17da4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:38.306288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9d8f9-bd44-467f-bc88-9103e052fab2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:38.548042 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-07c9d8f9-bd44-467f-bc88-9103e052fab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a372933321fb42de853d56c93fa17da4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:38.571100 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-07c9d8f9-bd44-467f-bc88-9103e052fab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a372933321fb42de853d56c93fa17da4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:38.571982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-07c9d8f9-bd44-467f-bc88-9103e052fab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a372933321fb42de853d56c93fa17da4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:38.629417 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-07c9d8f9-bd44-467f-bc88-9103e052fab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a372933321fb42de853d56c93fa17da4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:38.630496 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-07c9d8f9-bd44-467f-bc88-9103e052fab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a372933321fb42de853d56c93fa17da4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:38.648059 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 893/1802] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:38 2022] DELETE /identity/v3/users/a372933321fb42de853d56c93fa17da4 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:39.522688 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da1808-11a7-4fc7-82b6-c74d6c338dd7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:39.524475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-05da1808-11a7-4fc7-82b6-c74d6c338dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:39.542848 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da1808-11a7-4fc7-82b6-c74d6c338dd7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:39.637259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cc781-5f30-441f-8c70-b5281c20f63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:39.638158 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cc781-5f30-441f-8c70-b5281c20f63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:39.638443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cc781-5f30-441f-8c70-b5281c20f63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:39.638720 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cc781-5f30-441f-8c70-b5281c20f63f admin admin] PATH_INFO: `/v3/projects/17157a8bc60d4ec1af31b0ee8212cc94` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:39.640182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cc781-5f30-441f-8c70-b5281c20f63f admin admin] RBAC: Authorizing `identity:delete_project(project_id=17157a8bc60d4ec1af31b0ee8212cc94)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:39.642204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cc781-5f30-441f-8c70-b5281c20f63f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:39.757963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fc9cc781-5f30-441f-8c70-b5281c20f63f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17157a8bc60d4ec1af31b0ee8212cc94', 'request_id': 'req-fc9cc781-5f30-441f-8c70-b5281c20f63f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:39.765347 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fc9cc781-5f30-441f-8c70-b5281c20f63f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17157a8bc60d4ec1af31b0ee8212cc94', 'request_id': 'req-fc9cc781-5f30-441f-8c70-b5281c20f63f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:39.777872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fc9cc781-5f30-441f-8c70-b5281c20f63f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17157a8bc60d4ec1af31b0ee8212cc94', 'request_id': 'req-fc9cc781-5f30-441f-8c70-b5281c20f63f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:39.902078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fc9cc781-5f30-441f-8c70-b5281c20f63f admin admin] The token cache is being invalidate because project 17157a8bc60d4ec1af31b0ee8212cc94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:39.902334 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fc9cc781-5f30-441f-8c70-b5281c20f63f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:39.903002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fc9cc781-5f30-441f-8c70-b5281c20f63f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:39.904627 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 910/1803] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:39 2022] DELETE /identity/v3/projects/17157a8bc60d4ec1af31b0ee8212cc94 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:39.909392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e2c12-c88f-456c-89f6-7db601b830ea None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:39.909864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e2c12-c88f-456c-89f6-7db601b830ea None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:39.909962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e2c12-c88f-456c-89f6-7db601b830ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:39.944824 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0f2e2c12-c88f-456c-89f6-7db601b830ea None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:39.946330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0f2e2c12-c88f-456c-89f6-7db601b830ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:40.014058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 894/1804] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:40.022605 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6de0cf-0eb0-4c61-9af9-2f8684e1eff1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:40.022891 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6de0cf-0eb0-4c61-9af9-2f8684e1eff1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:40.023192 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6de0cf-0eb0-4c61-9af9-2f8684e1eff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:40.042844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6f6de0cf-0eb0-4c61-9af9-2f8684e1eff1 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:40.044071 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6f6de0cf-0eb0-4c61-9af9-2f8684e1eff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:40.052120 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 911/1805] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:40.057022 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e2c12-c88f-456c-89f6-7db601b830ea None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:40.067055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e2c12-c88f-456c-89f6-7db601b830ea None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:40.072547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6af14f-4c0e-470b-99f4-9861035ce1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:40.073176 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6af14f-4c0e-470b-99f4-9861035ce1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:40.073528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6af14f-4c0e-470b-99f4-9861035ce1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:40.073800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6af14f-4c0e-470b-99f4-9861035ce1d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:40.074523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6af14f-4c0e-470b-99f4-9861035ce1d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:09:40.074826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6af14f-4c0e-470b-99f4-9861035ce1d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:40.076457 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6af14f-4c0e-470b-99f4-9861035ce1d8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:40.087994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 895/1806] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:09:40.092418 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6de0cf-0eb0-4c61-9af9-2f8684e1eff1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:40.102609 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6de0cf-0eb0-4c61-9af9-2f8684e1eff1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:40.107300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e9a02-8e48-40c4-b033-7ea1b0859a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:40.107948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e9a02-8e48-40c4-b033-7ea1b0859a64 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:40.108229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e9a02-8e48-40c4-b033-7ea1b0859a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:40.108564 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e9a02-8e48-40c4-b033-7ea1b0859a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:40.109268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e9a02-8e48-40c4-b033-7ea1b0859a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:40.111233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e9a02-8e48-40c4-b033-7ea1b0859a64 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:40.214807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 912/1807] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:40 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:40.218851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6af14f-4c0e-470b-99f4-9861035ce1d8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:40.230354 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6af14f-4c0e-470b-99f4-9861035ce1d8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:40.293072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1319e-6232-4004-b2d9-89e9c9cd615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:40.293813 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1319e-6232-4004-b2d9-89e9c9cd615f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:40.294099 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1319e-6232-4004-b2d9-89e9c9cd615f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:40.294371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1319e-6232-4004-b2d9-89e9c9cd615f admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:40.295282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1319e-6232-4004-b2d9-89e9c9cd615f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:40.297793 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1319e-6232-4004-b2d9-89e9c9cd615f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:40.409862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 896/1808] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:40 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:09:40.414409 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e9a02-8e48-40c4-b033-7ea1b0859a64 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:40.426293 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e9a02-8e48-40c4-b033-7ea1b0859a64 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:40.432793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1a8fb-3cad-4f13-bfb2-5ab6aeb8f2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:40.433453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1a8fb-3cad-4f13-bfb2-5ab6aeb8f2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:40.434071 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1a8fb-3cad-4f13-bfb2-5ab6aeb8f2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:40.434413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1a8fb-3cad-4f13-bfb2-5ab6aeb8f2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:40.436340 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1a8fb-3cad-4f13-bfb2-5ab6aeb8f2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:40.442105 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1a8fb-3cad-4f13-bfb2-5ab6aeb8f2c1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:40.452409 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 913/1809] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:09:40.455077 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1319e-6232-4004-b2d9-89e9c9cd615f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:40.466507 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1319e-6232-4004-b2d9-89e9c9cd615f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:40.471740 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b0003-d5ce-4669-9206-b1bb304a362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:40.472741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b0003-d5ce-4669-9206-b1bb304a362a admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:40.472741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b0003-d5ce-4669-9206-b1bb304a362a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:40.473138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b0003-d5ce-4669-9206-b1bb304a362a admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:40.474092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b0003-d5ce-4669-9206-b1bb304a362a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:40.475965 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b0003-d5ce-4669-9206-b1bb304a362a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:40.488130 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 897/1810] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:09:40.493781 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1a8fb-3cad-4f13-bfb2-5ab6aeb8f2c1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:40.503717 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1a8fb-3cad-4f13-bfb2-5ab6aeb8f2c1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:40.512090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0c42e-4bfb-4b9c-876c-8e9b0a993e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:40.512090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c42e-4bfb-4b9c-876c-8e9b0a993e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:40.512481 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c42e-4bfb-4b9c-876c-8e9b0a993e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:40.512818 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c42e-4bfb-4b9c-876c-8e9b0a993e34 admin admin] PATH_INFO: `/v3/projects/421330ff8bde414bb7305afd9b76fcc6/users/c5081c9bffff410ba28c11e77d1a595b/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:40.531660 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0c42e-4bfb-4b9c-876c-8e9b0a993e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=421330ff8bde414bb7305afd9b76fcc6, user_id=c5081c9bffff410ba28c11e77d1a595b, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:40.534944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0c42e-4bfb-4b9c-876c-8e9b0a993e34 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:40.636720 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 914/1811] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:40 2022] PUT /identity/v3/projects/421330ff8bde414bb7305afd9b76fcc6/users/c5081c9bffff410ba28c11e77d1a595b/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:40.650507 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae87f87-4bad-4dc2-b3ce-6a31138db097 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:40.650800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae87f87-4bad-4dc2-b3ce-6a31138db097 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:40.651083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae87f87-4bad-4dc2-b3ce-6a31138db097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:40.680949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5ae87f87-4bad-4dc2-b3ce-6a31138db097 None None] MFA Rules not processed for user `c5081c9bffff410ba28c11e77d1a595b`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:40.682293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5ae87f87-4bad-4dc2-b3ce-6a31138db097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:40.768931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 898/1812] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:40.774778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0c42e-4bfb-4b9c-876c-8e9b0a993e34 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:40.864863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0c42e-4bfb-4b9c-876c-8e9b0a993e34 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:40.871739 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02450614-1217-4f94-ade7-5521629d620d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:40.872410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02450614-1217-4f94-ade7-5521629d620d admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:40.872871 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02450614-1217-4f94-ade7-5521629d620d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:40.873256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02450614-1217-4f94-ade7-5521629d620d admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:40.873987 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02450614-1217-4f94-ade7-5521629d620d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:40.875945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02450614-1217-4f94-ade7-5521629d620d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:41.014218 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 915/1813] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:40 2022] POST /identity/v3/projects => generated 379 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:41.018239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae87f87-4bad-4dc2-b3ce-6a31138db097 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:41.042675 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae87f87-4bad-4dc2-b3ce-6a31138db097 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:41.110274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf9d0f-dd65-4737-8093-28c59d763170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:41.110982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf9d0f-dd65-4737-8093-28c59d763170 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:41.111423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf9d0f-dd65-4737-8093-28c59d763170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:41.111601 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf9d0f-dd65-4737-8093-28c59d763170 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:41.112281 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf9d0f-dd65-4737-8093-28c59d763170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:41.114191 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf9d0f-dd65-4737-8093-28c59d763170 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:41.239241 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 899/1814] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:41 2022] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:41.242036 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02450614-1217-4f94-ade7-5521629d620d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:41.252390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02450614-1217-4f94-ade7-5521629d620d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:41.257728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed126f-5a49-471c-a30a-dbdbb76197f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:41.258539 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed126f-5a49-471c-a30a-dbdbb76197f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:41.258867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed126f-5a49-471c-a30a-dbdbb76197f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:41.259174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed126f-5a49-471c-a30a-dbdbb76197f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:41.260121 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed126f-5a49-471c-a30a-dbdbb76197f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:41.262214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed126f-5a49-471c-a30a-dbdbb76197f2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:41.274237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 916/1815] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:41.278450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf9d0f-dd65-4737-8093-28c59d763170 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:41.289270 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf9d0f-dd65-4737-8093-28c59d763170 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:41.293824 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340471ec-acd6-48e7-9b15-48c3b020b039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:41.294735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340471ec-acd6-48e7-9b15-48c3b020b039 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:41.295052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340471ec-acd6-48e7-9b15-48c3b020b039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:41.295376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340471ec-acd6-48e7-9b15-48c3b020b039 admin admin] PATH_INFO: `/v3/projects/8caab3f924a648d18354b96f4711ade9/users/bcfd8eceb3d140e3a983a099cc11a5a9/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:41.310587 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340471ec-acd6-48e7-9b15-48c3b020b039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8caab3f924a648d18354b96f4711ade9, user_id=bcfd8eceb3d140e3a983a099cc11a5a9, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:41.313291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340471ec-acd6-48e7-9b15-48c3b020b039 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:41.425522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 900/1816] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:41 2022] PUT /identity/v3/projects/8caab3f924a648d18354b96f4711ade9/users/bcfd8eceb3d140e3a983a099cc11a5a9/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:41.430789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed126f-5a49-471c-a30a-dbdbb76197f2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:41.441010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed126f-5a49-471c-a30a-dbdbb76197f2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:41.497419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333ddad-ae9e-409a-ac8b-6abbc3ec4424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:41.498007 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333ddad-ae9e-409a-ac8b-6abbc3ec4424 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:41.498287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333ddad-ae9e-409a-ac8b-6abbc3ec4424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:41.498569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333ddad-ae9e-409a-ac8b-6abbc3ec4424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:41.499350 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333ddad-ae9e-409a-ac8b-6abbc3ec4424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:41.501071 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333ddad-ae9e-409a-ac8b-6abbc3ec4424 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:41.512410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 917/1817] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:41.516128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340471ec-acd6-48e7-9b15-48c3b020b039 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:41.527052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340471ec-acd6-48e7-9b15-48c3b020b039 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:41.531577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1c1f0-9e30-49a3-9b85-63e1b4886b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:41.532477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1c1f0-9e30-49a3-9b85-63e1b4886b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:41.532748 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1c1f0-9e30-49a3-9b85-63e1b4886b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:41.540241 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1c1f0-9e30-49a3-9b85-63e1b4886b58 admin admin] PATH_INFO: `/v3/projects/8caab3f924a648d18354b96f4711ade9/users/bcfd8eceb3d140e3a983a099cc11a5a9/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:41.545507 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1c1f0-9e30-49a3-9b85-63e1b4886b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8caab3f924a648d18354b96f4711ade9, user_id=bcfd8eceb3d140e3a983a099cc11a5a9, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:41.547979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1c1f0-9e30-49a3-9b85-63e1b4886b58 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:41.578138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 901/1818] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:41 2022] PUT /identity/v3/projects/8caab3f924a648d18354b96f4711ade9/users/bcfd8eceb3d140e3a983a099cc11a5a9/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:41.588792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc4c74-b9ae-40f7-9caf-8be4176b9a87 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:41.588792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc4c74-b9ae-40f7-9caf-8be4176b9a87 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:41.588792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc4c74-b9ae-40f7-9caf-8be4176b9a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:41.620006 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c1cc4c74-b9ae-40f7-9caf-8be4176b9a87 None None] MFA Rules not processed for user `bcfd8eceb3d140e3a983a099cc11a5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:41.621270 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c1cc4c74-b9ae-40f7-9caf-8be4176b9a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:41.708316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 918/1819] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:41.720527 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1c1f0-9e30-49a3-9b85-63e1b4886b58 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:41.722518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-27f1c1f0-9e30-49a3-9b85-63e1b4886b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:41.783692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1c1f0-9e30-49a3-9b85-63e1b4886b58 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:41.788660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef0e1c-c2e4-440c-b695-1ef70f7be571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:41.789354 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef0e1c-c2e4-440c-b695-1ef70f7be571 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:41.789635 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef0e1c-c2e4-440c-b695-1ef70f7be571 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:41.789910 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef0e1c-c2e4-440c-b695-1ef70f7be571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:41.799034 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef0e1c-c2e4-440c-b695-1ef70f7be571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:41.800522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef0e1c-c2e4-440c-b695-1ef70f7be571 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:41.811211 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 902/1820] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:41.940720 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc4c74-b9ae-40f7-9caf-8be4176b9a87 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:41.952787 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc4c74-b9ae-40f7-9caf-8be4176b9a87 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:41.959854 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed8108-fcea-4c85-aa99-5294ee711aa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:41.960383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed8108-fcea-4c85-aa99-5294ee711aa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:41.960725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed8108-fcea-4c85-aa99-5294ee711aa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:41.961011 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed8108-fcea-4c85-aa99-5294ee711aa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:42.029434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed8108-fcea-4c85-aa99-5294ee711aa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:42.030820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed8108-fcea-4c85-aa99-5294ee711aa9 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:42.040886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 919/1821] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:45.262515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef0e1c-c2e4-440c-b695-1ef70f7be571 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:45.328290 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef0e1c-c2e4-440c-b695-1ef70f7be571 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:45.332823 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444abc14-7309-4b59-afd0-991e35be8a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:45.333821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444abc14-7309-4b59-afd0-991e35be8a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:45.334099 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444abc14-7309-4b59-afd0-991e35be8a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:45.334365 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444abc14-7309-4b59-afd0-991e35be8a38 admin admin] PATH_INFO: `/v3/users/c5081c9bffff410ba28c11e77d1a595b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:45.335593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444abc14-7309-4b59-afd0-991e35be8a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5081c9bffff410ba28c11e77d1a595b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:45.337630 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444abc14-7309-4b59-afd0-991e35be8a38 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:45.510227 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-444abc14-7309-4b59-afd0-991e35be8a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5081c9bffff410ba28c11e77d1a595b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:45.528119 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-444abc14-7309-4b59-afd0-991e35be8a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5081c9bffff410ba28c11e77d1a595b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:45.529142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-444abc14-7309-4b59-afd0-991e35be8a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5081c9bffff410ba28c11e77d1a595b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:45.625393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-444abc14-7309-4b59-afd0-991e35be8a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5081c9bffff410ba28c11e77d1a595b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:45.626688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-444abc14-7309-4b59-afd0-991e35be8a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5081c9bffff410ba28c11e77d1a595b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:45.649652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 903/1822] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:45 2022] DELETE /identity/v3/users/c5081c9bffff410ba28c11e77d1a595b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:45.654029 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a65af-9994-46a3-8f80-53fac611e845 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:45.654521 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a65af-9994-46a3-8f80-53fac611e845 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:45.655048 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a65af-9994-46a3-8f80-53fac611e845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:45.680739 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-732a65af-9994-46a3-8f80-53fac611e845 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:45.682387 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-732a65af-9994-46a3-8f80-53fac611e845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:45.764270 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 920/1823] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:45.774458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444abc14-7309-4b59-afd0-991e35be8a38 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:45.775885 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-444abc14-7309-4b59-afd0-991e35be8a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:45.833330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444abc14-7309-4b59-afd0-991e35be8a38 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:45.837940 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594f03e-b2f3-4800-b461-e2b9be49a232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:45.838647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594f03e-b2f3-4800-b461-e2b9be49a232 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:45.838938 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594f03e-b2f3-4800-b461-e2b9be49a232 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:45.839249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594f03e-b2f3-4800-b461-e2b9be49a232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:45.850142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594f03e-b2f3-4800-b461-e2b9be49a232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:45.852056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594f03e-b2f3-4800-b461-e2b9be49a232 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:45.861801 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 904/1824] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:46.748206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a65af-9994-46a3-8f80-53fac611e845 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:46.751195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-732a65af-9994-46a3-8f80-53fac611e845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:46.764725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a65af-9994-46a3-8f80-53fac611e845 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:46.770555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69365cbd-d348-4f92-8f2d-3129b8546a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:46.777104 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69365cbd-d348-4f92-8f2d-3129b8546a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:46.777396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69365cbd-d348-4f92-8f2d-3129b8546a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:46.777684 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69365cbd-d348-4f92-8f2d-3129b8546a76 admin admin] PATH_INFO: `/v3/projects/421330ff8bde414bb7305afd9b76fcc6` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:46.778985 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69365cbd-d348-4f92-8f2d-3129b8546a76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=421330ff8bde414bb7305afd9b76fcc6)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:46.781086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69365cbd-d348-4f92-8f2d-3129b8546a76 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:46.890610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-69365cbd-d348-4f92-8f2d-3129b8546a76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421330ff8bde414bb7305afd9b76fcc6', 'request_id': 'req-69365cbd-d348-4f92-8f2d-3129b8546a76'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:46.898000 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-69365cbd-d348-4f92-8f2d-3129b8546a76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421330ff8bde414bb7305afd9b76fcc6', 'request_id': 'req-69365cbd-d348-4f92-8f2d-3129b8546a76'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:46.903613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-69365cbd-d348-4f92-8f2d-3129b8546a76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421330ff8bde414bb7305afd9b76fcc6', 'request_id': 'req-69365cbd-d348-4f92-8f2d-3129b8546a76'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:46.965888 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-69365cbd-d348-4f92-8f2d-3129b8546a76 admin admin] The token cache is being invalidate because project 421330ff8bde414bb7305afd9b76fcc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:46.966127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-69365cbd-d348-4f92-8f2d-3129b8546a76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:46.967751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-69365cbd-d348-4f92-8f2d-3129b8546a76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:46.969537 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 921/1825] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:46 2022] DELETE /identity/v3/projects/421330ff8bde414bb7305afd9b76fcc6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:46.973494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594f03e-b2f3-4800-b461-e2b9be49a232 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:46.983829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594f03e-b2f3-4800-b461-e2b9be49a232 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:47.038745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58df34-45b3-46cb-8b31-cbff5f2a2571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:47.039715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58df34-45b3-46cb-8b31-cbff5f2a2571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:47.040000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58df34-45b3-46cb-8b31-cbff5f2a2571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:47.040293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58df34-45b3-46cb-8b31-cbff5f2a2571 admin admin] PATH_INFO: `/v3/users/bcfd8eceb3d140e3a983a099cc11a5a9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:47.041491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58df34-45b3-46cb-8b31-cbff5f2a2571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcfd8eceb3d140e3a983a099cc11a5a9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:47.043421 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58df34-45b3-46cb-8b31-cbff5f2a2571 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:47.210261 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5c58df34-45b3-46cb-8b31-cbff5f2a2571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcfd8eceb3d140e3a983a099cc11a5a9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:47.222013 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5c58df34-45b3-46cb-8b31-cbff5f2a2571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcfd8eceb3d140e3a983a099cc11a5a9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:47.222639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5c58df34-45b3-46cb-8b31-cbff5f2a2571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcfd8eceb3d140e3a983a099cc11a5a9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:47.280277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5c58df34-45b3-46cb-8b31-cbff5f2a2571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcfd8eceb3d140e3a983a099cc11a5a9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:47.280907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5c58df34-45b3-46cb-8b31-cbff5f2a2571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcfd8eceb3d140e3a983a099cc11a5a9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:47.294715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 905/1826] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:46 2022] DELETE /identity/v3/users/bcfd8eceb3d140e3a983a099cc11a5a9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:47.745204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69365cbd-d348-4f92-8f2d-3129b8546a76 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:47.746851 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-69365cbd-d348-4f92-8f2d-3129b8546a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:47.761463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69365cbd-d348-4f92-8f2d-3129b8546a76 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:47.831551 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7df35-d279-4426-8c27-76db7034e13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:47.832420 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7df35-d279-4426-8c27-76db7034e13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:47.832701 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7df35-d279-4426-8c27-76db7034e13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:47.832980 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7df35-d279-4426-8c27-76db7034e13d admin admin] PATH_INFO: `/v3/projects/8caab3f924a648d18354b96f4711ade9` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:47.834411 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7df35-d279-4426-8c27-76db7034e13d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8caab3f924a648d18354b96f4711ade9)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:47.836363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7df35-d279-4426-8c27-76db7034e13d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:47.938123 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7bb7df35-d279-4426-8c27-76db7034e13d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8caab3f924a648d18354b96f4711ade9', 'request_id': 'req-7bb7df35-d279-4426-8c27-76db7034e13d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:47.944862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7bb7df35-d279-4426-8c27-76db7034e13d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8caab3f924a648d18354b96f4711ade9', 'request_id': 'req-7bb7df35-d279-4426-8c27-76db7034e13d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:47.950461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7bb7df35-d279-4426-8c27-76db7034e13d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8caab3f924a648d18354b96f4711ade9', 'request_id': 'req-7bb7df35-d279-4426-8c27-76db7034e13d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:48.037786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7bb7df35-d279-4426-8c27-76db7034e13d admin admin] The token cache is being invalidate because project 8caab3f924a648d18354b96f4711ade9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:48.041814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7bb7df35-d279-4426-8c27-76db7034e13d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:48.041814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7bb7df35-d279-4426-8c27-76db7034e13d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:48.041814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 922/1827] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:47 2022] DELETE /identity/v3/projects/8caab3f924a648d18354b96f4711ade9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:48.045601 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7287e30-e175-4ef5-991c-e8bf245caa4c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:48.046064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7287e30-e175-4ef5-991c-e8bf245caa4c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:48.046236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7287e30-e175-4ef5-991c-e8bf245caa4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:48.064201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c7287e30-e175-4ef5-991c-e8bf245caa4c None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:48.065402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c7287e30-e175-4ef5-991c-e8bf245caa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:48.123360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 906/1828] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:48.132012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad917061-ba65-4d25-8213-30bf375fcc77 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:48.132297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad917061-ba65-4d25-8213-30bf375fcc77 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:48.132597 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad917061-ba65-4d25-8213-30bf375fcc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:48.150631 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ad917061-ba65-4d25-8213-30bf375fcc77 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:48.151835 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ad917061-ba65-4d25-8213-30bf375fcc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:48.159607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 923/1829] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:48.164055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7287e30-e175-4ef5-991c-e8bf245caa4c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:48.173516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7287e30-e175-4ef5-991c-e8bf245caa4c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:48.178900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60b848-0075-4743-8df3-dfaaccd7279c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:48.179822 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60b848-0075-4743-8df3-dfaaccd7279c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:48.180117 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60b848-0075-4743-8df3-dfaaccd7279c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:48.180399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60b848-0075-4743-8df3-dfaaccd7279c admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:48.181135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60b848-0075-4743-8df3-dfaaccd7279c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:09:48.181446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60b848-0075-4743-8df3-dfaaccd7279c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:48.183032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60b848-0075-4743-8df3-dfaaccd7279c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:48.195629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 907/1830] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:09:48.199664 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad917061-ba65-4d25-8213-30bf375fcc77 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:48.208638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad917061-ba65-4d25-8213-30bf375fcc77 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:48.213297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fad31-0eab-4e6b-b6bb-58dd395510bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:48.213947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fad31-0eab-4e6b-b6bb-58dd395510bb admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:48.214231 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fad31-0eab-4e6b-b6bb-58dd395510bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:48.214509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fad31-0eab-4e6b-b6bb-58dd395510bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:48.215248 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fad31-0eab-4e6b-b6bb-58dd395510bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:48.217138 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fad31-0eab-4e6b-b6bb-58dd395510bb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:48.344438 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 924/1831] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:48 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:48.345509 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60b848-0075-4743-8df3-dfaaccd7279c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:48.356653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60b848-0075-4743-8df3-dfaaccd7279c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:48.411307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef9093-1ce5-43f2-a304-aa8e8c316c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:48.412508 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef9093-1ce5-43f2-a304-aa8e8c316c13 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:48.412797 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef9093-1ce5-43f2-a304-aa8e8c316c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:48.413075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef9093-1ce5-43f2-a304-aa8e8c316c13 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:48.413786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef9093-1ce5-43f2-a304-aa8e8c316c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:48.415726 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef9093-1ce5-43f2-a304-aa8e8c316c13 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:48.514939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 908/1832] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:48 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:09:48.518917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fad31-0eab-4e6b-b6bb-58dd395510bb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:48.529372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fad31-0eab-4e6b-b6bb-58dd395510bb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:48.534027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cf9ca-af5d-44a9-bda0-f99f6799d1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:48.534676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cf9ca-af5d-44a9-bda0-f99f6799d1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:48.534955 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cf9ca-af5d-44a9-bda0-f99f6799d1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:48.535267 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cf9ca-af5d-44a9-bda0-f99f6799d1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:48.536115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cf9ca-af5d-44a9-bda0-f99f6799d1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:48.538516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cf9ca-af5d-44a9-bda0-f99f6799d1d7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:48.549757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 925/1833] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:48.554270 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef9093-1ce5-43f2-a304-aa8e8c316c13 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:48.564941 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef9093-1ce5-43f2-a304-aa8e8c316c13 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:48.569909 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1f482-7c55-4002-8cd5-90c084484d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:48.570551 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1f482-7c55-4002-8cd5-90c084484d70 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:48.570832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1f482-7c55-4002-8cd5-90c084484d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:48.571137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1f482-7c55-4002-8cd5-90c084484d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:48.571858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1f482-7c55-4002-8cd5-90c084484d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:48.573426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1f482-7c55-4002-8cd5-90c084484d70 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:48.583018 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 909/1834] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:48.587588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cf9ca-af5d-44a9-bda0-f99f6799d1d7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:48.597127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cf9ca-af5d-44a9-bda0-f99f6799d1d7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:48.601715 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59685b55-0072-4f7d-888a-1445d4e52d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:48.602574 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59685b55-0072-4f7d-888a-1445d4e52d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:48.602855 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59685b55-0072-4f7d-888a-1445d4e52d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:48.603151 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59685b55-0072-4f7d-888a-1445d4e52d22 admin admin] PATH_INFO: `/v3/projects/56fb7a540dcc40f2a12131ef1da4bafb/users/e308f8de26884326a5faf24a31c012f1/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:48.616902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59685b55-0072-4f7d-888a-1445d4e52d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56fb7a540dcc40f2a12131ef1da4bafb, user_id=e308f8de26884326a5faf24a31c012f1, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:48.619581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59685b55-0072-4f7d-888a-1445d4e52d22 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:48.732177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 926/1835] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:48 2022] PUT /identity/v3/projects/56fb7a540dcc40f2a12131ef1da4bafb/users/e308f8de26884326a5faf24a31c012f1/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:48.744278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6abf01-5759-49c4-b8b8-9fb29da34f3d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:48.744590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6abf01-5759-49c4-b8b8-9fb29da34f3d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:48.744951 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6abf01-5759-49c4-b8b8-9fb29da34f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:48.771883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-dc6abf01-5759-49c4-b8b8-9fb29da34f3d None None] MFA Rules not processed for user `e308f8de26884326a5faf24a31c012f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:48.773117 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dc6abf01-5759-49c4-b8b8-9fb29da34f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:48.842765 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 910/1836] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:48.884246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59685b55-0072-4f7d-888a-1445d4e52d22 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:48.886077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-59685b55-0072-4f7d-888a-1445d4e52d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:48.953166 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59685b55-0072-4f7d-888a-1445d4e52d22 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:48.956902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c25622-16de-4d4c-be9a-194f80fbb8f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:48.957548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c25622-16de-4d4c-be9a-194f80fbb8f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:48.957824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c25622-16de-4d4c-be9a-194f80fbb8f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:48.958091 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c25622-16de-4d4c-be9a-194f80fbb8f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:48.968199 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c25622-16de-4d4c-be9a-194f80fbb8f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:48.974110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c25622-16de-4d4c-be9a-194f80fbb8f4 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:48.978801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 927/1837] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:48.999040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6abf01-5759-49c4-b8b8-9fb29da34f3d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:49.080377 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6abf01-5759-49c4-b8b8-9fb29da34f3d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:49.085692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46295c98-589a-49a4-9503-2cf3cc637477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:49.086602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46295c98-589a-49a4-9503-2cf3cc637477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:49.086889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46295c98-589a-49a4-9503-2cf3cc637477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:49.087219 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46295c98-589a-49a4-9503-2cf3cc637477 admin admin] PATH_INFO: `/v3/users/e308f8de26884326a5faf24a31c012f1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:49.089218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46295c98-589a-49a4-9503-2cf3cc637477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e308f8de26884326a5faf24a31c012f1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:49.092199 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46295c98-589a-49a4-9503-2cf3cc637477 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:49.295471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-46295c98-589a-49a4-9503-2cf3cc637477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e308f8de26884326a5faf24a31c012f1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:49.315765 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-46295c98-589a-49a4-9503-2cf3cc637477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e308f8de26884326a5faf24a31c012f1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:49.316631 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-46295c98-589a-49a4-9503-2cf3cc637477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e308f8de26884326a5faf24a31c012f1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:49.390428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-46295c98-589a-49a4-9503-2cf3cc637477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e308f8de26884326a5faf24a31c012f1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:49.391061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-46295c98-589a-49a4-9503-2cf3cc637477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e308f8de26884326a5faf24a31c012f1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:49.404357 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 911/1838] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:48 2022] DELETE /identity/v3/users/e308f8de26884326a5faf24a31c012f1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:49.409088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d95cc5-1575-4cc3-b4d7-8628b8b4deb0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:49.409376 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d95cc5-1575-4cc3-b4d7-8628b8b4deb0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:49.409652 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d95cc5-1575-4cc3-b4d7-8628b8b4deb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:49.429399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-51d95cc5-1575-4cc3-b4d7-8628b8b4deb0 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:49.430934 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-51d95cc5-1575-4cc3-b4d7-8628b8b4deb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:49.491801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 928/1839] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:49.501922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46295c98-589a-49a4-9503-2cf3cc637477 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:49.503348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-46295c98-589a-49a4-9503-2cf3cc637477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:49.561692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46295c98-589a-49a4-9503-2cf3cc637477 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:49.565520 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc60db-dedc-4413-815d-85a15eea642a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:49.566486 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc60db-dedc-4413-815d-85a15eea642a service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:49.566711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc60db-dedc-4413-815d-85a15eea642a service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:49.566991 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc60db-dedc-4413-815d-85a15eea642a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:49.577225 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc60db-dedc-4413-815d-85a15eea642a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:49.578825 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc60db-dedc-4413-815d-85a15eea642a service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:49.589268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 912/1840] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:50.048313 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d95cc5-1575-4cc3-b4d7-8628b8b4deb0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:50.050062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-51d95cc5-1575-4cc3-b4d7-8628b8b4deb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:50.065312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d95cc5-1575-4cc3-b4d7-8628b8b4deb0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:50.071914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420443f-35dc-4115-8fe3-f984bd01b8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:50.072782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420443f-35dc-4115-8fe3-f984bd01b8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:50.072782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420443f-35dc-4115-8fe3-f984bd01b8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:50.073399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420443f-35dc-4115-8fe3-f984bd01b8ed admin admin] PATH_INFO: `/v3/projects/56fb7a540dcc40f2a12131ef1da4bafb` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:50.074531 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420443f-35dc-4115-8fe3-f984bd01b8ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=56fb7a540dcc40f2a12131ef1da4bafb)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:50.076563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420443f-35dc-4115-8fe3-f984bd01b8ed admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:50.179015 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3420443f-35dc-4115-8fe3-f984bd01b8ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56fb7a540dcc40f2a12131ef1da4bafb', 'request_id': 'req-3420443f-35dc-4115-8fe3-f984bd01b8ed'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:50.185370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3420443f-35dc-4115-8fe3-f984bd01b8ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56fb7a540dcc40f2a12131ef1da4bafb', 'request_id': 'req-3420443f-35dc-4115-8fe3-f984bd01b8ed'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:50.190869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3420443f-35dc-4115-8fe3-f984bd01b8ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56fb7a540dcc40f2a12131ef1da4bafb', 'request_id': 'req-3420443f-35dc-4115-8fe3-f984bd01b8ed'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:50.269481 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3420443f-35dc-4115-8fe3-f984bd01b8ed admin admin] The token cache is being invalidate because project 56fb7a540dcc40f2a12131ef1da4bafb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:50.269481 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3420443f-35dc-4115-8fe3-f984bd01b8ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:50.269884 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3420443f-35dc-4115-8fe3-f984bd01b8ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:50.272257 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 929/1841] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:50 2022] DELETE /identity/v3/projects/56fb7a540dcc40f2a12131ef1da4bafb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:50.277308 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70953f4-0234-4432-8529-4be0c0461d3d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:50.277779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70953f4-0234-4432-8529-4be0c0461d3d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:50.277884 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70953f4-0234-4432-8529-4be0c0461d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:50.312946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d70953f4-0234-4432-8529-4be0c0461d3d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:50.314567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d70953f4-0234-4432-8529-4be0c0461d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:50.398966 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 913/1842] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:50.400829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e7319-0710-4e56-9850-29baee0b45e7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:50.401580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e7319-0710-4e56-9850-29baee0b45e7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:50.401902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e7319-0710-4e56-9850-29baee0b45e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:50.427939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a57e7319-0710-4e56-9850-29baee0b45e7 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:50.429231 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a57e7319-0710-4e56-9850-29baee0b45e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:50.437596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 930/1843] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:50.442082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70953f4-0234-4432-8529-4be0c0461d3d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:50.452316 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70953f4-0234-4432-8529-4be0c0461d3d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:50.457030 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5973c3-b684-4ffd-96c4-323763ee548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:50.457938 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5973c3-b684-4ffd-96c4-323763ee548d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:50.458039 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5973c3-b684-4ffd-96c4-323763ee548d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:50.458846 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5973c3-b684-4ffd-96c4-323763ee548d admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:50.459955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5973c3-b684-4ffd-96c4-323763ee548d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:09:50.460264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5973c3-b684-4ffd-96c4-323763ee548d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:50.461844 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5973c3-b684-4ffd-96c4-323763ee548d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:50.473480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 914/1844] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:09:50.478870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e7319-0710-4e56-9850-29baee0b45e7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:50.488412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e7319-0710-4e56-9850-29baee0b45e7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:50.493258 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01cec8-0aa6-4a16-b964-92ca89c9295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:50.493904 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01cec8-0aa6-4a16-b964-92ca89c9295c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:50.494183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01cec8-0aa6-4a16-b964-92ca89c9295c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:50.494455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01cec8-0aa6-4a16-b964-92ca89c9295c admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:50.495229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01cec8-0aa6-4a16-b964-92ca89c9295c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:50.497175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01cec8-0aa6-4a16-b964-92ca89c9295c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:50.601555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 931/1845] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:50 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:50.605810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5973c3-b684-4ffd-96c4-323763ee548d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:50.615876 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5973c3-b684-4ffd-96c4-323763ee548d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:50.676727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d796e4f-6ede-46b7-a996-4f5be9c34d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:50.678098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d796e4f-6ede-46b7-a996-4f5be9c34d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:50.678631 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d796e4f-6ede-46b7-a996-4f5be9c34d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:50.678759 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d796e4f-6ede-46b7-a996-4f5be9c34d7d admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:50.679560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d796e4f-6ede-46b7-a996-4f5be9c34d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:50.681668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d796e4f-6ede-46b7-a996-4f5be9c34d7d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:50.786298 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 915/1846] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:50 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:50.788575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01cec8-0aa6-4a16-b964-92ca89c9295c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:50.801099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01cec8-0aa6-4a16-b964-92ca89c9295c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:50.807787 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b61c7-c6a1-4ae7-a509-b2d6a0e015ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:50.808518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b61c7-c6a1-4ae7-a509-b2d6a0e015ad admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:50.809224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b61c7-c6a1-4ae7-a509-b2d6a0e015ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:50.809575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b61c7-c6a1-4ae7-a509-b2d6a0e015ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:50.810386 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b61c7-c6a1-4ae7-a509-b2d6a0e015ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:50.812087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b61c7-c6a1-4ae7-a509-b2d6a0e015ad admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:50.824541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 932/1847] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:50.831329 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d796e4f-6ede-46b7-a996-4f5be9c34d7d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:50.838922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d796e4f-6ede-46b7-a996-4f5be9c34d7d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:50.843673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de41dbd-56fd-405a-943a-bb2929e9e03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:50.844327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de41dbd-56fd-405a-943a-bb2929e9e03f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:50.844606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de41dbd-56fd-405a-943a-bb2929e9e03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:50.844879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de41dbd-56fd-405a-943a-bb2929e9e03f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:50.845601 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de41dbd-56fd-405a-943a-bb2929e9e03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:50.847308 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de41dbd-56fd-405a-943a-bb2929e9e03f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:50.858489 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 916/1848] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:50.862724 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b61c7-c6a1-4ae7-a509-b2d6a0e015ad admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:50.875151 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b61c7-c6a1-4ae7-a509-b2d6a0e015ad admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:50.880023 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052856d-9217-4b75-84de-0bfbb89f9c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:50.881636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052856d-9217-4b75-84de-0bfbb89f9c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:50.881914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052856d-9217-4b75-84de-0bfbb89f9c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:50.882188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052856d-9217-4b75-84de-0bfbb89f9c24 admin admin] PATH_INFO: `/v3/projects/9cf00d60a8a14803bad841273acfce15/users/dfb224e635d248e5bc3aad117f59ebb1/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:50.898162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052856d-9217-4b75-84de-0bfbb89f9c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf00d60a8a14803bad841273acfce15, user_id=dfb224e635d248e5bc3aad117f59ebb1, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:50.900926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052856d-9217-4b75-84de-0bfbb89f9c24 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:50.996828 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 933/1849] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:50 2022] PUT /identity/v3/projects/9cf00d60a8a14803bad841273acfce15/users/dfb224e635d248e5bc3aad117f59ebb1/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:51.007262 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a229f5-e642-4a6a-8da0-6e1076a9e10b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:51.007556 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a229f5-e642-4a6a-8da0-6e1076a9e10b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:51.007840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a229f5-e642-4a6a-8da0-6e1076a9e10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:51.034531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-28a229f5-e642-4a6a-8da0-6e1076a9e10b None None] MFA Rules not processed for user `dfb224e635d248e5bc3aad117f59ebb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:51.035873 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-28a229f5-e642-4a6a-8da0-6e1076a9e10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:51.104900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 917/1850] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:51.109386 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052856d-9217-4b75-84de-0bfbb89f9c24 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:51.179162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052856d-9217-4b75-84de-0bfbb89f9c24 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:51.185042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86ebc5-55dd-4f94-a013-5656bbfda383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:51.185715 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86ebc5-55dd-4f94-a013-5656bbfda383 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:51.186040 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86ebc5-55dd-4f94-a013-5656bbfda383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:51.186418 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86ebc5-55dd-4f94-a013-5656bbfda383 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:51.187191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86ebc5-55dd-4f94-a013-5656bbfda383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:51.189125 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86ebc5-55dd-4f94-a013-5656bbfda383 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:51.304747 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 934/1851] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:51 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:51.306247 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a229f5-e642-4a6a-8da0-6e1076a9e10b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:51.318327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a229f5-e642-4a6a-8da0-6e1076a9e10b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:51.412046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b67fb4-b9eb-43ea-8c1e-05c13c822529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:51.418241 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b67fb4-b9eb-43ea-8c1e-05c13c822529 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:51.418241 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b67fb4-b9eb-43ea-8c1e-05c13c822529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:51.418241 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b67fb4-b9eb-43ea-8c1e-05c13c822529 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:51.418241 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b67fb4-b9eb-43ea-8c1e-05c13c822529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:51.418241 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b67fb4-b9eb-43ea-8c1e-05c13c822529 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:51.500614 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 918/1852] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:51 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:51.506850 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86ebc5-55dd-4f94-a013-5656bbfda383 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:51.519959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86ebc5-55dd-4f94-a013-5656bbfda383 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:51.526785 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d0719-2808-4741-acd2-4e3aef54bc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:51.527634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d0719-2808-4741-acd2-4e3aef54bc97 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:51.527919 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d0719-2808-4741-acd2-4e3aef54bc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:51.528194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d0719-2808-4741-acd2-4e3aef54bc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:51.528936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d0719-2808-4741-acd2-4e3aef54bc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:51.531651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d0719-2808-4741-acd2-4e3aef54bc97 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:51.546136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 935/1853] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:51.547446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b67fb4-b9eb-43ea-8c1e-05c13c822529 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:51.577465 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b67fb4-b9eb-43ea-8c1e-05c13c822529 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:51.592933 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb93f75-fecd-4fb3-8d5b-3f98edbf1c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:51.593632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb93f75-fecd-4fb3-8d5b-3f98edbf1c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:51.593940 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb93f75-fecd-4fb3-8d5b-3f98edbf1c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:51.594187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb93f75-fecd-4fb3-8d5b-3f98edbf1c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:51.594927 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb93f75-fecd-4fb3-8d5b-3f98edbf1c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:51.596586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb93f75-fecd-4fb3-8d5b-3f98edbf1c89 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:51.623774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 919/1854] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:51.624918 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d0719-2808-4741-acd2-4e3aef54bc97 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:51.637582 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d0719-2808-4741-acd2-4e3aef54bc97 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:51.642790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd34e8f-d543-47dd-a8d5-169cbbf8147e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:51.643860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd34e8f-d543-47dd-a8d5-169cbbf8147e admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:51.644244 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd34e8f-d543-47dd-a8d5-169cbbf8147e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:51.644638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd34e8f-d543-47dd-a8d5-169cbbf8147e admin admin] PATH_INFO: `/v3/projects/799eef0511de4ee6b496e79f2aff4d4a/users/5b1d3e73d70b41e5b5b83d48878bd63f/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:51.661285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd34e8f-d543-47dd-a8d5-169cbbf8147e admin admin] RBAC: Authorizing `identity:create_grant(project_id=799eef0511de4ee6b496e79f2aff4d4a, user_id=5b1d3e73d70b41e5b5b83d48878bd63f, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:51.664224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd34e8f-d543-47dd-a8d5-169cbbf8147e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:51.774944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 936/1855] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:51 2022] PUT /identity/v3/projects/799eef0511de4ee6b496e79f2aff4d4a/users/5b1d3e73d70b41e5b5b83d48878bd63f/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:51.787091 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda7272-3421-4b03-b892-9fde5705eb6d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:51.787537 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda7272-3421-4b03-b892-9fde5705eb6d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:51.787829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda7272-3421-4b03-b892-9fde5705eb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:51.840349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5bda7272-3421-4b03-b892-9fde5705eb6d None None] MFA Rules not processed for user `5b1d3e73d70b41e5b5b83d48878bd63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:51.840349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5bda7272-3421-4b03-b892-9fde5705eb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:51.976479 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 920/1856] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:51.981531 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd34e8f-d543-47dd-a8d5-169cbbf8147e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:52.103022 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd34e8f-d543-47dd-a8d5-169cbbf8147e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:52.108856 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b637713-b05e-499f-b9fd-9172191d1762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:52.110444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b637713-b05e-499f-b9fd-9172191d1762 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:52.113325 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b637713-b05e-499f-b9fd-9172191d1762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:52.113325 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b637713-b05e-499f-b9fd-9172191d1762 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:52.113325 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b637713-b05e-499f-b9fd-9172191d1762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:52.114047 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b637713-b05e-499f-b9fd-9172191d1762 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:52.274946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 937/1857] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:51 2022] POST /identity/v3/projects => generated 383 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:52.278373 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda7272-3421-4b03-b892-9fde5705eb6d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:52.290237 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda7272-3421-4b03-b892-9fde5705eb6d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:52.346232 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65129692-5d52-4f44-895e-b3884268c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:52.346927 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65129692-5d52-4f44-895e-b3884268c2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:52.347214 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65129692-5d52-4f44-895e-b3884268c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:52.347496 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65129692-5d52-4f44-895e-b3884268c2b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:52.348204 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65129692-5d52-4f44-895e-b3884268c2b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:52.350680 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65129692-5d52-4f44-895e-b3884268c2b6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:52.460862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 921/1858] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:52 2022] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:09:52.465018 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b637713-b05e-499f-b9fd-9172191d1762 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:52.477238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b637713-b05e-499f-b9fd-9172191d1762 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:52.485564 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03e21f-d854-47ed-a598-d15852041ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:52.486420 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03e21f-d854-47ed-a598-d15852041ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:52.488235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03e21f-d854-47ed-a598-d15852041ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:52.488235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03e21f-d854-47ed-a598-d15852041ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:52.488235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03e21f-d854-47ed-a598-d15852041ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:52.489833 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03e21f-d854-47ed-a598-d15852041ea5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:52.502637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 938/1859] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:09:52.507966 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65129692-5d52-4f44-895e-b3884268c2b6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:52.534924 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65129692-5d52-4f44-895e-b3884268c2b6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:52.540934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e77b1-4456-4769-ad4c-e4a5fa0411f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:52.541887 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e77b1-4456-4769-ad4c-e4a5fa0411f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:52.542331 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e77b1-4456-4769-ad4c-e4a5fa0411f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:52.542619 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e77b1-4456-4769-ad4c-e4a5fa0411f3 admin admin] PATH_INFO: `/v3/projects/b46672b97a5a416e81fb84e8f81b431c/users/a4c36625171548d3a555cc1b518ac86a/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:52.563585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e77b1-4456-4769-ad4c-e4a5fa0411f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46672b97a5a416e81fb84e8f81b431c, user_id=a4c36625171548d3a555cc1b518ac86a, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:52.566265 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e77b1-4456-4769-ad4c-e4a5fa0411f3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:52.666070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 922/1860] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:52 2022] PUT /identity/v3/projects/b46672b97a5a416e81fb84e8f81b431c/users/a4c36625171548d3a555cc1b518ac86a/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:09:52.669946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03e21f-d854-47ed-a598-d15852041ea5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:52.681824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03e21f-d854-47ed-a598-d15852041ea5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:52.741335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5d853-36cd-4ded-a23a-5f3175ee74dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:52.742006 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5d853-36cd-4ded-a23a-5f3175ee74dc admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:52.742286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5d853-36cd-4ded-a23a-5f3175ee74dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:52.742558 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5d853-36cd-4ded-a23a-5f3175ee74dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:52.743371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5d853-36cd-4ded-a23a-5f3175ee74dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:52.745098 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5d853-36cd-4ded-a23a-5f3175ee74dc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:52.758973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 939/1861] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:09:52.760242 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e77b1-4456-4769-ad4c-e4a5fa0411f3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:52.771144 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e77b1-4456-4769-ad4c-e4a5fa0411f3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:52.775902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbc271-bdc0-47d3-9e7a-03fe0efa25dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:52.776790 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbc271-bdc0-47d3-9e7a-03fe0efa25dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:52.777080 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbc271-bdc0-47d3-9e7a-03fe0efa25dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:52.777352 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbc271-bdc0-47d3-9e7a-03fe0efa25dd admin admin] PATH_INFO: `/v3/projects/b46672b97a5a416e81fb84e8f81b431c/users/a4c36625171548d3a555cc1b518ac86a/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:52.780094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbc271-bdc0-47d3-9e7a-03fe0efa25dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46672b97a5a416e81fb84e8f81b431c, user_id=a4c36625171548d3a555cc1b518ac86a, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:52.782955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbc271-bdc0-47d3-9e7a-03fe0efa25dd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:52.795866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 923/1862] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:52 2022] PUT /identity/v3/projects/b46672b97a5a416e81fb84e8f81b431c/users/a4c36625171548d3a555cc1b518ac86a/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:52.805730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae28e68-484b-41aa-8c00-f251920f5277 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:52.806243 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae28e68-484b-41aa-8c00-f251920f5277 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:52.806617 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae28e68-484b-41aa-8c00-f251920f5277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:52.834026 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2ae28e68-484b-41aa-8c00-f251920f5277 None None] MFA Rules not processed for user `a4c36625171548d3a555cc1b518ac86a`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:52.835585 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2ae28e68-484b-41aa-8c00-f251920f5277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:52.911776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 940/1863] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:52.923188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbc271-bdc0-47d3-9e7a-03fe0efa25dd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:52.924854 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f1bbc271-bdc0-47d3-9e7a-03fe0efa25dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:52.984079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbc271-bdc0-47d3-9e7a-03fe0efa25dd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:52.987949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366872b5-2ce1-42bb-895a-5034a3570ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:52.988667 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366872b5-2ce1-42bb-895a-5034a3570ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:52.989011 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366872b5-2ce1-42bb-895a-5034a3570ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:52.989708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366872b5-2ce1-42bb-895a-5034a3570ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:53.044943 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366872b5-2ce1-42bb-895a-5034a3570ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:53.046439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366872b5-2ce1-42bb-895a-5034a3570ae8 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:53.057362 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 924/1864] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:54.398956 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae28e68-484b-41aa-8c00-f251920f5277 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:54.400802 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2ae28e68-484b-41aa-8c00-f251920f5277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:54.533734 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae28e68-484b-41aa-8c00-f251920f5277 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:54.549224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e26ee-2f1f-4e50-bd1f-a735e903bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:54.554498 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e26ee-2f1f-4e50-bd1f-a735e903bbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:54.555128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e26ee-2f1f-4e50-bd1f-a735e903bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:54.555795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e26ee-2f1f-4e50-bd1f-a735e903bbb3 admin admin] PATH_INFO: `/v3/users/dd8433ccaad9436a9c4a7eba3bce5eaf` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:54.558432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e26ee-2f1f-4e50-bd1f-a735e903bbb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd8433ccaad9436a9c4a7eba3bce5eaf)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:54.563708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e26ee-2f1f-4e50-bd1f-a735e903bbb3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:54.794522 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b26e26ee-2f1f-4e50-bd1f-a735e903bbb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd8433ccaad9436a9c4a7eba3bce5eaf'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:54.809901 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b26e26ee-2f1f-4e50-bd1f-a735e903bbb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd8433ccaad9436a9c4a7eba3bce5eaf'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:54.885827 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b26e26ee-2f1f-4e50-bd1f-a735e903bbb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd8433ccaad9436a9c4a7eba3bce5eaf'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:54.886436 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b26e26ee-2f1f-4e50-bd1f-a735e903bbb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd8433ccaad9436a9c4a7eba3bce5eaf'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:54.887061 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b26e26ee-2f1f-4e50-bd1f-a735e903bbb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd8433ccaad9436a9c4a7eba3bce5eaf'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:54.900448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 941/1865] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:54 2022] DELETE /identity/v3/users/dd8433ccaad9436a9c4a7eba3bce5eaf => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:54.905037 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf334fc-d410-4335-8a3f-79f630761591 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:54.905481 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf334fc-d410-4335-8a3f-79f630761591 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:54.905586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf334fc-d410-4335-8a3f-79f630761591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:54.922889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-adf334fc-d410-4335-8a3f-79f630761591 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:54.924126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-adf334fc-d410-4335-8a3f-79f630761591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:54.983504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 925/1866] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:54.993737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e26ee-2f1f-4e50-bd1f-a735e903bbb3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:54.995191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b26e26ee-2f1f-4e50-bd1f-a735e903bbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:55.059853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e26ee-2f1f-4e50-bd1f-a735e903bbb3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:55.059853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3a29c-5d7f-407b-9cc4-f3bec40d1bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:55.060034 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3a29c-5d7f-407b-9cc4-f3bec40d1bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:55.060267 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3a29c-5d7f-407b-9cc4-f3bec40d1bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:55.060530 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3a29c-5d7f-407b-9cc4-f3bec40d1bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:55.070394 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3a29c-5d7f-407b-9cc4-f3bec40d1bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:55.071951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3a29c-5d7f-407b-9cc4-f3bec40d1bb7 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:55.081582 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 942/1867] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:55.115074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf334fc-d410-4335-8a3f-79f630761591 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:55.116732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-adf334fc-d410-4335-8a3f-79f630761591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:55.173659 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf334fc-d410-4335-8a3f-79f630761591 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:55.178017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ecbc4-537b-4bf9-bb0a-7041195567e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:55.178656 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ecbc4-537b-4bf9-bb0a-7041195567e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:55.178934 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ecbc4-537b-4bf9-bb0a-7041195567e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:55.179236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ecbc4-537b-4bf9-bb0a-7041195567e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:55.180963 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d90ecbc4-537b-4bf9-bb0a-7041195567e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:55.238957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ecbc4-537b-4bf9-bb0a-7041195567e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:55.241605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ecbc4-537b-4bf9-bb0a-7041195567e8 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:55.251173 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 926/1868] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:09:55.473147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3a29c-5d7f-407b-9cc4-f3bec40d1bb7 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:55.475685 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-21e3a29c-5d7f-407b-9cc4-f3bec40d1bb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:55.488382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3a29c-5d7f-407b-9cc4-f3bec40d1bb7 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:55.493282 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f7122-c86e-47af-9e6a-305707d6ea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:55.494215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f7122-c86e-47af-9e6a-305707d6ea4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:55.494504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f7122-c86e-47af-9e6a-305707d6ea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:55.494782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f7122-c86e-47af-9e6a-305707d6ea4f admin admin] PATH_INFO: `/v3/projects/72cf162ce59647cb9f3fd6df3ab3b476` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:55.495995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f7122-c86e-47af-9e6a-305707d6ea4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=72cf162ce59647cb9f3fd6df3ab3b476)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:55.498019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f7122-c86e-47af-9e6a-305707d6ea4f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:55.638008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f74f7122-c86e-47af-9e6a-305707d6ea4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72cf162ce59647cb9f3fd6df3ab3b476', 'request_id': 'req-f74f7122-c86e-47af-9e6a-305707d6ea4f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:55.644537 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f74f7122-c86e-47af-9e6a-305707d6ea4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72cf162ce59647cb9f3fd6df3ab3b476', 'request_id': 'req-f74f7122-c86e-47af-9e6a-305707d6ea4f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:55.651024 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f74f7122-c86e-47af-9e6a-305707d6ea4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72cf162ce59647cb9f3fd6df3ab3b476', 'request_id': 'req-f74f7122-c86e-47af-9e6a-305707d6ea4f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:55.762538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f74f7122-c86e-47af-9e6a-305707d6ea4f admin admin] The token cache is being invalidate because project 72cf162ce59647cb9f3fd6df3ab3b476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:55.762825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f74f7122-c86e-47af-9e6a-305707d6ea4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:55.763470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f74f7122-c86e-47af-9e6a-305707d6ea4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:55.770902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 943/1869] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:55 2022] DELETE /identity/v3/projects/72cf162ce59647cb9f3fd6df3ab3b476 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:55.773713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ecbc4-537b-4bf9-bb0a-7041195567e8 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:55.784168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ecbc4-537b-4bf9-bb0a-7041195567e8 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:55.843226 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2729b5-d10a-4a5d-a8f6-e3977fafa7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:55.844098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2729b5-d10a-4a5d-a8f6-e3977fafa7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:55.844379 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2729b5-d10a-4a5d-a8f6-e3977fafa7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:55.844652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2729b5-d10a-4a5d-a8f6-e3977fafa7e5 admin admin] PATH_INFO: `/v3/users/5511f3c9ece2460baa80712fb24f57e7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:55.845861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2729b5-d10a-4a5d-a8f6-e3977fafa7e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5511f3c9ece2460baa80712fb24f57e7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:55.847804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2729b5-d10a-4a5d-a8f6-e3977fafa7e5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:56.079935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f7122-c86e-47af-9e6a-305707d6ea4f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:56.081490 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f74f7122-c86e-47af-9e6a-305707d6ea4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:56.095533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f7122-c86e-47af-9e6a-305707d6ea4f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:56.103480 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff61b7e-229f-47c7-9ff3-1296a9945aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:56.104441 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff61b7e-229f-47c7-9ff3-1296a9945aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:56.104926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff61b7e-229f-47c7-9ff3-1296a9945aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:56.105404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff61b7e-229f-47c7-9ff3-1296a9945aa0 admin admin] PATH_INFO: `/v3/users/312dea7575a44de593c0ce200cd3812d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:56.106936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff61b7e-229f-47c7-9ff3-1296a9945aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=312dea7575a44de593c0ce200cd3812d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:56.109188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff61b7e-229f-47c7-9ff3-1296a9945aa0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:56.122194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-df2729b5-d10a-4a5d-a8f6-e3977fafa7e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5511f3c9ece2460baa80712fb24f57e7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:56.137041 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-df2729b5-d10a-4a5d-a8f6-e3977fafa7e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5511f3c9ece2460baa80712fb24f57e7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:56.137848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-df2729b5-d10a-4a5d-a8f6-e3977fafa7e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5511f3c9ece2460baa80712fb24f57e7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:56.228654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-df2729b5-d10a-4a5d-a8f6-e3977fafa7e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5511f3c9ece2460baa80712fb24f57e7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:56.229359 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-df2729b5-d10a-4a5d-a8f6-e3977fafa7e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5511f3c9ece2460baa80712fb24f57e7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:56.242512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 927/1870] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:55 2022] DELETE /identity/v3/users/5511f3c9ece2460baa80712fb24f57e7 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:56.353122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3ff61b7e-229f-47c7-9ff3-1296a9945aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312dea7575a44de593c0ce200cd3812d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:56.364556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3ff61b7e-229f-47c7-9ff3-1296a9945aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312dea7575a44de593c0ce200cd3812d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:56.470909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3ff61b7e-229f-47c7-9ff3-1296a9945aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312dea7575a44de593c0ce200cd3812d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:56.471555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3ff61b7e-229f-47c7-9ff3-1296a9945aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312dea7575a44de593c0ce200cd3812d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:56.472155 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3ff61b7e-229f-47c7-9ff3-1296a9945aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312dea7575a44de593c0ce200cd3812d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:56.492134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 944/1871] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:09:56 2022] DELETE /identity/v3/users/312dea7575a44de593c0ce200cd3812d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:09:56.503596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c78e70-29fc-4e56-a3a2-bd179ce6c744 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:56.503772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c78e70-29fc-4e56-a3a2-bd179ce6c744 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:56.504063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c78e70-29fc-4e56-a3a2-bd179ce6c744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:56.531911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b3c78e70-29fc-4e56-a3a2-bd179ce6c744 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:56.533169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b3c78e70-29fc-4e56-a3a2-bd179ce6c744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:56.599891 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 928/1872] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:56.610604 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff61b7e-229f-47c7-9ff3-1296a9945aa0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:56.612075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3ff61b7e-229f-47c7-9ff3-1296a9945aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:56.668915 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff61b7e-229f-47c7-9ff3-1296a9945aa0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:56.672446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1134e-c5dc-4c6e-8127-8188e0ac924f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:56.673086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1134e-c5dc-4c6e-8127-8188e0ac924f service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:56.673372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1134e-c5dc-4c6e-8127-8188e0ac924f service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:56.673643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1134e-c5dc-4c6e-8127-8188e0ac924f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:56.684273 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1134e-c5dc-4c6e-8127-8188e0ac924f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:56.686223 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1134e-c5dc-4c6e-8127-8188e0ac924f service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:56.696841 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 945/1873] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:56.712217 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c78e70-29fc-4e56-a3a2-bd179ce6c744 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:56.714605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b3c78e70-29fc-4e56-a3a2-bd179ce6c744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:56.729045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c78e70-29fc-4e56-a3a2-bd179ce6c744 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:56.734393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3823ec-0ac5-4f68-b037-165ae9b10422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:56.735959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3823ec-0ac5-4f68-b037-165ae9b10422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:56.736585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3823ec-0ac5-4f68-b037-165ae9b10422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:56.736911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3823ec-0ac5-4f68-b037-165ae9b10422 admin admin] PATH_INFO: `/v3/projects/7e9cb2b2b8e942e391eb3f073706a70a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:56.738332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3823ec-0ac5-4f68-b037-165ae9b10422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e9cb2b2b8e942e391eb3f073706a70a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:56.745548 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3823ec-0ac5-4f68-b037-165ae9b10422 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:57.132168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2f3823ec-0ac5-4f68-b037-165ae9b10422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e9cb2b2b8e942e391eb3f073706a70a', 'request_id': 'req-2f3823ec-0ac5-4f68-b037-165ae9b10422'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:57.390589 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2f3823ec-0ac5-4f68-b037-165ae9b10422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e9cb2b2b8e942e391eb3f073706a70a', 'request_id': 'req-2f3823ec-0ac5-4f68-b037-165ae9b10422'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:57.396726 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2f3823ec-0ac5-4f68-b037-165ae9b10422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e9cb2b2b8e942e391eb3f073706a70a', 'request_id': 'req-2f3823ec-0ac5-4f68-b037-165ae9b10422'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:57.409126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2f3823ec-0ac5-4f68-b037-165ae9b10422 admin admin] The token cache is being invalidate because project 7e9cb2b2b8e942e391eb3f073706a70a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:57.409447 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2f3823ec-0ac5-4f68-b037-165ae9b10422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:57.410094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2f3823ec-0ac5-4f68-b037-165ae9b10422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:57.411713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 929/1874] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:56 2022] DELETE /identity/v3/projects/7e9cb2b2b8e942e391eb3f073706a70a => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:57.417323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8426e-607e-457a-8d8c-a93211aae30b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:57.421601 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8426e-607e-457a-8d8c-a93211aae30b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:57.421601 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8426e-607e-457a-8d8c-a93211aae30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:57.436101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e5d8426e-607e-457a-8d8c-a93211aae30b None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:57.437316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e5d8426e-607e-457a-8d8c-a93211aae30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:57.506992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 946/1875] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:57.508711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0f169-e74f-4c38-9a34-f9a782a0fb49 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:57.509019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0f169-e74f-4c38-9a34-f9a782a0fb49 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:57.509469 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0f169-e74f-4c38-9a34-f9a782a0fb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:57.528351 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1bb0f169-e74f-4c38-9a34-f9a782a0fb49 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:57.529724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1bb0f169-e74f-4c38-9a34-f9a782a0fb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:57.543146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8426e-607e-457a-8d8c-a93211aae30b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:57.543384 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 930/1876] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:57.544113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e5d8426e-607e-457a-8d8c-a93211aae30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:57.546993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0f169-e74f-4c38-9a34-f9a782a0fb49 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:57.559581 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0f169-e74f-4c38-9a34-f9a782a0fb49 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:57.572543 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2c879-055b-4712-89f3-a8cac4f8b770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:57.572704 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8426e-607e-457a-8d8c-a93211aae30b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:57.572811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2c879-055b-4712-89f3-a8cac4f8b770 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:57.572811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2c879-055b-4712-89f3-a8cac4f8b770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:57.572811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2c879-055b-4712-89f3-a8cac4f8b770 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:57.572811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2c879-055b-4712-89f3-a8cac4f8b770 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:09:57.572811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2c879-055b-4712-89f3-a8cac4f8b770 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:57.573870 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2c879-055b-4712-89f3-a8cac4f8b770 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:57.576543 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7299fab-280a-48fc-86d7-89c0efc1c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:57.577664 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299fab-280a-48fc-86d7-89c0efc1c898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:57.578749 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299fab-280a-48fc-86d7-89c0efc1c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:57.580197 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299fab-280a-48fc-86d7-89c0efc1c898 admin admin] PATH_INFO: `/v3/projects/13b55c8de5014239b40d42bccd0d41f6` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:57.587624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 931/1877] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:09:57.588360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7299fab-280a-48fc-86d7-89c0efc1c898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b55c8de5014239b40d42bccd0d41f6)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:57.590736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7299fab-280a-48fc-86d7-89c0efc1c898 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:57.600455 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2c879-055b-4712-89f3-a8cac4f8b770 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:57.613651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2c879-055b-4712-89f3-a8cac4f8b770 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:57.619051 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0bdda-f317-4a19-9961-a0b81d9861c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:57.619737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0bdda-f317-4a19-9961-a0b81d9861c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:57.620019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0bdda-f317-4a19-9961-a0b81d9861c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:57.620294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0bdda-f317-4a19-9961-a0b81d9861c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:57.620984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0bdda-f317-4a19-9961-a0b81d9861c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:57.622927 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0bdda-f317-4a19-9961-a0b81d9861c6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:57.728665 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f7299fab-280a-48fc-86d7-89c0efc1c898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b55c8de5014239b40d42bccd0d41f6', 'request_id': 'req-f7299fab-280a-48fc-86d7-89c0efc1c898'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:57.734664 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f7299fab-280a-48fc-86d7-89c0efc1c898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b55c8de5014239b40d42bccd0d41f6', 'request_id': 'req-f7299fab-280a-48fc-86d7-89c0efc1c898'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:57.739952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f7299fab-280a-48fc-86d7-89c0efc1c898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b55c8de5014239b40d42bccd0d41f6', 'request_id': 'req-f7299fab-280a-48fc-86d7-89c0efc1c898'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:57.767017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 932/1878] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:57 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:57.769083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0bdda-f317-4a19-9961-a0b81d9861c6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:57.769492 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e5c0bdda-f317-4a19-9961-a0b81d9861c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:57.824013 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0bdda-f317-4a19-9961-a0b81d9861c6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:57.824245 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f7299fab-280a-48fc-86d7-89c0efc1c898 admin admin] The token cache is being invalidate because project 13b55c8de5014239b40d42bccd0d41f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:09:57.824412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f7299fab-280a-48fc-86d7-89c0efc1c898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:57.825053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f7299fab-280a-48fc-86d7-89c0efc1c898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:09:57.826634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 947/1879] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:09:57 2022] DELETE /identity/v3/projects/13b55c8de5014239b40d42bccd0d41f6 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:09:57.827629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe50ee6-8c51-4b70-942d-f3cd0ca09d03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:57.828274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe50ee6-8c51-4b70-942d-f3cd0ca09d03 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:57.828562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe50ee6-8c51-4b70-942d-f3cd0ca09d03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:57.828845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe50ee6-8c51-4b70-942d-f3cd0ca09d03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:57.830769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7299fab-280a-48fc-86d7-89c0efc1c898 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:57.830885 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-abe50ee6-8c51-4b70-942d-f3cd0ca09d03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:57.832058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f7299fab-280a-48fc-86d7-89c0efc1c898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:57.899654 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7299fab-280a-48fc-86d7-89c0efc1c898 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:57.906842 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe50ee6-8c51-4b70-942d-f3cd0ca09d03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:57.908300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe50ee6-8c51-4b70-942d-f3cd0ca09d03 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:57.918415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 933/1880] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:09:57.919864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183d646-50b0-4b96-a52c-af14fc5200c7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:57.920197 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183d646-50b0-4b96-a52c-af14fc5200c7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:57.920476 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183d646-50b0-4b96-a52c-af14fc5200c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:57.938331 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6183d646-50b0-4b96-a52c-af14fc5200c7 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:57.939759 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6183d646-50b0-4b96-a52c-af14fc5200c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:57.960319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25ee05-8aa2-47e8-a6b4-ee2d0a2697e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:57.961156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25ee05-8aa2-47e8-a6b4-ee2d0a2697e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:57.961451 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25ee05-8aa2-47e8-a6b4-ee2d0a2697e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:57.961757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25ee05-8aa2-47e8-a6b4-ee2d0a2697e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:57.962445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25ee05-8aa2-47e8-a6b4-ee2d0a2697e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:57.964420 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25ee05-8aa2-47e8-a6b4-ee2d0a2697e2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:58.000330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 934/1881] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:58.008552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a009a13-cfb9-487d-af28-f8ade40904fa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:58.008850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a009a13-cfb9-487d-af28-f8ade40904fa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:58.009133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a009a13-cfb9-487d-af28-f8ade40904fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:58.028711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4a009a13-cfb9-487d-af28-f8ade40904fa None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:58.029918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4a009a13-cfb9-487d-af28-f8ade40904fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:58.037727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 935/1882] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:58.042780 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a009a13-cfb9-487d-af28-f8ade40904fa None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:58.053209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a009a13-cfb9-487d-af28-f8ade40904fa None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:58.058448 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726f7e0-3237-4814-b7ea-00618afa8648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:58.059471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726f7e0-3237-4814-b7ea-00618afa8648 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:58.059830 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726f7e0-3237-4814-b7ea-00618afa8648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:58.060163 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726f7e0-3237-4814-b7ea-00618afa8648 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:58.061275 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726f7e0-3237-4814-b7ea-00618afa8648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:09:58.061938 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726f7e0-3237-4814-b7ea-00618afa8648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:58.064019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726f7e0-3237-4814-b7ea-00618afa8648 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:58.078440 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 936/1883] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:09:58.082508 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726f7e0-3237-4814-b7ea-00618afa8648 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:58.096287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 948/1884] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:57 2022] POST /identity/v3/users => generated 294 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:58.099652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726f7e0-3237-4814-b7ea-00618afa8648 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:58.102222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47985ded-aaeb-4a7a-9a6f-ca7edd37f25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:58.102950 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47985ded-aaeb-4a7a-9a6f-ca7edd37f25c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:58.103276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47985ded-aaeb-4a7a-9a6f-ca7edd37f25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:58.103649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47985ded-aaeb-4a7a-9a6f-ca7edd37f25c admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:58.103851 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25ee05-8aa2-47e8-a6b4-ee2d0a2697e2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:58.104360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47985ded-aaeb-4a7a-9a6f-ca7edd37f25c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:58.106299 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47985ded-aaeb-4a7a-9a6f-ca7edd37f25c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:58.119611 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25ee05-8aa2-47e8-a6b4-ee2d0a2697e2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:58.125369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20fc31-3a43-4d86-9b8f-6aa9d141cdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:58.126568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20fc31-3a43-4d86-9b8f-6aa9d141cdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:58.126568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20fc31-3a43-4d86-9b8f-6aa9d141cdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:58.126815 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20fc31-3a43-4d86-9b8f-6aa9d141cdb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:58.127752 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20fc31-3a43-4d86-9b8f-6aa9d141cdb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:58.129370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20fc31-3a43-4d86-9b8f-6aa9d141cdb1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:58.145335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 949/1885] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:58.146514 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20fc31-3a43-4d86-9b8f-6aa9d141cdb1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:58.164159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20fc31-3a43-4d86-9b8f-6aa9d141cdb1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:58.170669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd7f50-76e8-4956-9783-b1a4fa4dd40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:58.171446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7f50-76e8-4956-9783-b1a4fa4dd40a admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:58.171652 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7f50-76e8-4956-9783-b1a4fa4dd40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:58.171924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7f50-76e8-4956-9783-b1a4fa4dd40a admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:58.172649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd7f50-76e8-4956-9783-b1a4fa4dd40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:58.174399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd7f50-76e8-4956-9783-b1a4fa4dd40a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:58.191166 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 950/1886] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:58.192172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd7f50-76e8-4956-9783-b1a4fa4dd40a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:58.209181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd7f50-76e8-4956-9783-b1a4fa4dd40a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:58.215195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd48d4e-ebb3-4cd5-ab88-b0479c5822a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:58.216088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd48d4e-ebb3-4cd5-ab88-b0479c5822a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:58.216504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd48d4e-ebb3-4cd5-ab88-b0479c5822a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:58.216643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd48d4e-ebb3-4cd5-ab88-b0479c5822a9 admin admin] PATH_INFO: `/v3/projects/f5bc8c352f5b41508150e4da0df09be4/users/fdae444b42204960b5ef9eb4bc8f0352/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:58.227514 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 937/1887] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:58 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:09:58.231688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47985ded-aaeb-4a7a-9a6f-ca7edd37f25c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:58.257187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd48d4e-ebb3-4cd5-ab88-b0479c5822a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5bc8c352f5b41508150e4da0df09be4, user_id=fdae444b42204960b5ef9eb4bc8f0352, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:58.261935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd48d4e-ebb3-4cd5-ab88-b0479c5822a9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:58.309248 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47985ded-aaeb-4a7a-9a6f-ca7edd37f25c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:58.326845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed77e0-a028-43cd-aec7-2da1ded20a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:58.326845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed77e0-a028-43cd-aec7-2da1ded20a55 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:58.326845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed77e0-a028-43cd-aec7-2da1ded20a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:58.326845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed77e0-a028-43cd-aec7-2da1ded20a55 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:58.327760 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed77e0-a028-43cd-aec7-2da1ded20a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:58.327760 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed77e0-a028-43cd-aec7-2da1ded20a55 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:58.355063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 951/1888] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:58 2022] PUT /identity/v3/projects/f5bc8c352f5b41508150e4da0df09be4/users/fdae444b42204960b5ef9eb4bc8f0352/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:58.358759 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b9317-8534-47e6-b2a6-6d7399ff1e81 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:58.359284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b9317-8534-47e6-b2a6-6d7399ff1e81 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:58.359634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b9317-8534-47e6-b2a6-6d7399ff1e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:58.386736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c67b9317-8534-47e6-b2a6-6d7399ff1e81 None None] MFA Rules not processed for user `fdae444b42204960b5ef9eb4bc8f0352`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:58.388069 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c67b9317-8534-47e6-b2a6-6d7399ff1e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:58.423620 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 938/1889] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:58 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:09:58.426720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed77e0-a028-43cd-aec7-2da1ded20a55 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:58.442948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed77e0-a028-43cd-aec7-2da1ded20a55 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:58.479329 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 952/1890] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:58.480861 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b9317-8534-47e6-b2a6-6d7399ff1e81 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:58.544699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a17c9-7021-48bd-8a10-60433967a59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:58.545449 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a17c9-7021-48bd-8a10-60433967a59b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:58.545784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a17c9-7021-48bd-8a10-60433967a59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:58.546063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a17c9-7021-48bd-8a10-60433967a59b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:58.547524 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a17c9-7021-48bd-8a10-60433967a59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:58.549951 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a17c9-7021-48bd-8a10-60433967a59b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:58.565751 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 939/1891] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:09:58.571465 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a17c9-7021-48bd-8a10-60433967a59b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:58.582301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a17c9-7021-48bd-8a10-60433967a59b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:58.588592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18491c0b-21cb-441b-ba91-122681daf4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:58.589197 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18491c0b-21cb-441b-ba91-122681daf4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:58.589480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18491c0b-21cb-441b-ba91-122681daf4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:58.589586 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b9317-8534-47e6-b2a6-6d7399ff1e81 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:58.590023 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18491c0b-21cb-441b-ba91-122681daf4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:58.591574 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18491c0b-21cb-441b-ba91-122681daf4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:58.594720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18491c0b-21cb-441b-ba91-122681daf4b0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:58.596002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a5dc1-3ec7-46e5-b0bb-ec2d4cb00c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:58.596995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a5dc1-3ec7-46e5-b0bb-ec2d4cb00c92 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:58.597372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a5dc1-3ec7-46e5-b0bb-ec2d4cb00c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:58.598008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a5dc1-3ec7-46e5-b0bb-ec2d4cb00c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:58.598729 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a5dc1-3ec7-46e5-b0bb-ec2d4cb00c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:58.602236 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a5dc1-3ec7-46e5-b0bb-ec2d4cb00c92 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:58.614755 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 940/1892] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:58.616297 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18491c0b-21cb-441b-ba91-122681daf4b0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:58.628517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18491c0b-21cb-441b-ba91-122681daf4b0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:58.635044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c2d56-66a1-4cc4-b977-fc8525875e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:58.636030 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c2d56-66a1-4cc4-b977-fc8525875e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:58.636402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c2d56-66a1-4cc4-b977-fc8525875e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:58.636735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c2d56-66a1-4cc4-b977-fc8525875e64 admin admin] PATH_INFO: `/v3/projects/070a48799da941efbe309c725edc3da3/users/3346e8eaadc74a9abee431561bf1f01b/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:58.656313 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c2d56-66a1-4cc4-b977-fc8525875e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070a48799da941efbe309c725edc3da3, user_id=3346e8eaadc74a9abee431561bf1f01b, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:58.659240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c2d56-66a1-4cc4-b977-fc8525875e64 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:58.711380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 953/1893] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:58 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:58.721653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a5dc1-3ec7-46e5-b0bb-ec2d4cb00c92 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:58.745613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 941/1894] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:58 2022] PUT /identity/v3/projects/070a48799da941efbe309c725edc3da3/users/3346e8eaadc74a9abee431561bf1f01b/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:09:58.768571 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90937c8f-0c7d-4152-9c39-0cabbd2ee32e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:58.768994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90937c8f-0c7d-4152-9c39-0cabbd2ee32e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:58.769489 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90937c8f-0c7d-4152-9c39-0cabbd2ee32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:58.815644 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-90937c8f-0c7d-4152-9c39-0cabbd2ee32e None None] MFA Rules not processed for user `3346e8eaadc74a9abee431561bf1f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:58.817853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-90937c8f-0c7d-4152-9c39-0cabbd2ee32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:58.840459 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a5dc1-3ec7-46e5-b0bb-ec2d4cb00c92 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:58.927772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 942/1895] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:09:58.944029 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560ab73-0ef2-4d35-8de1-608ef49a3520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:58.944878 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560ab73-0ef2-4d35-8de1-608ef49a3520 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:58.945163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560ab73-0ef2-4d35-8de1-608ef49a3520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:58.945609 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560ab73-0ef2-4d35-8de1-608ef49a3520 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:58.946634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560ab73-0ef2-4d35-8de1-608ef49a3520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:58.948703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90937c8f-0c7d-4152-9c39-0cabbd2ee32e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:58.948921 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560ab73-0ef2-4d35-8de1-608ef49a3520 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:58.950225 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-90937c8f-0c7d-4152-9c39-0cabbd2ee32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:59.010331 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90937c8f-0c7d-4152-9c39-0cabbd2ee32e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:59.014068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bcbc8-d6e0-456e-8f7a-3e0820c74209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:59.014723 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bcbc8-d6e0-456e-8f7a-3e0820c74209 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:59.015009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bcbc8-d6e0-456e-8f7a-3e0820c74209 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:59.015317 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bcbc8-d6e0-456e-8f7a-3e0820c74209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:59.024188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bcbc8-d6e0-456e-8f7a-3e0820c74209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:59.025617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bcbc8-d6e0-456e-8f7a-3e0820c74209 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:59.034774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 943/1896] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:09:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:09:59.055564 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 954/1897] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:58 2022] POST /identity/v3/users => generated 294 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:09:59.059696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bcbc8-d6e0-456e-8f7a-3e0820c74209 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:59.072009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bcbc8-d6e0-456e-8f7a-3e0820c74209 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:59.077979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8739847-bbab-4881-bf90-597d6eb225cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:59.079316 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8739847-bbab-4881-bf90-597d6eb225cf admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:59.079743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8739847-bbab-4881-bf90-597d6eb225cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:59.080031 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8739847-bbab-4881-bf90-597d6eb225cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:59.080982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8739847-bbab-4881-bf90-597d6eb225cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:59.083165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8739847-bbab-4881-bf90-597d6eb225cf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:59.096302 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 944/1898] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:09:59.100065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560ab73-0ef2-4d35-8de1-608ef49a3520 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:59.111277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560ab73-0ef2-4d35-8de1-608ef49a3520 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:59.118235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069524f4-5419-4b76-b749-df66a23a47d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:59.118535 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069524f4-5419-4b76-b749-df66a23a47d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:59.119138 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069524f4-5419-4b76-b749-df66a23a47d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:59.119499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069524f4-5419-4b76-b749-df66a23a47d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:59.120250 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069524f4-5419-4b76-b749-df66a23a47d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:59.122531 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069524f4-5419-4b76-b749-df66a23a47d3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:59.133567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 955/1899] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:09:59.137593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8739847-bbab-4881-bf90-597d6eb225cf admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:59.148766 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8739847-bbab-4881-bf90-597d6eb225cf admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:59.153536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c69059-822c-4954-9765-cb4f56d03477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:59.154411 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c69059-822c-4954-9765-cb4f56d03477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:59.154689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c69059-822c-4954-9765-cb4f56d03477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:59.154962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c69059-822c-4954-9765-cb4f56d03477 admin admin] PATH_INFO: `/v3/projects/790e8b69241648f5a399a1931423619a/users/62ce9b544ede4cfeba1e6268bdc4f5f4/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:59.170531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c69059-822c-4954-9765-cb4f56d03477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790e8b69241648f5a399a1931423619a, user_id=62ce9b544ede4cfeba1e6268bdc4f5f4, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:59.173334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c69059-822c-4954-9765-cb4f56d03477 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:59.284346 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 945/1900] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:59 2022] PUT /identity/v3/projects/790e8b69241648f5a399a1931423619a/users/62ce9b544ede4cfeba1e6268bdc4f5f4/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:09:59.295235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aadbd-c820-48ce-b32b-aeb6971deeac None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:59.295636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aadbd-c820-48ce-b32b-aeb6971deeac None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:59.296083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aadbd-c820-48ce-b32b-aeb6971deeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:59.329240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-158aadbd-c820-48ce-b32b-aeb6971deeac None None] MFA Rules not processed for user `62ce9b544ede4cfeba1e6268bdc4f5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:09:59.330649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-158aadbd-c820-48ce-b32b-aeb6971deeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:09:59.403257 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 956/1901] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:09:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:09:59.405372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c69059-822c-4954-9765-cb4f56d03477 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:59.473210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c69059-822c-4954-9765-cb4f56d03477 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:59.479726 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44c30c-e715-403d-9f5f-70db342f8078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:59.480538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44c30c-e715-403d-9f5f-70db342f8078 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:59.484266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44c30c-e715-403d-9f5f-70db342f8078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:59.484266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44c30c-e715-403d-9f5f-70db342f8078 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:59.484266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44c30c-e715-403d-9f5f-70db342f8078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:59.484266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44c30c-e715-403d-9f5f-70db342f8078 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:59.590891 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 946/1902] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:09:59 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:09:59.595144 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aadbd-c820-48ce-b32b-aeb6971deeac None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:59.606429 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aadbd-c820-48ce-b32b-aeb6971deeac None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:59.680697 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d7850-26a1-4092-858d-c5318596405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:59.680930 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d7850-26a1-4092-858d-c5318596405e admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:59.681225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d7850-26a1-4092-858d-c5318596405e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:59.681595 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d7850-26a1-4092-858d-c5318596405e admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:59.683613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d7850-26a1-4092-858d-c5318596405e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:59.684998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d7850-26a1-4092-858d-c5318596405e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:59.791152 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 957/1903] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:09:59 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:09:59.791573 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44c30c-e715-403d-9f5f-70db342f8078 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:59.802882 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44c30c-e715-403d-9f5f-70db342f8078 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:59.808236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828234ae-6147-422b-a7e8-5beec3ecb4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:59.809322 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828234ae-6147-422b-a7e8-5beec3ecb4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:59.811285 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828234ae-6147-422b-a7e8-5beec3ecb4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:59.811285 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828234ae-6147-422b-a7e8-5beec3ecb4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:59.811285 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828234ae-6147-422b-a7e8-5beec3ecb4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:59.812584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828234ae-6147-422b-a7e8-5beec3ecb4f3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:59.827138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 947/1904] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:09:59.829326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d7850-26a1-4092-858d-c5318596405e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:09:59.840619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d7850-26a1-4092-858d-c5318596405e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:09:59.845472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e001d2-319c-4cf5-9649-76d61fc2b5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:09:59.846459 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e001d2-319c-4cf5-9649-76d61fc2b5b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:09:59.846808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e001d2-319c-4cf5-9649-76d61fc2b5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:09:59.847845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e001d2-319c-4cf5-9649-76d61fc2b5b1 admin admin] PATH_INFO: `/v3/projects/9f03308bead14abc939759d6879031b1/users/896c023c3aa04b74a877942268ceaf86/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:09:59.874650 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e001d2-319c-4cf5-9649-76d61fc2b5b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f03308bead14abc939759d6879031b1, user_id=896c023c3aa04b74a877942268ceaf86, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:09:59.877980 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e001d2-319c-4cf5-9649-76d61fc2b5b1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:09:59.999749 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 958/1905] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:09:59 2022] PUT /identity/v3/projects/9f03308bead14abc939759d6879031b1/users/896c023c3aa04b74a877942268ceaf86/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:00.003500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828234ae-6147-422b-a7e8-5beec3ecb4f3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:00.018744 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828234ae-6147-422b-a7e8-5beec3ecb4f3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:00.104722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a59863-37a3-4ecb-adb7-33acb2a934f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:00.105613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a59863-37a3-4ecb-adb7-33acb2a934f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:00.106161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a59863-37a3-4ecb-adb7-33acb2a934f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:00.106450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a59863-37a3-4ecb-adb7-33acb2a934f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:00.107282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a59863-37a3-4ecb-adb7-33acb2a934f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:00.109620 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a59863-37a3-4ecb-adb7-33acb2a934f9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:00.130403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 948/1906] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:00.131063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e001d2-319c-4cf5-9649-76d61fc2b5b1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:00.157150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e001d2-319c-4cf5-9649-76d61fc2b5b1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:00.162028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8590bf-1006-4c74-aafb-727a7ab2ebc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:00.163051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8590bf-1006-4c74-aafb-727a7ab2ebc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:00.163709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8590bf-1006-4c74-aafb-727a7ab2ebc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:00.164417 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8590bf-1006-4c74-aafb-727a7ab2ebc1 admin admin] PATH_INFO: `/v3/projects/9f03308bead14abc939759d6879031b1/users/896c023c3aa04b74a877942268ceaf86/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:00.166505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8590bf-1006-4c74-aafb-727a7ab2ebc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f03308bead14abc939759d6879031b1, user_id=896c023c3aa04b74a877942268ceaf86, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:00.169308 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8590bf-1006-4c74-aafb-727a7ab2ebc1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:00.182415 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 959/1907] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:00 2022] PUT /identity/v3/projects/9f03308bead14abc939759d6879031b1/users/896c023c3aa04b74a877942268ceaf86/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:00.192929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd08810-0703-4e19-b310-af36c5c072d3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:00.193348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd08810-0703-4e19-b310-af36c5c072d3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:00.193700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd08810-0703-4e19-b310-af36c5c072d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:00.222306 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7bd08810-0703-4e19-b310-af36c5c072d3 None None] MFA Rules not processed for user `896c023c3aa04b74a877942268ceaf86`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:00.223873 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7bd08810-0703-4e19-b310-af36c5c072d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:00.294099 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 949/1908] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:00.305044 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8590bf-1006-4c74-aafb-727a7ab2ebc1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:00.306884 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ee8590bf-1006-4c74-aafb-727a7ab2ebc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:00.374719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8590bf-1006-4c74-aafb-727a7ab2ebc1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:00.379499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a30b5-5dd1-4da2-8e69-ec2d9a363b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:00.380215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a30b5-5dd1-4da2-8e69-ec2d9a363b9c service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:00.381479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a30b5-5dd1-4da2-8e69-ec2d9a363b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:00.381613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a30b5-5dd1-4da2-8e69-ec2d9a363b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:00.392848 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a30b5-5dd1-4da2-8e69-ec2d9a363b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:00.394273 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a30b5-5dd1-4da2-8e69-ec2d9a363b9c service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:00.404494 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 960/1909] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:01.995197 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd08810-0703-4e19-b310-af36c5c072d3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:02.007977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd08810-0703-4e19-b310-af36c5c072d3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:02.012469 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd02ea-efe4-4448-a4a6-56a37d0d40a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:02.013183 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd02ea-efe4-4448-a4a6-56a37d0d40a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:02.013462 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd02ea-efe4-4448-a4a6-56a37d0d40a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:02.014044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd02ea-efe4-4448-a4a6-56a37d0d40a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:02.090490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd02ea-efe4-4448-a4a6-56a37d0d40a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:02.092045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd02ea-efe4-4448-a4a6-56a37d0d40a7 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:02.106021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 950/1910] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:04.246574 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a30b5-5dd1-4da2-8e69-ec2d9a363b9c service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:04.248154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7a8a30b5-5dd1-4da2-8e69-ec2d9a363b9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:04.314326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a30b5-5dd1-4da2-8e69-ec2d9a363b9c service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:04.318675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defcea7-236e-4793-be79-51bdd70b73e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:04.319689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defcea7-236e-4793-be79-51bdd70b73e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:04.319970 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defcea7-236e-4793-be79-51bdd70b73e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:04.320247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defcea7-236e-4793-be79-51bdd70b73e7 admin admin] PATH_INFO: `/v3/users/dfb224e635d248e5bc3aad117f59ebb1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:04.321431 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defcea7-236e-4793-be79-51bdd70b73e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb224e635d248e5bc3aad117f59ebb1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:04.323368 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defcea7-236e-4793-be79-51bdd70b73e7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:04.490094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd02ea-efe4-4448-a4a6-56a37d0d40a7 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:04.507679 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd02ea-efe4-4448-a4a6-56a37d0d40a7 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:04.514458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fc919-656d-4c1c-9812-b2444efb7070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:04.514867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0defcea7-236e-4793-be79-51bdd70b73e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb224e635d248e5bc3aad117f59ebb1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:04.515591 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fc919-656d-4c1c-9812-b2444efb7070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:04.515910 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fc919-656d-4c1c-9812-b2444efb7070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:04.516157 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fc919-656d-4c1c-9812-b2444efb7070 admin admin] PATH_INFO: `/v3/users/3346e8eaadc74a9abee431561bf1f01b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:04.517498 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fc919-656d-4c1c-9812-b2444efb7070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3346e8eaadc74a9abee431561bf1f01b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:04.519649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fc919-656d-4c1c-9812-b2444efb7070 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:04.533522 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0defcea7-236e-4793-be79-51bdd70b73e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb224e635d248e5bc3aad117f59ebb1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:04.634200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0defcea7-236e-4793-be79-51bdd70b73e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb224e635d248e5bc3aad117f59ebb1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:04.634830 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0defcea7-236e-4793-be79-51bdd70b73e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb224e635d248e5bc3aad117f59ebb1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:04.635489 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0defcea7-236e-4793-be79-51bdd70b73e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb224e635d248e5bc3aad117f59ebb1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:04.648999 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 961/1911] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:04 2022] DELETE /identity/v3/users/dfb224e635d248e5bc3aad117f59ebb1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:04.653345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6945f-fc2a-4633-9dd7-df07c4226658 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:04.653641 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6945f-fc2a-4633-9dd7-df07c4226658 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:04.653918 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6945f-fc2a-4633-9dd7-df07c4226658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:04.672617 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-77c6945f-fc2a-4633-9dd7-df07c4226658 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:04.673904 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-77c6945f-fc2a-4633-9dd7-df07c4226658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:04.726157 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c1fc919-656d-4c1c-9812-b2444efb7070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3346e8eaadc74a9abee431561bf1f01b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:04.736062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 962/1912] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:04.740062 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c1fc919-656d-4c1c-9812-b2444efb7070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3346e8eaadc74a9abee431561bf1f01b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:04.740475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c1fc919-656d-4c1c-9812-b2444efb7070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3346e8eaadc74a9abee431561bf1f01b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:04.746499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6945f-fc2a-4633-9dd7-df07c4226658 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:04.748142 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-77c6945f-fc2a-4633-9dd7-df07c4226658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:04.809391 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6945f-fc2a-4633-9dd7-df07c4226658 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:04.814167 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11489c3-90fa-464e-8c04-aa48e49494c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:04.814848 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11489c3-90fa-464e-8c04-aa48e49494c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:04.815168 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11489c3-90fa-464e-8c04-aa48e49494c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:04.815426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11489c3-90fa-464e-8c04-aa48e49494c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:04.821266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c1fc919-656d-4c1c-9812-b2444efb7070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3346e8eaadc74a9abee431561bf1f01b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:04.821266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7c1fc919-656d-4c1c-9812-b2444efb7070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3346e8eaadc74a9abee431561bf1f01b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:04.821534 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c11489c3-90fa-464e-8c04-aa48e49494c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:04.834213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11489c3-90fa-464e-8c04-aa48e49494c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:04.834416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 951/1913] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:04 2022] DELETE /identity/v3/users/3346e8eaadc74a9abee431561bf1f01b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:04.835864 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11489c3-90fa-464e-8c04-aa48e49494c5 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:04.838733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e99956-a74a-45d3-bc5d-f98b7761db7d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:04.839165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e99956-a74a-45d3-bc5d-f98b7761db7d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:04.839521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e99956-a74a-45d3-bc5d-f98b7761db7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:04.846053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 963/1914] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:10:04.857209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d3e99956-a74a-45d3-bc5d-f98b7761db7d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:04.858420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d3e99956-a74a-45d3-bc5d-f98b7761db7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:04.928421 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 952/1915] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:04.943594 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11489c3-90fa-464e-8c04-aa48e49494c5 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:04.951371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c11489c3-90fa-464e-8c04-aa48e49494c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:04.967079 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11489c3-90fa-464e-8c04-aa48e49494c5 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:05.024483 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c32fe6-be40-45a7-b5e3-a746d7e1d38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:05.025153 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c32fe6-be40-45a7-b5e3-a746d7e1d38e service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:05.025524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c32fe6-be40-45a7-b5e3-a746d7e1d38e service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:05.025798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c32fe6-be40-45a7-b5e3-a746d7e1d38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:05.036049 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c32fe6-be40-45a7-b5e3-a746d7e1d38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:05.037554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c32fe6-be40-45a7-b5e3-a746d7e1d38e service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:05.048038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 964/1916] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:05.630805 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e99956-a74a-45d3-bc5d-f98b7761db7d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:05.634439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d3e99956-a74a-45d3-bc5d-f98b7761db7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:05.647717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e99956-a74a-45d3-bc5d-f98b7761db7d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:05.654461 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55176680-f51c-4de5-812e-0bf27c222757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:05.656021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55176680-f51c-4de5-812e-0bf27c222757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:05.656515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55176680-f51c-4de5-812e-0bf27c222757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:05.656978 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55176680-f51c-4de5-812e-0bf27c222757 admin admin] PATH_INFO: `/v3/projects/9cf00d60a8a14803bad841273acfce15` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:05.659365 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55176680-f51c-4de5-812e-0bf27c222757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf00d60a8a14803bad841273acfce15)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:05.665165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55176680-f51c-4de5-812e-0bf27c222757 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:05.811986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-55176680-f51c-4de5-812e-0bf27c222757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf00d60a8a14803bad841273acfce15', 'request_id': 'req-55176680-f51c-4de5-812e-0bf27c222757'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:05.843257 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c32fe6-be40-45a7-b5e3-a746d7e1d38e service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:05.844949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-43c32fe6-be40-45a7-b5e3-a746d7e1d38e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:05.858572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c32fe6-be40-45a7-b5e3-a746d7e1d38e service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:05.885497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-55176680-f51c-4de5-812e-0bf27c222757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf00d60a8a14803bad841273acfce15', 'request_id': 'req-55176680-f51c-4de5-812e-0bf27c222757'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:05.892188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-55176680-f51c-4de5-812e-0bf27c222757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf00d60a8a14803bad841273acfce15', 'request_id': 'req-55176680-f51c-4de5-812e-0bf27c222757'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:05.905618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-55176680-f51c-4de5-812e-0bf27c222757 admin admin] The token cache is being invalidate because project 9cf00d60a8a14803bad841273acfce15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:05.905927 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-55176680-f51c-4de5-812e-0bf27c222757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:05.906599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-55176680-f51c-4de5-812e-0bf27c222757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:05.908245 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 953/1917] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:05 2022] DELETE /identity/v3/projects/9cf00d60a8a14803bad841273acfce15 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:05.912019 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55176680-f51c-4de5-812e-0bf27c222757 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:05.915073 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-55176680-f51c-4de5-812e-0bf27c222757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:05.956460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0bcaf-a0a7-409e-b5b4-550502af71c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:05.957345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0bcaf-a0a7-409e-b5b4-550502af71c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:05.957646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0bcaf-a0a7-409e-b5b4-550502af71c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:05.958029 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0bcaf-a0a7-409e-b5b4-550502af71c6 admin admin] PATH_INFO: `/v3/projects/070a48799da941efbe309c725edc3da3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:05.960616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0bcaf-a0a7-409e-b5b4-550502af71c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070a48799da941efbe309c725edc3da3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:05.966340 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0bcaf-a0a7-409e-b5b4-550502af71c6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:06.059090 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55176680-f51c-4de5-812e-0bf27c222757 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:06.066048 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746178e-ad14-405f-ab9e-6f9832aff897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:06.067046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746178e-ad14-405f-ab9e-6f9832aff897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:06.068376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746178e-ad14-405f-ab9e-6f9832aff897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:06.068580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746178e-ad14-405f-ab9e-6f9832aff897 admin admin] PATH_INFO: `/v3/users/5b1d3e73d70b41e5b5b83d48878bd63f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:06.070737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746178e-ad14-405f-ab9e-6f9832aff897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1d3e73d70b41e5b5b83d48878bd63f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:06.073797 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746178e-ad14-405f-ab9e-6f9832aff897 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:06.133038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cfe0bcaf-a0a7-409e-b5b4-550502af71c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070a48799da941efbe309c725edc3da3', 'request_id': 'req-cfe0bcaf-a0a7-409e-b5b4-550502af71c6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:06.139615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cfe0bcaf-a0a7-409e-b5b4-550502af71c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070a48799da941efbe309c725edc3da3', 'request_id': 'req-cfe0bcaf-a0a7-409e-b5b4-550502af71c6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:06.145844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cfe0bcaf-a0a7-409e-b5b4-550502af71c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070a48799da941efbe309c725edc3da3', 'request_id': 'req-cfe0bcaf-a0a7-409e-b5b4-550502af71c6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:06.214013 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cfe0bcaf-a0a7-409e-b5b4-550502af71c6 admin admin] The token cache is being invalidate because project 070a48799da941efbe309c725edc3da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:06.214494 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cfe0bcaf-a0a7-409e-b5b4-550502af71c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:06.215291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cfe0bcaf-a0a7-409e-b5b4-550502af71c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:06.217253 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 965/1918] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:05 2022] DELETE /identity/v3/projects/070a48799da941efbe309c725edc3da3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:06.221872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aab08-dd5c-4bc7-846d-9c4e6d7cfe00 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:06.222122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aab08-dd5c-4bc7-846d-9c4e6d7cfe00 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:06.222368 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547aab08-dd5c-4bc7-846d-9c4e6d7cfe00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:06.241409 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-547aab08-dd5c-4bc7-846d-9c4e6d7cfe00 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:06.242713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-547aab08-dd5c-4bc7-846d-9c4e6d7cfe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:06.253992 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9746178e-ad14-405f-ab9e-6f9832aff897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1d3e73d70b41e5b5b83d48878bd63f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:06.269049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9746178e-ad14-405f-ab9e-6f9832aff897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1d3e73d70b41e5b5b83d48878bd63f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:06.269780 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9746178e-ad14-405f-ab9e-6f9832aff897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1d3e73d70b41e5b5b83d48878bd63f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:06.311766 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 966/1919] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:06.321289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560f9e-8783-4af3-ae2e-68f60850ce21 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:06.321660 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560f9e-8783-4af3-ae2e-68f60850ce21 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:06.321945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560f9e-8783-4af3-ae2e-68f60850ce21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:06.340756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a7560f9e-8783-4af3-ae2e-68f60850ce21 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:06.341945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a7560f9e-8783-4af3-ae2e-68f60850ce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:06.349824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 967/1920] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:06.354548 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7560f9e-8783-4af3-ae2e-68f60850ce21 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:06.355216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9746178e-ad14-405f-ab9e-6f9832aff897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1d3e73d70b41e5b5b83d48878bd63f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:06.358944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9746178e-ad14-405f-ab9e-6f9832aff897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1d3e73d70b41e5b5b83d48878bd63f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:06.363807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7560f9e-8783-4af3-ae2e-68f60850ce21 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:06.369606 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4e0f6-59cf-44d4-9fda-85fb8f6c99cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:06.370283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4e0f6-59cf-44d4-9fda-85fb8f6c99cd admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:06.370563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4e0f6-59cf-44d4-9fda-85fb8f6c99cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:06.370888 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4e0f6-59cf-44d4-9fda-85fb8f6c99cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:06.371655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4e0f6-59cf-44d4-9fda-85fb8f6c99cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:10:06.371990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4e0f6-59cf-44d4-9fda-85fb8f6c99cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:06.373630 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4e0f6-59cf-44d4-9fda-85fb8f6c99cd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:06.390096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 968/1922] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:10:06.390529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 954/1922] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:05 2022] DELETE /identity/v3/users/5b1d3e73d70b41e5b5b83d48878bd63f => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:06.391729 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4e0f6-59cf-44d4-9fda-85fb8f6c99cd admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:06.402627 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4e0f6-59cf-44d4-9fda-85fb8f6c99cd admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:06.461826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10bc0b-9b41-4b57-956a-a352dc477c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:06.462499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10bc0b-9b41-4b57-956a-a352dc477c97 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:06.462783 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10bc0b-9b41-4b57-956a-a352dc477c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:06.463058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10bc0b-9b41-4b57-956a-a352dc477c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:06.463778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10bc0b-9b41-4b57-956a-a352dc477c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:06.465671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10bc0b-9b41-4b57-956a-a352dc477c97 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:06.586373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 969/1923] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:06 2022] POST /identity/v3/projects => generated 367 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:06.595906 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746178e-ad14-405f-ab9e-6f9832aff897 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:06.605761 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746178e-ad14-405f-ab9e-6f9832aff897 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:06.660282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78954547-37ce-42a5-90e9-a5ed47966f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:06.660958 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78954547-37ce-42a5-90e9-a5ed47966f10 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:06.661243 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78954547-37ce-42a5-90e9-a5ed47966f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:06.661521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78954547-37ce-42a5-90e9-a5ed47966f10 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:06.662276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78954547-37ce-42a5-90e9-a5ed47966f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:06.664438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78954547-37ce-42a5-90e9-a5ed47966f10 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:06.765092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 955/1924] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:06 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:06.778413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10bc0b-9b41-4b57-956a-a352dc477c97 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:06.789072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10bc0b-9b41-4b57-956a-a352dc477c97 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:06.794220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af76548-6d72-4296-8fa2-f1efce7946f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:06.795096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af76548-6d72-4296-8fa2-f1efce7946f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:06.795483 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af76548-6d72-4296-8fa2-f1efce7946f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:06.795941 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af76548-6d72-4296-8fa2-f1efce7946f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:06.796740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af76548-6d72-4296-8fa2-f1efce7946f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:06.798415 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af76548-6d72-4296-8fa2-f1efce7946f3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:06.815347 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 970/1925] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:06.816495 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78954547-37ce-42a5-90e9-a5ed47966f10 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:06.829098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78954547-37ce-42a5-90e9-a5ed47966f10 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:06.835222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1f5af-53bc-4259-8a3a-af428cf72c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:06.835977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1f5af-53bc-4259-8a3a-af428cf72c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:06.838697 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1f5af-53bc-4259-8a3a-af428cf72c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:06.838697 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1f5af-53bc-4259-8a3a-af428cf72c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:06.838697 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1f5af-53bc-4259-8a3a-af428cf72c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:06.839335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1f5af-53bc-4259-8a3a-af428cf72c4e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:06.849897 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 956/1926] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:10:06.855030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af76548-6d72-4296-8fa2-f1efce7946f3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:06.866603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af76548-6d72-4296-8fa2-f1efce7946f3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:06.872600 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da2d0b-0ab1-49fd-a1f9-8cc7f536ce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:06.873767 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da2d0b-0ab1-49fd-a1f9-8cc7f536ce2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:06.874427 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da2d0b-0ab1-49fd-a1f9-8cc7f536ce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:06.874577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da2d0b-0ab1-49fd-a1f9-8cc7f536ce2f admin admin] PATH_INFO: `/v3/projects/f3e17c0513714e4b8fd503c36267948c/users/1e74272ca9e94645a0740d904b1cba18/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:06.903513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da2d0b-0ab1-49fd-a1f9-8cc7f536ce2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e17c0513714e4b8fd503c36267948c, user_id=1e74272ca9e94645a0740d904b1cba18, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:06.906531 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da2d0b-0ab1-49fd-a1f9-8cc7f536ce2f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:07.014307 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 971/1927] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:06 2022] PUT /identity/v3/projects/f3e17c0513714e4b8fd503c36267948c/users/1e74272ca9e94645a0740d904b1cba18/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:07.025195 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731f3dc-27aa-4a95-a31c-dea0cdd06166 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:07.025490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731f3dc-27aa-4a95-a31c-dea0cdd06166 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:07.025771 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731f3dc-27aa-4a95-a31c-dea0cdd06166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:07.056320 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da2d0b-0ab1-49fd-a1f9-8cc7f536ce2f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:07.056876 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7731f3dc-27aa-4a95-a31c-dea0cdd06166 None None] MFA Rules not processed for user `1e74272ca9e94645a0740d904b1cba18`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:07.059195 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7731f3dc-27aa-4a95-a31c-dea0cdd06166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:07.059335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f8da2d0b-0ab1-49fd-a1f9-8cc7f536ce2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:07.144314 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da2d0b-0ab1-49fd-a1f9-8cc7f536ce2f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:07.144789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 957/1928] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:07.147211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336354af-b9c8-429f-b629-aa3d67ac9075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:07.148165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336354af-b9c8-429f-b629-aa3d67ac9075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:07.148441 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336354af-b9c8-429f-b629-aa3d67ac9075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:07.148774 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336354af-b9c8-429f-b629-aa3d67ac9075 admin admin] PATH_INFO: `/v3/projects/799eef0511de4ee6b496e79f2aff4d4a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:07.149976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336354af-b9c8-429f-b629-aa3d67ac9075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=799eef0511de4ee6b496e79f2aff4d4a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:07.151937 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336354af-b9c8-429f-b629-aa3d67ac9075 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:07.152832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731f3dc-27aa-4a95-a31c-dea0cdd06166 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:07.154416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7731f3dc-27aa-4a95-a31c-dea0cdd06166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:07.212832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731f3dc-27aa-4a95-a31c-dea0cdd06166 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:07.216640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284caee-ee42-46ed-980b-492a835ddaa3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68748827b9f14eb7958d5b202c5d6877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:07.217397 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284caee-ee42-46ed-980b-492a835ddaa3 service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:07.217809 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284caee-ee42-46ed-980b-492a835ddaa3 service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:07.218128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284caee-ee42-46ed-980b-492a835ddaa3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:07.227237 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284caee-ee42-46ed-980b-492a835ddaa3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:07.228687 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284caee-ee42-46ed-980b-492a835ddaa3 service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:07.237757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 958/1929] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:07.263600 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-336354af-b9c8-429f-b629-aa3d67ac9075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799eef0511de4ee6b496e79f2aff4d4a', 'request_id': 'req-336354af-b9c8-429f-b629-aa3d67ac9075'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:07.269788 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-336354af-b9c8-429f-b629-aa3d67ac9075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799eef0511de4ee6b496e79f2aff4d4a', 'request_id': 'req-336354af-b9c8-429f-b629-aa3d67ac9075'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:07.275758 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-336354af-b9c8-429f-b629-aa3d67ac9075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799eef0511de4ee6b496e79f2aff4d4a', 'request_id': 'req-336354af-b9c8-429f-b629-aa3d67ac9075'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:07.361542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-336354af-b9c8-429f-b629-aa3d67ac9075 admin admin] The token cache is being invalidate because project 799eef0511de4ee6b496e79f2aff4d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:07.362031 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-336354af-b9c8-429f-b629-aa3d67ac9075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:07.362733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-336354af-b9c8-429f-b629-aa3d67ac9075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:07.364458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 972/1930] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:07 2022] DELETE /identity/v3/projects/799eef0511de4ee6b496e79f2aff4d4a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:07.369083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284caee-ee42-46ed-980b-492a835ddaa3 service glance] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:07.380571 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284caee-ee42-46ed-980b-492a835ddaa3 service glance] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:07.439363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128c98e-6d94-405d-8e33-6332ae8e8d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:07.440238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128c98e-6d94-405d-8e33-6332ae8e8d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:07.440515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128c98e-6d94-405d-8e33-6332ae8e8d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:07.440838 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128c98e-6d94-405d-8e33-6332ae8e8d76 admin admin] PATH_INFO: `/v3/users/a4c36625171548d3a555cc1b518ac86a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:07.442060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128c98e-6d94-405d-8e33-6332ae8e8d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4c36625171548d3a555cc1b518ac86a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:07.444238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128c98e-6d94-405d-8e33-6332ae8e8d76 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:07.445041 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336354af-b9c8-429f-b629-aa3d67ac9075 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:07.446365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-336354af-b9c8-429f-b629-aa3d67ac9075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:07.507054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336354af-b9c8-429f-b629-aa3d67ac9075 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:07.511032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fd964-cef9-4046-af4c-c2402da9001d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:07.511762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fd964-cef9-4046-af4c-c2402da9001d service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:07.512365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fd964-cef9-4046-af4c-c2402da9001d service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:07.512365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fd964-cef9-4046-af4c-c2402da9001d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:07.514142 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-856fd964-cef9-4046-af4c-c2402da9001d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:07.577800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fd964-cef9-4046-af4c-c2402da9001d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:07.581483 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fd964-cef9-4046-af4c-c2402da9001d service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:07.589952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 973/1931] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:10:07.679819 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4128c98e-6d94-405d-8e33-6332ae8e8d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4c36625171548d3a555cc1b518ac86a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:07.697062 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4128c98e-6d94-405d-8e33-6332ae8e8d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4c36625171548d3a555cc1b518ac86a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:07.700098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4128c98e-6d94-405d-8e33-6332ae8e8d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4c36625171548d3a555cc1b518ac86a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:07.785082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4128c98e-6d94-405d-8e33-6332ae8e8d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4c36625171548d3a555cc1b518ac86a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:07.785715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4128c98e-6d94-405d-8e33-6332ae8e8d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4c36625171548d3a555cc1b518ac86a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:07.802827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 959/1932] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:07 2022] DELETE /identity/v3/users/a4c36625171548d3a555cc1b518ac86a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:08.328349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fd964-cef9-4046-af4c-c2402da9001d service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:08.328349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-856fd964-cef9-4046-af4c-c2402da9001d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:08.360536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fd964-cef9-4046-af4c-c2402da9001d service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:08.422944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c3283-2139-4328-b8cd-e5401e29fc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:08.424205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c3283-2139-4328-b8cd-e5401e29fc64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:08.424557 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c3283-2139-4328-b8cd-e5401e29fc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:08.424896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c3283-2139-4328-b8cd-e5401e29fc64 admin admin] PATH_INFO: `/v3/projects/b46672b97a5a416e81fb84e8f81b431c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:08.426163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c3283-2139-4328-b8cd-e5401e29fc64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46672b97a5a416e81fb84e8f81b431c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:08.429132 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c3283-2139-4328-b8cd-e5401e29fc64 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:08.565507 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f40c3283-2139-4328-b8cd-e5401e29fc64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46672b97a5a416e81fb84e8f81b431c', 'request_id': 'req-f40c3283-2139-4328-b8cd-e5401e29fc64'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:08.572581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f40c3283-2139-4328-b8cd-e5401e29fc64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46672b97a5a416e81fb84e8f81b431c', 'request_id': 'req-f40c3283-2139-4328-b8cd-e5401e29fc64'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:08.577780 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f40c3283-2139-4328-b8cd-e5401e29fc64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46672b97a5a416e81fb84e8f81b431c', 'request_id': 'req-f40c3283-2139-4328-b8cd-e5401e29fc64'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:08.672373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f40c3283-2139-4328-b8cd-e5401e29fc64 admin admin] The token cache is being invalidate because project b46672b97a5a416e81fb84e8f81b431c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:08.672664 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f40c3283-2139-4328-b8cd-e5401e29fc64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:08.673304 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f40c3283-2139-4328-b8cd-e5401e29fc64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:08.675863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 974/1933] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:08 2022] DELETE /identity/v3/projects/b46672b97a5a416e81fb84e8f81b431c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:08.682152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8df70-bfb5-4f0a-944b-12b5ad62ffa5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:08.682514 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8df70-bfb5-4f0a-944b-12b5ad62ffa5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:08.682645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8df70-bfb5-4f0a-944b-12b5ad62ffa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:08.702913 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bbc8df70-bfb5-4f0a-944b-12b5ad62ffa5 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:08.704379 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bbc8df70-bfb5-4f0a-944b-12b5ad62ffa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:08.774213 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 960/1934] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:08.777223 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfdeb0-93e9-4a9a-8eee-19e894e1160f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:08.777585 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfdeb0-93e9-4a9a-8eee-19e894e1160f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:08.777888 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfdeb0-93e9-4a9a-8eee-19e894e1160f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:08.799720 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6ebfdeb0-93e9-4a9a-8eee-19e894e1160f None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:08.801731 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6ebfdeb0-93e9-4a9a-8eee-19e894e1160f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:08.809824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 975/1935] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:08.814258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8df70-bfb5-4f0a-944b-12b5ad62ffa5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:08.839987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8df70-bfb5-4f0a-944b-12b5ad62ffa5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:08.848832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492db3f7-59ca-4b08-bdf7-3c92fa91ded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:08.849682 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492db3f7-59ca-4b08-bdf7-3c92fa91ded5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:08.850083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492db3f7-59ca-4b08-bdf7-3c92fa91ded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:08.850445 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492db3f7-59ca-4b08-bdf7-3c92fa91ded5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:08.851511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492db3f7-59ca-4b08-bdf7-3c92fa91ded5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:10:08.851912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492db3f7-59ca-4b08-bdf7-3c92fa91ded5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:08.853517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492db3f7-59ca-4b08-bdf7-3c92fa91ded5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:08.870665 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 961/1936] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:10:08.874684 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfdeb0-93e9-4a9a-8eee-19e894e1160f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:08.883713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfdeb0-93e9-4a9a-8eee-19e894e1160f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:08.888920 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c3109-7afa-4f39-8464-c28e9d6869f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:08.889582 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c3109-7afa-4f39-8464-c28e9d6869f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:08.889861 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c3109-7afa-4f39-8464-c28e9d6869f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:08.890141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c3109-7afa-4f39-8464-c28e9d6869f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:08.890874 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c3109-7afa-4f39-8464-c28e9d6869f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:08.893270 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c3109-7afa-4f39-8464-c28e9d6869f0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:09.056973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 976/1937] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:08 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:10:09.061221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492db3f7-59ca-4b08-bdf7-3c92fa91ded5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:09.072173 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492db3f7-59ca-4b08-bdf7-3c92fa91ded5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:09.135899 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68711617-47be-4c03-b359-efa459cf49ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:09.136522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68711617-47be-4c03-b359-efa459cf49ed admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:09.136775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68711617-47be-4c03-b359-efa459cf49ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:09.137050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68711617-47be-4c03-b359-efa459cf49ed admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:09.137814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68711617-47be-4c03-b359-efa459cf49ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:09.139792 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68711617-47be-4c03-b359-efa459cf49ed admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:09.277796 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 962/1938] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:09 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:09.281886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c3109-7afa-4f39-8464-c28e9d6869f0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:09.293905 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c3109-7afa-4f39-8464-c28e9d6869f0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:09.299055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aca1d-6ec7-45f5-b611-206062e39ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:09.299769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aca1d-6ec7-45f5-b611-206062e39ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:09.300052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aca1d-6ec7-45f5-b611-206062e39ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:09.300331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aca1d-6ec7-45f5-b611-206062e39ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:09.301274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411aca1d-6ec7-45f5-b611-206062e39ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:09.303615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411aca1d-6ec7-45f5-b611-206062e39ddc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:09.322002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 977/1939] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:09.323955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68711617-47be-4c03-b359-efa459cf49ed admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:09.334996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68711617-47be-4c03-b359-efa459cf49ed admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:09.340349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e64ed5-6cd1-4967-9eb9-85d833792532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:09.341090 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e64ed5-6cd1-4967-9eb9-85d833792532 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:09.341384 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e64ed5-6cd1-4967-9eb9-85d833792532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:09.341661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e64ed5-6cd1-4967-9eb9-85d833792532 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:09.342500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e64ed5-6cd1-4967-9eb9-85d833792532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:09.344368 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e64ed5-6cd1-4967-9eb9-85d833792532 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:09.359300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 963/1940] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:09.363558 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aca1d-6ec7-45f5-b611-206062e39ddc admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:09.375061 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aca1d-6ec7-45f5-b611-206062e39ddc admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:09.379621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd8fe1-8107-41a2-8d11-2468de2abf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:09.380489 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd8fe1-8107-41a2-8d11-2468de2abf44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:09.380764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd8fe1-8107-41a2-8d11-2468de2abf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:09.381549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd8fe1-8107-41a2-8d11-2468de2abf44 admin admin] PATH_INFO: `/v3/projects/53795e38f3b84b859ad65f6203156d20/users/0fc61ff90d7041968220543a037ddf3a/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:09.399095 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd8fe1-8107-41a2-8d11-2468de2abf44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53795e38f3b84b859ad65f6203156d20, user_id=0fc61ff90d7041968220543a037ddf3a, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:09.400543 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd8fe1-8107-41a2-8d11-2468de2abf44 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:09.514945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 978/1941] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:09 2022] PUT /identity/v3/projects/53795e38f3b84b859ad65f6203156d20/users/0fc61ff90d7041968220543a037ddf3a/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:09.529252 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c7bb2-8baf-4466-b6dd-f53bb6ab7457 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:09.529252 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c7bb2-8baf-4466-b6dd-f53bb6ab7457 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:09.529252 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c7bb2-8baf-4466-b6dd-f53bb6ab7457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:09.558690 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9d4c7bb2-8baf-4466-b6dd-f53bb6ab7457 None None] MFA Rules not processed for user `0fc61ff90d7041968220543a037ddf3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:09.560274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9d4c7bb2-8baf-4466-b6dd-f53bb6ab7457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:09.638137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 964/1942] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:09.649624 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd8fe1-8107-41a2-8d11-2468de2abf44 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:09.651274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5dbd8fe1-8107-41a2-8d11-2468de2abf44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:09.710545 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd8fe1-8107-41a2-8d11-2468de2abf44 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:09.714691 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8820481-ac66-47a3-8a22-9dce9f7f0ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:09.715577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8820481-ac66-47a3-8a22-9dce9f7f0ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:09.715856 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8820481-ac66-47a3-8a22-9dce9f7f0ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:09.716128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8820481-ac66-47a3-8a22-9dce9f7f0ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:09.726147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8820481-ac66-47a3-8a22-9dce9f7f0ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:09.727638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8820481-ac66-47a3-8a22-9dce9f7f0ec0 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:09.737222 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 979/1943] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:10.665955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c7bb2-8baf-4466-b6dd-f53bb6ab7457 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:10.667650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9d4c7bb2-8baf-4466-b6dd-f53bb6ab7457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:10.736150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c7bb2-8baf-4466-b6dd-f53bb6ab7457 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:10.741238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d4638-37a0-449b-bcdb-b851962ad58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:10.742309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d4638-37a0-449b-bcdb-b851962ad58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:10.742625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d4638-37a0-449b-bcdb-b851962ad58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:10.742916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d4638-37a0-449b-bcdb-b851962ad58a admin admin] PATH_INFO: `/v3/users/35ef7a36ac424aa995c44c9eb90bd1d6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:10.744172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d4638-37a0-449b-bcdb-b851962ad58a admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ef7a36ac424aa995c44c9eb90bd1d6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:10.746109 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d4638-37a0-449b-bcdb-b851962ad58a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:10.970067 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-829d4638-37a0-449b-bcdb-b851962ad58a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ef7a36ac424aa995c44c9eb90bd1d6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:10.982140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-829d4638-37a0-449b-bcdb-b851962ad58a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ef7a36ac424aa995c44c9eb90bd1d6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:10.982926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-829d4638-37a0-449b-bcdb-b851962ad58a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ef7a36ac424aa995c44c9eb90bd1d6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:11.079532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-829d4638-37a0-449b-bcdb-b851962ad58a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ef7a36ac424aa995c44c9eb90bd1d6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:11.080153 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-829d4638-37a0-449b-bcdb-b851962ad58a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ef7a36ac424aa995c44c9eb90bd1d6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:11.093632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 965/1944] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:10 2022] DELETE /identity/v3/users/35ef7a36ac424aa995c44c9eb90bd1d6 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:11.424341 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8820481-ac66-47a3-8a22-9dce9f7f0ec0 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:11.436393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8820481-ac66-47a3-8a22-9dce9f7f0ec0 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:11.495011 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b60b3-9b33-4bdc-a4eb-b8fd4be0d074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:11.495894 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b60b3-9b33-4bdc-a4eb-b8fd4be0d074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:11.496171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b60b3-9b33-4bdc-a4eb-b8fd4be0d074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:11.496446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b60b3-9b33-4bdc-a4eb-b8fd4be0d074 admin admin] PATH_INFO: `/v3/projects/0d2df1e983894585869358afcafd0fb5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:11.497611 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b60b3-9b33-4bdc-a4eb-b8fd4be0d074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d2df1e983894585869358afcafd0fb5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:11.499551 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b60b3-9b33-4bdc-a4eb-b8fd4be0d074 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:11.575246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e0d85-9003-4fd5-91d1-680841252d34 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:11.576184 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e0d85-9003-4fd5-91d1-680841252d34 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:11.576535 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e0d85-9003-4fd5-91d1-680841252d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:11.594276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4b7e0d85-9003-4fd5-91d1-680841252d34 None None] MFA Rules not processed for user `0fc61ff90d7041968220543a037ddf3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:11.595657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4b7e0d85-9003-4fd5-91d1-680841252d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:11.635378 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f00b60b3-9b33-4bdc-a4eb-b8fd4be0d074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2df1e983894585869358afcafd0fb5', 'request_id': 'req-f00b60b3-9b33-4bdc-a4eb-b8fd4be0d074'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:11.641820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f00b60b3-9b33-4bdc-a4eb-b8fd4be0d074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2df1e983894585869358afcafd0fb5', 'request_id': 'req-f00b60b3-9b33-4bdc-a4eb-b8fd4be0d074'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:11.651054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f00b60b3-9b33-4bdc-a4eb-b8fd4be0d074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2df1e983894585869358afcafd0fb5', 'request_id': 'req-f00b60b3-9b33-4bdc-a4eb-b8fd4be0d074'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:11.654857 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 966/1945] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:11.731234 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f00b60b3-9b33-4bdc-a4eb-b8fd4be0d074 admin admin] The token cache is being invalidate because project 0d2df1e983894585869358afcafd0fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:11.731524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f00b60b3-9b33-4bdc-a4eb-b8fd4be0d074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:11.732183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f00b60b3-9b33-4bdc-a4eb-b8fd4be0d074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:11.734817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 980/1946] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:11 2022] DELETE /identity/v3/projects/0d2df1e983894585869358afcafd0fb5 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:11.739833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f2352-4b35-4be3-8700-d545d6be0a92 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:11.740831 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f2352-4b35-4be3-8700-d545d6be0a92 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:11.741451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f2352-4b35-4be3-8700-d545d6be0a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:11.762694 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1a7f2352-4b35-4be3-8700-d545d6be0a92 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:11.764082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1a7f2352-4b35-4be3-8700-d545d6be0a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:11.827772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 967/1947] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:11.836889 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e6d98-4c8b-424b-8dfa-a4ce13c6b177 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:11.837178 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e6d98-4c8b-424b-8dfa-a4ce13c6b177 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:11.837451 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e6d98-4c8b-424b-8dfa-a4ce13c6b177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:11.856903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-868e6d98-4c8b-424b-8dfa-a4ce13c6b177 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:11.858168 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-868e6d98-4c8b-424b-8dfa-a4ce13c6b177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:11.866894 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 981/1948] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:11.871177 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f2352-4b35-4be3-8700-d545d6be0a92 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:11.880633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f2352-4b35-4be3-8700-d545d6be0a92 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:11.886082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572ba21-1663-4b42-b690-88db127c90d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:11.886753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572ba21-1663-4b42-b690-88db127c90d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:11.888754 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572ba21-1663-4b42-b690-88db127c90d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:11.888754 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572ba21-1663-4b42-b690-88db127c90d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:11.888754 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572ba21-1663-4b42-b690-88db127c90d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:10:11.888754 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572ba21-1663-4b42-b690-88db127c90d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:11.889948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572ba21-1663-4b42-b690-88db127c90d7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:11.902430 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 968/1949] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:10:11.909286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e6d98-4c8b-424b-8dfa-a4ce13c6b177 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:11.920154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e6d98-4c8b-424b-8dfa-a4ce13c6b177 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:11.925246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa947adc-0f8a-4036-8114-4af610575d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:11.926891 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa947adc-0f8a-4036-8114-4af610575d33 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:11.927228 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa947adc-0f8a-4036-8114-4af610575d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:11.927514 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa947adc-0f8a-4036-8114-4af610575d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:11.929550 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa947adc-0f8a-4036-8114-4af610575d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:11.931746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa947adc-0f8a-4036-8114-4af610575d33 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:12.095682 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 982/1950] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:11 2022] POST /identity/v3/projects => generated 405 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:12.100526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572ba21-1663-4b42-b690-88db127c90d7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:12.110534 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572ba21-1663-4b42-b690-88db127c90d7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:12.169086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44ab99-3856-4769-9d10-dcf405dc63ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:12.169798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44ab99-3856-4769-9d10-dcf405dc63ef admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:12.170103 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44ab99-3856-4769-9d10-dcf405dc63ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:12.170385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44ab99-3856-4769-9d10-dcf405dc63ef admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:12.171222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44ab99-3856-4769-9d10-dcf405dc63ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:12.177135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44ab99-3856-4769-9d10-dcf405dc63ef admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:12.212861 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa947adc-0f8a-4036-8114-4af610575d33 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:12.214860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fa947adc-0f8a-4036-8114-4af610575d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:12.231600 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa947adc-0f8a-4036-8114-4af610575d33 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:12.236096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1c147-b269-4c8c-9d54-a796b8fe7880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:12.237066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1c147-b269-4c8c-9d54-a796b8fe7880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:12.237415 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1c147-b269-4c8c-9d54-a796b8fe7880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:12.237763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1c147-b269-4c8c-9d54-a796b8fe7880 admin admin] PATH_INFO: `/v3/users/fdae444b42204960b5ef9eb4bc8f0352` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:12.250024 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1c147-b269-4c8c-9d54-a796b8fe7880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdae444b42204960b5ef9eb4bc8f0352)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:12.252070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1c147-b269-4c8c-9d54-a796b8fe7880 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:12.305610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 969/1951] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:12 2022] POST /identity/v3/users => generated 303 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:12.310160 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44ab99-3856-4769-9d10-dcf405dc63ef admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:12.321326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44ab99-3856-4769-9d10-dcf405dc63ef admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:12.332688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5a122-63e2-4277-9d3d-61e4e86d1a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:12.333385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5a122-63e2-4277-9d3d-61e4e86d1a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:12.333672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5a122-63e2-4277-9d3d-61e4e86d1a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:12.334065 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5a122-63e2-4277-9d3d-61e4e86d1a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:12.334928 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5a122-63e2-4277-9d3d-61e4e86d1a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:12.336588 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5a122-63e2-4277-9d3d-61e4e86d1a30 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:12.349427 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 970/1952] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:10:12.361728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5a122-63e2-4277-9d3d-61e4e86d1a30 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:12.365336 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5a122-63e2-4277-9d3d-61e4e86d1a30 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:12.370815 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef7d52-270b-485c-b196-b5224de83456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:12.371526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7d52-270b-485c-b196-b5224de83456 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:12.371814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7d52-270b-485c-b196-b5224de83456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:12.372343 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7d52-270b-485c-b196-b5224de83456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:12.373239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef7d52-270b-485c-b196-b5224de83456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:12.374962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef7d52-270b-485c-b196-b5224de83456 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:12.394713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 971/1953] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:10:12.400104 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef7d52-270b-485c-b196-b5224de83456 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:12.410081 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef7d52-270b-485c-b196-b5224de83456 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:12.417376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd963f-8c5c-40d1-8508-97728488c566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:12.418260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd963f-8c5c-40d1-8508-97728488c566 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:12.418540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd963f-8c5c-40d1-8508-97728488c566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:12.418813 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd963f-8c5c-40d1-8508-97728488c566 admin admin] PATH_INFO: `/v3/projects/78c858c140c741d8a7ad62a022299fee/users/bca060d7726c4420bdf1b4ed8c72fc32/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:12.437486 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd963f-8c5c-40d1-8508-97728488c566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c858c140c741d8a7ad62a022299fee, user_id=bca060d7726c4420bdf1b4ed8c72fc32, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:12.440540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd963f-8c5c-40d1-8508-97728488c566 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:12.477014 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a4d1c147-b269-4c8c-9d54-a796b8fe7880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdae444b42204960b5ef9eb4bc8f0352'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:12.489438 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a4d1c147-b269-4c8c-9d54-a796b8fe7880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdae444b42204960b5ef9eb4bc8f0352'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:12.562491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 972/1954] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:12 2022] PUT /identity/v3/projects/78c858c140c741d8a7ad62a022299fee/users/bca060d7726c4420bdf1b4ed8c72fc32/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:12.567062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a4d1c147-b269-4c8c-9d54-a796b8fe7880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdae444b42204960b5ef9eb4bc8f0352'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:12.567698 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a4d1c147-b269-4c8c-9d54-a796b8fe7880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdae444b42204960b5ef9eb4bc8f0352'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:12.568299 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a4d1c147-b269-4c8c-9d54-a796b8fe7880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdae444b42204960b5ef9eb4bc8f0352'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:12.573100 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9220f51-2050-49b2-8da7-65b82f84c13c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:12.573389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9220f51-2050-49b2-8da7-65b82f84c13c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:12.573666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9220f51-2050-49b2-8da7-65b82f84c13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:12.581360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 983/1955] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:12 2022] DELETE /identity/v3/users/fdae444b42204960b5ef9eb4bc8f0352 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:12.585953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e4116-04e0-4d03-b091-3b2c760f6289 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:12.586241 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e4116-04e0-4d03-b091-3b2c760f6289 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:12.586519 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e4116-04e0-4d03-b091-3b2c760f6289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:12.602703 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e9220f51-2050-49b2-8da7-65b82f84c13c None None] MFA Rules not processed for user `bca060d7726c4420bdf1b4ed8c72fc32`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:12.603924 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e9220f51-2050-49b2-8da7-65b82f84c13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:12.604527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-633e4116-04e0-4d03-b091-3b2c760f6289 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:12.605808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-633e4116-04e0-4d03-b091-3b2c760f6289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:12.670770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 984/1956] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:12.670974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 973/1957] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:12.675092 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e4116-04e0-4d03-b091-3b2c760f6289 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:12.676566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-633e4116-04e0-4d03-b091-3b2c760f6289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:12.681235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9220f51-2050-49b2-8da7-65b82f84c13c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:12.682565 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e9220f51-2050-49b2-8da7-65b82f84c13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:12.689755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e4116-04e0-4d03-b091-3b2c760f6289 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:12.695431 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10da0d-dd04-4877-86dc-db1f33889bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:12.696208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10da0d-dd04-4877-86dc-db1f33889bfd admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:12.696566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10da0d-dd04-4877-86dc-db1f33889bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:12.696932 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10da0d-dd04-4877-86dc-db1f33889bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:12.697699 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10da0d-dd04-4877-86dc-db1f33889bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:12.699784 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10da0d-dd04-4877-86dc-db1f33889bfd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:12.741962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9220f51-2050-49b2-8da7-65b82f84c13c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:12.745578 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03982f21-4b95-4b24-b8a0-8bec1bde2d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:12.746215 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03982f21-4b95-4b24-b8a0-8bec1bde2d9f service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:12.746497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03982f21-4b95-4b24-b8a0-8bec1bde2d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:12.746768 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03982f21-4b95-4b24-b8a0-8bec1bde2d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:12.755462 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03982f21-4b95-4b24-b8a0-8bec1bde2d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:12.757716 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03982f21-4b95-4b24-b8a0-8bec1bde2d9f service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:12.768630 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 974/1958] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:10:12.814060 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 985/1959] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:12 2022] POST /identity/v3/projects => generated 405 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:10:12.815767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03982f21-4b95-4b24-b8a0-8bec1bde2d9f service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:12.827181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03982f21-4b95-4b24-b8a0-8bec1bde2d9f service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:12.889872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d943b-7c91-46f5-9139-839614d0bb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:12.890545 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d943b-7c91-46f5-9139-839614d0bb11 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:12.890827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d943b-7c91-46f5-9139-839614d0bb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:12.891099 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d943b-7c91-46f5-9139-839614d0bb11 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:12.891821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d943b-7c91-46f5-9139-839614d0bb11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:12.893778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d943b-7c91-46f5-9139-839614d0bb11 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:13.011973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 975/1960] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:12 2022] POST /identity/v3/users => generated 309 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:13.013240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10da0d-dd04-4877-86dc-db1f33889bfd admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:13.025171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10da0d-dd04-4877-86dc-db1f33889bfd admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:13.029191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9574d58-76ec-4c17-9d47-93efd2e3e2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:13.029870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9574d58-76ec-4c17-9d47-93efd2e3e2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:13.030175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9574d58-76ec-4c17-9d47-93efd2e3e2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:13.030448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9574d58-76ec-4c17-9d47-93efd2e3e2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:13.031203 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9574d58-76ec-4c17-9d47-93efd2e3e2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:13.032805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9574d58-76ec-4c17-9d47-93efd2e3e2c9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:13.047570 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 986/1961] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:13.049437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d943b-7c91-46f5-9139-839614d0bb11 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:13.063456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d943b-7c91-46f5-9139-839614d0bb11 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:13.069552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ae2f1-45bc-4009-bd0d-abffa58946d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:13.070637 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ae2f1-45bc-4009-bd0d-abffa58946d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:13.071063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ae2f1-45bc-4009-bd0d-abffa58946d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:13.073792 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ae2f1-45bc-4009-bd0d-abffa58946d7 admin admin] PATH_INFO: `/v3/projects/98431ff3cef84964974169e0a6df21ae/users/ad689b27dbad4253a6109fef5a6759be/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:13.090767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ae2f1-45bc-4009-bd0d-abffa58946d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98431ff3cef84964974169e0a6df21ae, user_id=ad689b27dbad4253a6109fef5a6759be, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:13.093711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ae2f1-45bc-4009-bd0d-abffa58946d7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:13.185685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 976/1962] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:13 2022] PUT /identity/v3/projects/98431ff3cef84964974169e0a6df21ae/users/ad689b27dbad4253a6109fef5a6759be/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:13.189806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9574d58-76ec-4c17-9d47-93efd2e3e2c9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:13.200422 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9574d58-76ec-4c17-9d47-93efd2e3e2c9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:13.219305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ae2f1-45bc-4009-bd0d-abffa58946d7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:13.221908 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2a9ae2f1-45bc-4009-bd0d-abffa58946d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:13.266436 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8aa73-a7f7-474c-8df5-a1026b5f89c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:13.268511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8aa73-a7f7-474c-8df5-a1026b5f89c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:13.268511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8aa73-a7f7-474c-8df5-a1026b5f89c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:13.268511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8aa73-a7f7-474c-8df5-a1026b5f89c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:13.273875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8aa73-a7f7-474c-8df5-a1026b5f89c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:13.273875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8aa73-a7f7-474c-8df5-a1026b5f89c0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:13.282348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 987/1963] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:10:13.287068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8aa73-a7f7-474c-8df5-a1026b5f89c0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:13.299735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8aa73-a7f7-474c-8df5-a1026b5f89c0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:13.301841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ae2f1-45bc-4009-bd0d-abffa58946d7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:13.305453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeacfc2-d2a2-442e-83a8-61f885e095d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:13.306348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeacfc2-d2a2-442e-83a8-61f885e095d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:13.307354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeacfc2-d2a2-442e-83a8-61f885e095d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:13.307354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeacfc2-d2a2-442e-83a8-61f885e095d8 admin admin] PATH_INFO: `/v3/projects/98431ff3cef84964974169e0a6df21ae/users/ad689b27dbad4253a6109fef5a6759be/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:13.308564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbe90f-e1b2-4551-8194-4a88fd531108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:13.309180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeacfc2-d2a2-442e-83a8-61f885e095d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98431ff3cef84964974169e0a6df21ae, user_id=ad689b27dbad4253a6109fef5a6759be, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:13.309685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbe90f-e1b2-4551-8194-4a88fd531108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:13.310026 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbe90f-e1b2-4551-8194-4a88fd531108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:13.310234 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbe90f-e1b2-4551-8194-4a88fd531108 admin admin] PATH_INFO: `/v3/projects/f5bc8c352f5b41508150e4da0df09be4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:13.311470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbe90f-e1b2-4551-8194-4a88fd531108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5bc8c352f5b41508150e4da0df09be4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:13.312084 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeacfc2-d2a2-442e-83a8-61f885e095d8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:13.313351 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbe90f-e1b2-4551-8194-4a88fd531108 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:13.324331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 988/1964] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:13 2022] PUT /identity/v3/projects/98431ff3cef84964974169e0a6df21ae/users/ad689b27dbad4253a6109fef5a6759be/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:13.336169 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8254-1689-4fa2-8918-7d025859ce99 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:13.336461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8254-1689-4fa2-8918-7d025859ce99 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:13.336739 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8254-1689-4fa2-8918-7d025859ce99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:13.368535 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d23b8254-1689-4fa2-8918-7d025859ce99 None None] MFA Rules not processed for user `ad689b27dbad4253a6109fef5a6759be`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:13.369988 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d23b8254-1689-4fa2-8918-7d025859ce99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:13.447531 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 989/1965] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:13.458570 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b8254-1689-4fa2-8918-7d025859ce99 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:13.460116 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70cbe90f-e1b2-4551-8194-4a88fd531108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5bc8c352f5b41508150e4da0df09be4', 'request_id': 'req-70cbe90f-e1b2-4551-8194-4a88fd531108'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:13.460387 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d23b8254-1689-4fa2-8918-7d025859ce99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:13.522672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b8254-1689-4fa2-8918-7d025859ce99 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:13.527511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70cbe90f-e1b2-4551-8194-4a88fd531108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5bc8c352f5b41508150e4da0df09be4', 'request_id': 'req-70cbe90f-e1b2-4551-8194-4a88fd531108'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:13.533840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70cbe90f-e1b2-4551-8194-4a88fd531108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5bc8c352f5b41508150e4da0df09be4', 'request_id': 'req-70cbe90f-e1b2-4551-8194-4a88fd531108'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:13.545886 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70cbe90f-e1b2-4551-8194-4a88fd531108 admin admin] The token cache is being invalidate because project f5bc8c352f5b41508150e4da0df09be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:13.546390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70cbe90f-e1b2-4551-8194-4a88fd531108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:13.547071 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70cbe90f-e1b2-4551-8194-4a88fd531108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:13.548983 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 977/1966] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:13 2022] DELETE /identity/v3/projects/f5bc8c352f5b41508150e4da0df09be4 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:13.552728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbe90f-e1b2-4551-8194-4a88fd531108 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:13.554733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-70cbe90f-e1b2-4551-8194-4a88fd531108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:13.575876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faf62b-3d45-42ba-9e03-c0d7b505779b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:13.576551 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faf62b-3d45-42ba-9e03-c0d7b505779b service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:13.576831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faf62b-3d45-42ba-9e03-c0d7b505779b service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:13.577109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faf62b-3d45-42ba-9e03-c0d7b505779b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:13.579367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-45faf62b-3d45-42ba-9e03-c0d7b505779b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:13.651543 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbe90f-e1b2-4551-8194-4a88fd531108 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:13.656814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82e1a7-39de-4022-8a9c-19bb16c4916c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:13.657692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82e1a7-39de-4022-8a9c-19bb16c4916c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:13.658462 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82e1a7-39de-4022-8a9c-19bb16c4916c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:13.658462 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82e1a7-39de-4022-8a9c-19bb16c4916c admin admin] PATH_INFO: `/v3/users/62ce9b544ede4cfeba1e6268bdc4f5f4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:13.659510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82e1a7-39de-4022-8a9c-19bb16c4916c admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ce9b544ede4cfeba1e6268bdc4f5f4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:13.660461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45faf62b-3d45-42ba-9e03-c0d7b505779b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:13.661598 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82e1a7-39de-4022-8a9c-19bb16c4916c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:13.661902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45faf62b-3d45-42ba-9e03-c0d7b505779b service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:13.672809 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 990/1967] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:13 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:10:13.819240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a82e1a7-39de-4022-8a9c-19bb16c4916c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ce9b544ede4cfeba1e6268bdc4f5f4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:13.829130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faf62b-3d45-42ba-9e03-c0d7b505779b service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:13.830696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-45faf62b-3d45-42ba-9e03-c0d7b505779b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:13.832023 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a82e1a7-39de-4022-8a9c-19bb16c4916c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ce9b544ede4cfeba1e6268bdc4f5f4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:13.833027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a82e1a7-39de-4022-8a9c-19bb16c4916c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ce9b544ede4cfeba1e6268bdc4f5f4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:13.850249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faf62b-3d45-42ba-9e03-c0d7b505779b service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:13.854997 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23111fe-f606-4e1b-b330-e2dc5e3e05e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:13.855943 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23111fe-f606-4e1b-b330-e2dc5e3e05e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:13.856223 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23111fe-f606-4e1b-b330-e2dc5e3e05e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:13.856499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23111fe-f606-4e1b-b330-e2dc5e3e05e4 admin admin] PATH_INFO: `/v3/users/bca060d7726c4420bdf1b4ed8c72fc32` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:13.857653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23111fe-f606-4e1b-b330-e2dc5e3e05e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca060d7726c4420bdf1b4ed8c72fc32)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:13.859588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23111fe-f606-4e1b-b330-e2dc5e3e05e4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:13.921638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a82e1a7-39de-4022-8a9c-19bb16c4916c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ce9b544ede4cfeba1e6268bdc4f5f4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:13.922376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6a82e1a7-39de-4022-8a9c-19bb16c4916c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ce9b544ede4cfeba1e6268bdc4f5f4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:13.935986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 978/1968] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:13 2022] DELETE /identity/v3/users/62ce9b544ede4cfeba1e6268bdc4f5f4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:14.060946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c23111fe-f606-4e1b-b330-e2dc5e3e05e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca060d7726c4420bdf1b4ed8c72fc32'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:14.073794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c23111fe-f606-4e1b-b330-e2dc5e3e05e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca060d7726c4420bdf1b4ed8c72fc32'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:14.154074 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c23111fe-f606-4e1b-b330-e2dc5e3e05e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca060d7726c4420bdf1b4ed8c72fc32'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:14.154694 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c23111fe-f606-4e1b-b330-e2dc5e3e05e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca060d7726c4420bdf1b4ed8c72fc32'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:14.155472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c23111fe-f606-4e1b-b330-e2dc5e3e05e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca060d7726c4420bdf1b4ed8c72fc32'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:14.170853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 991/1969] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:13 2022] DELETE /identity/v3/users/bca060d7726c4420bdf1b4ed8c72fc32 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:14.175238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba25079-288f-47bc-af29-713e323ecb47 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:14.175755 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba25079-288f-47bc-af29-713e323ecb47 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:14.176108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba25079-288f-47bc-af29-713e323ecb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:14.195567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4ba25079-288f-47bc-af29-713e323ecb47 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:14.196781 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4ba25079-288f-47bc-af29-713e323ecb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:14.260481 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 979/1970] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:14.274687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23111fe-f606-4e1b-b330-e2dc5e3e05e4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:14.276375 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c23111fe-f606-4e1b-b330-e2dc5e3e05e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:14.337447 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23111fe-f606-4e1b-b330-e2dc5e3e05e4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:14.341160 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35683adf-1894-4c85-9754-8fe87486e43c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:14.341808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35683adf-1894-4c85-9754-8fe87486e43c service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:14.342087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35683adf-1894-4c85-9754-8fe87486e43c service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:14.342357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35683adf-1894-4c85-9754-8fe87486e43c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:14.351960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35683adf-1894-4c85-9754-8fe87486e43c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:14.353408 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35683adf-1894-4c85-9754-8fe87486e43c service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:14.362657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 992/1971] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:14.390964 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba25079-288f-47bc-af29-713e323ecb47 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:14.392465 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4ba25079-288f-47bc-af29-713e323ecb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:14.405292 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba25079-288f-47bc-af29-713e323ecb47 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:14.409839 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129eab2-8c1f-4e55-82b6-5007bff9578a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:14.410842 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129eab2-8c1f-4e55-82b6-5007bff9578a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:14.411348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129eab2-8c1f-4e55-82b6-5007bff9578a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:14.411621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129eab2-8c1f-4e55-82b6-5007bff9578a admin admin] PATH_INFO: `/v3/projects/790e8b69241648f5a399a1931423619a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:14.412945 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129eab2-8c1f-4e55-82b6-5007bff9578a admin admin] RBAC: Authorizing `identity:delete_project(project_id=790e8b69241648f5a399a1931423619a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:14.418518 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129eab2-8c1f-4e55-82b6-5007bff9578a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:14.531101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e129eab2-8c1f-4e55-82b6-5007bff9578a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790e8b69241648f5a399a1931423619a', 'request_id': 'req-e129eab2-8c1f-4e55-82b6-5007bff9578a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:14.616979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e129eab2-8c1f-4e55-82b6-5007bff9578a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790e8b69241648f5a399a1931423619a', 'request_id': 'req-e129eab2-8c1f-4e55-82b6-5007bff9578a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:14.624326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e129eab2-8c1f-4e55-82b6-5007bff9578a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790e8b69241648f5a399a1931423619a', 'request_id': 'req-e129eab2-8c1f-4e55-82b6-5007bff9578a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:14.641026 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e129eab2-8c1f-4e55-82b6-5007bff9578a admin admin] The token cache is being invalidate because project 790e8b69241648f5a399a1931423619a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:14.641354 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e129eab2-8c1f-4e55-82b6-5007bff9578a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:14.642010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e129eab2-8c1f-4e55-82b6-5007bff9578a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:14.644057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 980/1972] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:14 2022] DELETE /identity/v3/projects/790e8b69241648f5a399a1931423619a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:14.648467 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35683adf-1894-4c85-9754-8fe87486e43c service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:14.659418 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35683adf-1894-4c85-9754-8fe87486e43c service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:14.744910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5bd16-00a9-4e53-80bc-2a8716873c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:14.745805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5bd16-00a9-4e53-80bc-2a8716873c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:14.746088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5bd16-00a9-4e53-80bc-2a8716873c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:14.746392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5bd16-00a9-4e53-80bc-2a8716873c19 admin admin] PATH_INFO: `/v3/users/896c023c3aa04b74a877942268ceaf86` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:14.747881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5bd16-00a9-4e53-80bc-2a8716873c19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=896c023c3aa04b74a877942268ceaf86)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:14.750107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5bd16-00a9-4e53-80bc-2a8716873c19 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:14.884160 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129eab2-8c1f-4e55-82b6-5007bff9578a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:14.886884 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e129eab2-8c1f-4e55-82b6-5007bff9578a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:14.913152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129eab2-8c1f-4e55-82b6-5007bff9578a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:14.927898 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-57f5bd16-00a9-4e53-80bc-2a8716873c19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896c023c3aa04b74a877942268ceaf86'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:14.933656 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:14.935141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:14.935825 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:14.936325 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2 admin admin] PATH_INFO: `/v3/projects/78c858c140c741d8a7ad62a022299fee` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:14.938486 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c858c140c741d8a7ad62a022299fee)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:14.940448 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:14.942007 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-57f5bd16-00a9-4e53-80bc-2a8716873c19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896c023c3aa04b74a877942268ceaf86'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.036193 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-57f5bd16-00a9-4e53-80bc-2a8716873c19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896c023c3aa04b74a877942268ceaf86'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.036803 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-57f5bd16-00a9-4e53-80bc-2a8716873c19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896c023c3aa04b74a877942268ceaf86'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.037981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-57f5bd16-00a9-4e53-80bc-2a8716873c19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896c023c3aa04b74a877942268ceaf86'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.050517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 993/1973] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:14 2022] DELETE /identity/v3/users/896c023c3aa04b74a877942268ceaf86 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:15.077639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c858c140c741d8a7ad62a022299fee', 'request_id': 'req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.176604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c858c140c741d8a7ad62a022299fee', 'request_id': 'req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.183198 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c858c140c741d8a7ad62a022299fee', 'request_id': 'req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.195388 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2 admin admin] The token cache is being invalidate because project 78c858c140c741d8a7ad62a022299fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:15.195798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.196456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.198057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 981/1974] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:14 2022] DELETE /identity/v3/projects/78c858c140c741d8a7ad62a022299fee => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:15.202193 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5bd16-00a9-4e53-80bc-2a8716873c19 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:15.203800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-57f5bd16-00a9-4e53-80bc-2a8716873c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:15.273245 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5bd16-00a9-4e53-80bc-2a8716873c19 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:15.331618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec5d30-72af-4631-ab70-9faef3e0ce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:15.332499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec5d30-72af-4631-ab70-9faef3e0ce88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:15.332775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec5d30-72af-4631-ab70-9faef3e0ce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:15.333094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec5d30-72af-4631-ab70-9faef3e0ce88 admin admin] PATH_INFO: `/v3/users/ad689b27dbad4253a6109fef5a6759be` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:15.335498 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec5d30-72af-4631-ab70-9faef3e0ce88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad689b27dbad4253a6109fef5a6759be)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:15.337579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec5d30-72af-4631-ab70-9faef3e0ce88 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:15.504244 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:15.506039 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:15.520590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58d89c-a18e-47fa-b18d-ed4e37e41cf2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:15.527347 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f8d33-4b07-435d-9826-c49f1ed4146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:15.528559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f8d33-4b07-435d-9826-c49f1ed4146b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:15.529004 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f8d33-4b07-435d-9826-c49f1ed4146b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:15.529444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f8d33-4b07-435d-9826-c49f1ed4146b admin admin] PATH_INFO: `/v3/projects/9f03308bead14abc939759d6879031b1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:15.530953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f8d33-4b07-435d-9826-c49f1ed4146b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f03308bead14abc939759d6879031b1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:15.533046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f8d33-4b07-435d-9826-c49f1ed4146b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:15.544909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2eec5d30-72af-4631-ab70-9faef3e0ce88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad689b27dbad4253a6109fef5a6759be'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.561269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2eec5d30-72af-4631-ab70-9faef3e0ce88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad689b27dbad4253a6109fef5a6759be'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.636468 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2eec5d30-72af-4631-ab70-9faef3e0ce88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad689b27dbad4253a6109fef5a6759be'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.637149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2eec5d30-72af-4631-ab70-9faef3e0ce88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad689b27dbad4253a6109fef5a6759be'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.638078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2eec5d30-72af-4631-ab70-9faef3e0ce88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad689b27dbad4253a6109fef5a6759be'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.653180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 994/1975] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:15 2022] DELETE /identity/v3/users/ad689b27dbad4253a6109fef5a6759be => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:15.688680 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-078f8d33-4b07-435d-9826-c49f1ed4146b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f03308bead14abc939759d6879031b1', 'request_id': 'req-078f8d33-4b07-435d-9826-c49f1ed4146b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.767891 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-078f8d33-4b07-435d-9826-c49f1ed4146b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f03308bead14abc939759d6879031b1', 'request_id': 'req-078f8d33-4b07-435d-9826-c49f1ed4146b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.774553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-078f8d33-4b07-435d-9826-c49f1ed4146b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f03308bead14abc939759d6879031b1', 'request_id': 'req-078f8d33-4b07-435d-9826-c49f1ed4146b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.785438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-078f8d33-4b07-435d-9826-c49f1ed4146b admin admin] The token cache is being invalidate because project 9f03308bead14abc939759d6879031b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:15.785808 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-078f8d33-4b07-435d-9826-c49f1ed4146b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.786437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-078f8d33-4b07-435d-9826-c49f1ed4146b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:15.788790 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 982/1976] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:15 2022] DELETE /identity/v3/projects/9f03308bead14abc939759d6879031b1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:15.803390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44184d-2449-4c9b-90be-08455776355a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:15.803390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44184d-2449-4c9b-90be-08455776355a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:15.803390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44184d-2449-4c9b-90be-08455776355a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:15.814593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ca44184d-2449-4c9b-90be-08455776355a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:15.815829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ca44184d-2449-4c9b-90be-08455776355a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:15.889562 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 995/1977] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:15.898462 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3719b-9ee6-4cf3-bf9c-7f9af00fcd04 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:15.900461 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3719b-9ee6-4cf3-bf9c-7f9af00fcd04 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:15.900948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3719b-9ee6-4cf3-bf9c-7f9af00fcd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:15.929420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ebe3719b-9ee6-4cf3-bf9c-7f9af00fcd04 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:15.931891 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ebe3719b-9ee6-4cf3-bf9c-7f9af00fcd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:15.949146 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 983/1978] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:15.954027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44184d-2449-4c9b-90be-08455776355a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:15.965556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44184d-2449-4c9b-90be-08455776355a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:15.970827 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e05f25-5ef8-4bb5-a666-dd848701e90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:15.971576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e05f25-5ef8-4bb5-a666-dd848701e90c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:15.971877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e05f25-5ef8-4bb5-a666-dd848701e90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:15.972440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e05f25-5ef8-4bb5-a666-dd848701e90c admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:15.973088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e05f25-5ef8-4bb5-a666-dd848701e90c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:10:15.973574 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e05f25-5ef8-4bb5-a666-dd848701e90c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:15.979849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e05f25-5ef8-4bb5-a666-dd848701e90c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:15.994570 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 996/1979] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:10:15.999408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3719b-9ee6-4cf3-bf9c-7f9af00fcd04 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:16.017000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3719b-9ee6-4cf3-bf9c-7f9af00fcd04 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:16.024628 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ef0b8-3d3c-4740-9a21-c7c9d18803d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:16.026533 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ef0b8-3d3c-4740-9a21-c7c9d18803d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:16.027536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ef0b8-3d3c-4740-9a21-c7c9d18803d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:16.028301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ef0b8-3d3c-4740-9a21-c7c9d18803d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:16.029202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ef0b8-3d3c-4740-9a21-c7c9d18803d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:16.031529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ef0b8-3d3c-4740-9a21-c7c9d18803d5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:16.168876 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 984/1980] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:15 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:10:16.173043 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e05f25-5ef8-4bb5-a666-dd848701e90c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:16.190631 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e05f25-5ef8-4bb5-a666-dd848701e90c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:16.308122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018d97d-3465-4106-b8a9-aed2bc7831db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:16.309345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018d97d-3465-4106-b8a9-aed2bc7831db admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:16.309769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018d97d-3465-4106-b8a9-aed2bc7831db admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:16.310200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018d97d-3465-4106-b8a9-aed2bc7831db admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:16.311743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018d97d-3465-4106-b8a9-aed2bc7831db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:16.315236 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018d97d-3465-4106-b8a9-aed2bc7831db admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:16.412002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 997/1981] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:16 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:16.417106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ef0b8-3d3c-4740-9a21-c7c9d18803d5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:16.433334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ef0b8-3d3c-4740-9a21-c7c9d18803d5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:16.438953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21197753-b8c4-401d-af29-af996d8fce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:16.440167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21197753-b8c4-401d-af29-af996d8fce57 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:16.440559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21197753-b8c4-401d-af29-af996d8fce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:16.440837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21197753-b8c4-401d-af29-af996d8fce57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:16.441874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21197753-b8c4-401d-af29-af996d8fce57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:16.444962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21197753-b8c4-401d-af29-af996d8fce57 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:16.463901 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 985/1982] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:16.465249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018d97d-3465-4106-b8a9-aed2bc7831db admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:16.476574 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018d97d-3465-4106-b8a9-aed2bc7831db admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:16.486858 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9b2fe-a7e9-4047-a609-25da0be8132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:16.487709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9b2fe-a7e9-4047-a609-25da0be8132b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:16.488011 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9b2fe-a7e9-4047-a609-25da0be8132b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:16.488470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9b2fe-a7e9-4047-a609-25da0be8132b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:16.489975 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9b2fe-a7e9-4047-a609-25da0be8132b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:16.492800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9b2fe-a7e9-4047-a609-25da0be8132b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:16.511474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21197753-b8c4-401d-af29-af996d8fce57 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:16.514371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-21197753-b8c4-401d-af29-af996d8fce57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:16.516729 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 998/1983] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:16.529832 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9b2fe-a7e9-4047-a609-25da0be8132b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:16.542829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21197753-b8c4-401d-af29-af996d8fce57 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:16.543479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9b2fe-a7e9-4047-a609-25da0be8132b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:16.550165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557f681-927c-46b8-9628-9c73f4289eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:16.551067 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557f681-927c-46b8-9628-9c73f4289eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:16.551372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557f681-927c-46b8-9628-9c73f4289eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:16.551648 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557f681-927c-46b8-9628-9c73f4289eb9 admin admin] PATH_INFO: `/v3/projects/1a452d726b8042dc84b3f81639fb410f/users/3b0fdfe19f2d41d884e7c2f60eb2b8ac/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:16.551850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafad5b-b445-4c99-ac1f-258ab78d413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:16.553893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafad5b-b445-4c99-ac1f-258ab78d413a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:16.554281 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafad5b-b445-4c99-ac1f-258ab78d413a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:16.561292 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafad5b-b445-4c99-ac1f-258ab78d413a admin admin] PATH_INFO: `/v3/projects/98431ff3cef84964974169e0a6df21ae` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:16.563483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafad5b-b445-4c99-ac1f-258ab78d413a admin admin] RBAC: Authorizing `identity:delete_project(project_id=98431ff3cef84964974169e0a6df21ae)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:16.581970 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557f681-927c-46b8-9628-9c73f4289eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a452d726b8042dc84b3f81639fb410f, user_id=3b0fdfe19f2d41d884e7c2f60eb2b8ac, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:16.585615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafad5b-b445-4c99-ac1f-258ab78d413a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:16.585788 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557f681-927c-46b8-9628-9c73f4289eb9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:16.716439 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 999/1984] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:16 2022] PUT /identity/v3/projects/1a452d726b8042dc84b3f81639fb410f/users/3b0fdfe19f2d41d884e7c2f60eb2b8ac/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:16.733038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42053e0b-afe8-4283-b9dc-88ad4ea02983 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:16.733038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42053e0b-afe8-4283-b9dc-88ad4ea02983 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:16.733038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42053e0b-afe8-4283-b9dc-88ad4ea02983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:16.761664 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8bafad5b-b445-4c99-ac1f-258ab78d413a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98431ff3cef84964974169e0a6df21ae', 'request_id': 'req-8bafad5b-b445-4c99-ac1f-258ab78d413a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:16.781960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-42053e0b-afe8-4283-b9dc-88ad4ea02983 None None] MFA Rules not processed for user `3b0fdfe19f2d41d884e7c2f60eb2b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:16.782783 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-42053e0b-afe8-4283-b9dc-88ad4ea02983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:16.839900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8bafad5b-b445-4c99-ac1f-258ab78d413a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98431ff3cef84964974169e0a6df21ae', 'request_id': 'req-8bafad5b-b445-4c99-ac1f-258ab78d413a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:16.846534 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8bafad5b-b445-4c99-ac1f-258ab78d413a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98431ff3cef84964974169e0a6df21ae', 'request_id': 'req-8bafad5b-b445-4c99-ac1f-258ab78d413a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:16.869445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1000/1985] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:16.870497 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42053e0b-afe8-4283-b9dc-88ad4ea02983 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:16.874412 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8bafad5b-b445-4c99-ac1f-258ab78d413a admin admin] The token cache is being invalidate because project 98431ff3cef84964974169e0a6df21ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:16.874810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8bafad5b-b445-4c99-ac1f-258ab78d413a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:16.875602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8bafad5b-b445-4c99-ac1f-258ab78d413a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:16.877385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 986/1986] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:16 2022] DELETE /identity/v3/projects/98431ff3cef84964974169e0a6df21ae => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:16.884213 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c15000-011f-4d50-8d28-aaedb486abab None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:16.884580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c15000-011f-4d50-8d28-aaedb486abab None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:16.884936 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c15000-011f-4d50-8d28-aaedb486abab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:16.914357 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-18c15000-011f-4d50-8d28-aaedb486abab None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:16.915689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-18c15000-011f-4d50-8d28-aaedb486abab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:16.996219 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42053e0b-afe8-4283-b9dc-88ad4ea02983 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:17.003137 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d57b0f-db6b-4ccd-8d33-993fb134cec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:17.004602 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d57b0f-db6b-4ccd-8d33-993fb134cec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:17.004885 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d57b0f-db6b-4ccd-8d33-993fb134cec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:17.005165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d57b0f-db6b-4ccd-8d33-993fb134cec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:17.006559 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d57b0f-db6b-4ccd-8d33-993fb134cec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:17.013245 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d57b0f-db6b-4ccd-8d33-993fb134cec8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:17.015723 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 987/1987] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:17.027294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754a575-0e03-4777-90cd-803e594b2d1a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:17.027578 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754a575-0e03-4777-90cd-803e594b2d1a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:17.027846 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754a575-0e03-4777-90cd-803e594b2d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:17.049408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0754a575-0e03-4777-90cd-803e594b2d1a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:17.050606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0754a575-0e03-4777-90cd-803e594b2d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:17.061297 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 988/1988] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:17.067771 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754a575-0e03-4777-90cd-803e594b2d1a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:17.082079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754a575-0e03-4777-90cd-803e594b2d1a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:17.093407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821d3bd-dd32-4d4e-9712-f6469be94837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:17.094288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d3bd-dd32-4d4e-9712-f6469be94837 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:17.094632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d3bd-dd32-4d4e-9712-f6469be94837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:17.094948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d3bd-dd32-4d4e-9712-f6469be94837 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:17.095957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821d3bd-dd32-4d4e-9712-f6469be94837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:10:17.096272 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821d3bd-dd32-4d4e-9712-f6469be94837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:17.101483 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1001/1989] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:16 2022] POST /identity/v3/projects => generated 381 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:10:17.101661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821d3bd-dd32-4d4e-9712-f6469be94837 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:17.112574 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d57b0f-db6b-4ccd-8d33-993fb134cec8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:17.114621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a9d57b0f-db6b-4ccd-8d33-993fb134cec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:17.135690 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 989/1990] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:10:17.136620 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821d3bd-dd32-4d4e-9712-f6469be94837 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:17.147626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821d3bd-dd32-4d4e-9712-f6469be94837 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:17.211339 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d57b0f-db6b-4ccd-8d33-993fb134cec8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:17.216325 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb619749-8d99-408f-9256-cce7fde1a062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:17.216967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb619749-8d99-408f-9256-cce7fde1a062 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:17.217248 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb619749-8d99-408f-9256-cce7fde1a062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:17.217513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb619749-8d99-408f-9256-cce7fde1a062 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:17.218252 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb619749-8d99-408f-9256-cce7fde1a062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:17.220985 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb619749-8d99-408f-9256-cce7fde1a062 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:17.226696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6b600-79d0-4335-b14a-e968a3510488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:17.227630 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6b600-79d0-4335-b14a-e968a3510488 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:17.227997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6b600-79d0-4335-b14a-e968a3510488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:17.228345 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6b600-79d0-4335-b14a-e968a3510488 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:17.229119 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6b600-79d0-4335-b14a-e968a3510488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:17.231846 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6b600-79d0-4335-b14a-e968a3510488 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:17.342814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1002/1991] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:17 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:17.346806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb619749-8d99-408f-9256-cce7fde1a062 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:17.356767 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb619749-8d99-408f-9256-cce7fde1a062 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:17.362849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b701d0-9c10-445d-b3cb-c063e160101b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:17.363861 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b701d0-9c10-445d-b3cb-c063e160101b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:17.363972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b701d0-9c10-445d-b3cb-c063e160101b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:17.364181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b701d0-9c10-445d-b3cb-c063e160101b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:17.365665 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b701d0-9c10-445d-b3cb-c063e160101b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:17.368034 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b701d0-9c10-445d-b3cb-c063e160101b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:17.374868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 990/1992] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:17 2022] POST /identity/v3/projects => generated 365 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:17.376126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6b600-79d0-4335-b14a-e968a3510488 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:17.391370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1003/1993] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:10:17.392469 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b701d0-9c10-445d-b3cb-c063e160101b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:17.422565 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b701d0-9c10-445d-b3cb-c063e160101b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:17.498852 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6b600-79d0-4335-b14a-e968a3510488 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:17.507770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2daba9-28a8-498c-896e-6cd2bd6d85d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:17.508462 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2daba9-28a8-498c-896e-6cd2bd6d85d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:17.508750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2daba9-28a8-498c-896e-6cd2bd6d85d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:17.509026 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2daba9-28a8-498c-896e-6cd2bd6d85d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:17.509763 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2daba9-28a8-498c-896e-6cd2bd6d85d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:17.512076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2daba9-28a8-498c-896e-6cd2bd6d85d3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:17.526399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557c8ec-6b17-42f7-9e86-49d1de821b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:17.527711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557c8ec-6b17-42f7-9e86-49d1de821b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:17.528341 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557c8ec-6b17-42f7-9e86-49d1de821b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:17.528621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557c8ec-6b17-42f7-9e86-49d1de821b21 admin admin] PATH_INFO: `/v3/projects/3d81b35b82194f90b5052f0f6ac2bc90/users/d7af99314b1941b08d57eccedd49a1a7/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:17.547209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557c8ec-6b17-42f7-9e86-49d1de821b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d81b35b82194f90b5052f0f6ac2bc90, user_id=d7af99314b1941b08d57eccedd49a1a7, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:17.550025 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557c8ec-6b17-42f7-9e86-49d1de821b21 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:17.598111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 991/1994] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:17 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:17.602255 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2daba9-28a8-498c-896e-6cd2bd6d85d3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:17.615479 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2daba9-28a8-498c-896e-6cd2bd6d85d3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:17.620483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58603641-939d-4a28-bb75-e5af4937030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:17.621252 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58603641-939d-4a28-bb75-e5af4937030d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:17.621747 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58603641-939d-4a28-bb75-e5af4937030d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:17.622094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58603641-939d-4a28-bb75-e5af4937030d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:17.622905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58603641-939d-4a28-bb75-e5af4937030d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:17.624677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58603641-939d-4a28-bb75-e5af4937030d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:17.639434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 992/1995] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:17.640460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1004/1996] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:17 2022] PUT /identity/v3/projects/3d81b35b82194f90b5052f0f6ac2bc90/users/d7af99314b1941b08d57eccedd49a1a7/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:17.643181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58603641-939d-4a28-bb75-e5af4937030d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:17.645232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557c8ec-6b17-42f7-9e86-49d1de821b21 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:17.655628 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58603641-939d-4a28-bb75-e5af4937030d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:17.750350 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557c8ec-6b17-42f7-9e86-49d1de821b21 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:17.752085 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32436a2a-f4c2-40a5-a3ba-a691e8f3747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:17.752806 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32436a2a-f4c2-40a5-a3ba-a691e8f3747f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:17.753092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32436a2a-f4c2-40a5-a3ba-a691e8f3747f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:17.753386 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32436a2a-f4c2-40a5-a3ba-a691e8f3747f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:17.754112 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32436a2a-f4c2-40a5-a3ba-a691e8f3747f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:17.756573 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32436a2a-f4c2-40a5-a3ba-a691e8f3747f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:17.758276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269f8b9-2fc0-4bcd-b8b1-81112fcc3ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:17.759130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269f8b9-2fc0-4bcd-b8b1-81112fcc3ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:17.759475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269f8b9-2fc0-4bcd-b8b1-81112fcc3ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:17.759842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269f8b9-2fc0-4bcd-b8b1-81112fcc3ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:17.760868 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269f8b9-2fc0-4bcd-b8b1-81112fcc3ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:17.762671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269f8b9-2fc0-4bcd-b8b1-81112fcc3ee8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:17.771150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 993/1997] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:17.774455 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32436a2a-f4c2-40a5-a3ba-a691e8f3747f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:17.774603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1005/1998] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:10:17.778217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269f8b9-2fc0-4bcd-b8b1-81112fcc3ee8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:17.786224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32436a2a-f4c2-40a5-a3ba-a691e8f3747f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:17.790088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269f8b9-2fc0-4bcd-b8b1-81112fcc3ee8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:17.795618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eac463-ae6e-4ee5-91de-7c0665a3caa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:17.796716 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eac463-ae6e-4ee5-91de-7c0665a3caa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:17.797099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eac463-ae6e-4ee5-91de-7c0665a3caa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:17.797471 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eac463-ae6e-4ee5-91de-7c0665a3caa4 admin admin] PATH_INFO: `/v3/projects/3d81b35b82194f90b5052f0f6ac2bc90/users/d7af99314b1941b08d57eccedd49a1a7/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:17.799604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9d492-473c-483e-aec9-3b7ace569d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:17.799934 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eac463-ae6e-4ee5-91de-7c0665a3caa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d81b35b82194f90b5052f0f6ac2bc90, user_id=d7af99314b1941b08d57eccedd49a1a7, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:17.800507 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d492-473c-483e-aec9-3b7ace569d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:17.800789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d492-473c-483e-aec9-3b7ace569d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:17.801070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d492-473c-483e-aec9-3b7ace569d87 admin admin] PATH_INFO: `/v3/projects/db26ebb6129c4f92866f56f78965a661/users/17d907d673fd440b97aad2bd2b811461/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:17.803028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eac463-ae6e-4ee5-91de-7c0665a3caa4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:17.814606 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1006/1999] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:17 2022] PUT /identity/v3/projects/3d81b35b82194f90b5052f0f6ac2bc90/users/d7af99314b1941b08d57eccedd49a1a7/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:17.821284 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9d492-473c-483e-aec9-3b7ace569d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db26ebb6129c4f92866f56f78965a661, user_id=17d907d673fd440b97aad2bd2b811461, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:17.825381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9d492-473c-483e-aec9-3b7ace569d87 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:17.826338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5a90a-d7ae-470f-9f12-fecbdc32d0f3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:17.827217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5a90a-d7ae-470f-9f12-fecbdc32d0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:17.827217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5a90a-d7ae-470f-9f12-fecbdc32d0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:17.856686 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e3d5a90a-d7ae-470f-9f12-fecbdc32d0f3 None None] MFA Rules not processed for user `d7af99314b1941b08d57eccedd49a1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:17.857806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e3d5a90a-d7ae-470f-9f12-fecbdc32d0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:17.928362 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 994/2000] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:17 2022] PUT /identity/v3/projects/db26ebb6129c4f92866f56f78965a661/users/17d907d673fd440b97aad2bd2b811461/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:17.937811 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1007/2001] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:17.944229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5cbce-e4be-47fd-8278-6676a73204b7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:17.947853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5cbce-e4be-47fd-8278-6676a73204b7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:17.947853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5cbce-e4be-47fd-8278-6676a73204b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:17.950286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5a90a-d7ae-470f-9f12-fecbdc32d0f3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:17.951727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e3d5a90a-d7ae-470f-9f12-fecbdc32d0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:17.972320 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-34c5cbce-e4be-47fd-8278-6676a73204b7 None None] MFA Rules not processed for user `17d907d673fd440b97aad2bd2b811461`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:17.973622 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-34c5cbce-e4be-47fd-8278-6676a73204b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:18.016532 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5a90a-d7ae-470f-9f12-fecbdc32d0f3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:18.059471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 995/2002] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:18.060849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5cbce-e4be-47fd-8278-6676a73204b7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:18.079052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9e915-34d3-4190-a9df-c0959787ece1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:18.080707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9e915-34d3-4190-a9df-c0959787ece1 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:18.080997 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9e915-34d3-4190-a9df-c0959787ece1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:18.081279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9e915-34d3-4190-a9df-c0959787ece1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:18.132903 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5cbce-e4be-47fd-8278-6676a73204b7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:18.138506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c261b7-093f-4f4a-a603-92d588328169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:18.139208 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c261b7-093f-4f4a-a603-92d588328169 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:18.139493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c261b7-093f-4f4a-a603-92d588328169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:18.139781 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c261b7-093f-4f4a-a603-92d588328169 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:18.140498 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c261b7-093f-4f4a-a603-92d588328169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:18.142578 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c261b7-093f-4f4a-a603-92d588328169 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:18.158586 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9e915-34d3-4190-a9df-c0959787ece1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:18.160071 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9e915-34d3-4190-a9df-c0959787ece1 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:18.171079 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1008/2003] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:18.237950 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 996/2004] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:18 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:18.245772 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9e915-34d3-4190-a9df-c0959787ece1 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:18.256190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9e915-34d3-4190-a9df-c0959787ece1 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:18.315541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c261b7-093f-4f4a-a603-92d588328169 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:18.321919 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c34e3-fdf0-4d03-9cac-a8f46eab7a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:18.322600 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c34e3-fdf0-4d03-9cac-a8f46eab7a3f admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:18.322883 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c34e3-fdf0-4d03-9cac-a8f46eab7a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:18.323182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c34e3-fdf0-4d03-9cac-a8f46eab7a3f admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:18.323866 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c34e3-fdf0-4d03-9cac-a8f46eab7a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:18.325877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c34e3-fdf0-4d03-9cac-a8f46eab7a3f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:18.392984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c261b7-093f-4f4a-a603-92d588328169 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:18.401949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be917e92-d5c4-45f2-911f-532a2e9d76f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:18.402605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be917e92-d5c4-45f2-911f-532a2e9d76f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:18.406659 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be917e92-d5c4-45f2-911f-532a2e9d76f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:18.406659 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be917e92-d5c4-45f2-911f-532a2e9d76f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:18.406659 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-be917e92-d5c4-45f2-911f-532a2e9d76f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:18.430534 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1009/2005] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:18 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:18.441319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c34e3-fdf0-4d03-9cac-a8f46eab7a3f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:18.452243 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c34e3-fdf0-4d03-9cac-a8f46eab7a3f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:18.456989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09404934-9c53-4029-b333-e60c2d5b3556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:18.457630 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09404934-9c53-4029-b333-e60c2d5b3556 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:18.457914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09404934-9c53-4029-b333-e60c2d5b3556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:18.458189 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09404934-9c53-4029-b333-e60c2d5b3556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:18.459583 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09404934-9c53-4029-b333-e60c2d5b3556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:18.461294 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09404934-9c53-4029-b333-e60c2d5b3556 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:18.471164 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1010/2006] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:18.471433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be917e92-d5c4-45f2-911f-532a2e9d76f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:18.472983 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be917e92-d5c4-45f2-911f-532a2e9d76f5 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:18.475306 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09404934-9c53-4029-b333-e60c2d5b3556 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:18.482929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 997/2007] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:10:18.485410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09404934-9c53-4029-b333-e60c2d5b3556 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:18.490076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d133d3c-eb08-419f-be09-12790ed25332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:18.491310 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d133d3c-eb08-419f-be09-12790ed25332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:18.491598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d133d3c-eb08-419f-be09-12790ed25332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:18.491876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d133d3c-eb08-419f-be09-12790ed25332 admin admin] PATH_INFO: `/v3/projects/d9c46e65e7264cd49a156213c179e89d/users/164824868c6e4dfabe27059bcf4bee54/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:18.508509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d133d3c-eb08-419f-be09-12790ed25332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c46e65e7264cd49a156213c179e89d, user_id=164824868c6e4dfabe27059bcf4bee54, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:18.511306 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d133d3c-eb08-419f-be09-12790ed25332 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:18.608269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1011/2008] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:18 2022] PUT /identity/v3/projects/d9c46e65e7264cd49a156213c179e89d/users/164824868c6e4dfabe27059bcf4bee54/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:18.612276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be917e92-d5c4-45f2-911f-532a2e9d76f5 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:18.623629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be917e92-d5c4-45f2-911f-532a2e9d76f5 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:18.681167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77064b64-0dff-49cb-af7c-745ffa8aa776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:18.681953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77064b64-0dff-49cb-af7c-745ffa8aa776 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:18.682115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77064b64-0dff-49cb-af7c-745ffa8aa776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:18.682519 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77064b64-0dff-49cb-af7c-745ffa8aa776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:18.683125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77064b64-0dff-49cb-af7c-745ffa8aa776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:18.685073 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77064b64-0dff-49cb-af7c-745ffa8aa776 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:18.695830 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 998/2009] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:18.699904 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d133d3c-eb08-419f-be09-12790ed25332 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:18.714125 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d133d3c-eb08-419f-be09-12790ed25332 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:18.719238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48354c0-d683-4b01-a3b1-2a6b5588e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:18.720117 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48354c0-d683-4b01-a3b1-2a6b5588e8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:18.720392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48354c0-d683-4b01-a3b1-2a6b5588e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:18.720663 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48354c0-d683-4b01-a3b1-2a6b5588e8d5 admin admin] PATH_INFO: `/v3/projects/d9c46e65e7264cd49a156213c179e89d/users/164824868c6e4dfabe27059bcf4bee54/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:18.722609 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48354c0-d683-4b01-a3b1-2a6b5588e8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c46e65e7264cd49a156213c179e89d, user_id=164824868c6e4dfabe27059bcf4bee54, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:18.725433 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48354c0-d683-4b01-a3b1-2a6b5588e8d5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:18.735979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1012/2010] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:18 2022] PUT /identity/v3/projects/d9c46e65e7264cd49a156213c179e89d/users/164824868c6e4dfabe27059bcf4bee54/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:18.746764 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ecbe-af5d-47fd-96c4-23e35d5cf43e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:18.747050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ecbe-af5d-47fd-96c4-23e35d5cf43e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:18.747356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ecbe-af5d-47fd-96c4-23e35d5cf43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:18.774481 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8135ecbe-af5d-47fd-96c4-23e35d5cf43e None None] MFA Rules not processed for user `164824868c6e4dfabe27059bcf4bee54`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:18.775761 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8135ecbe-af5d-47fd-96c4-23e35d5cf43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:18.846576 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 999/2011] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:18.861273 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48354c0-d683-4b01-a3b1-2a6b5588e8d5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:18.861273 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e48354c0-d683-4b01-a3b1-2a6b5588e8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:18.931669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48354c0-d683-4b01-a3b1-2a6b5588e8d5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:18.937363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff84025-fe19-40a8-a5d7-ad9c95c5cead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:18.938106 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff84025-fe19-40a8-a5d7-ad9c95c5cead service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:18.938664 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff84025-fe19-40a8-a5d7-ad9c95c5cead service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:18.938948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff84025-fe19-40a8-a5d7-ad9c95c5cead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:18.949943 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff84025-fe19-40a8-a5d7-ad9c95c5cead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:18.951424 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff84025-fe19-40a8-a5d7-ad9c95c5cead service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:18.961614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1013/2012] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:19.049781 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ecbe-af5d-47fd-96c4-23e35d5cf43e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:19.114914 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ecbe-af5d-47fd-96c4-23e35d5cf43e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:19.122126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4aabb-4c21-43a4-9bd4-3d1d0c38428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:19.122999 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4aabb-4c21-43a4-9bd4-3d1d0c38428f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:19.123319 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4aabb-4c21-43a4-9bd4-3d1d0c38428f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:19.123590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4aabb-4c21-43a4-9bd4-3d1d0c38428f admin admin] PATH_INFO: `/v3/users/3b0fdfe19f2d41d884e7c2f60eb2b8ac` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:19.124773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4aabb-4c21-43a4-9bd4-3d1d0c38428f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b0fdfe19f2d41d884e7c2f60eb2b8ac)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:19.126704 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4aabb-4c21-43a4-9bd4-3d1d0c38428f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:19.168825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff84025-fe19-40a8-a5d7-ad9c95c5cead service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:19.176977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff84025-fe19-40a8-a5d7-ad9c95c5cead service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:19.181324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d58a3-7a87-4dcd-810d-ce7e672e0224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:19.187352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d58a3-7a87-4dcd-810d-ce7e672e0224 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:19.187352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d58a3-7a87-4dcd-810d-ce7e672e0224 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:19.187352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d58a3-7a87-4dcd-810d-ce7e672e0224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:19.237040 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d58a3-7a87-4dcd-810d-ce7e672e0224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:19.238488 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d58a3-7a87-4dcd-810d-ce7e672e0224 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:19.249193 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1014/2013] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:19.290128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-19b4aabb-4c21-43a4-9bd4-3d1d0c38428f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b0fdfe19f2d41d884e7c2f60eb2b8ac'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:19.302370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-19b4aabb-4c21-43a4-9bd4-3d1d0c38428f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b0fdfe19f2d41d884e7c2f60eb2b8ac'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:19.303064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-19b4aabb-4c21-43a4-9bd4-3d1d0c38428f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b0fdfe19f2d41d884e7c2f60eb2b8ac'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:19.390186 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-19b4aabb-4c21-43a4-9bd4-3d1d0c38428f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b0fdfe19f2d41d884e7c2f60eb2b8ac'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:19.391233 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-19b4aabb-4c21-43a4-9bd4-3d1d0c38428f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b0fdfe19f2d41d884e7c2f60eb2b8ac'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:19.405802 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1000/2014] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:19 2022] DELETE /identity/v3/users/3b0fdfe19f2d41d884e7c2f60eb2b8ac => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:19.410862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0619f-eb32-4deb-aaec-0b95f716ee5a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:19.411296 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0619f-eb32-4deb-aaec-0b95f716ee5a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:19.411581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0619f-eb32-4deb-aaec-0b95f716ee5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:19.434938 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8ae0619f-eb32-4deb-aaec-0b95f716ee5a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:19.434938 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8ae0619f-eb32-4deb-aaec-0b95f716ee5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:19.493900 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1015/2015] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:19.503615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4aabb-4c21-43a4-9bd4-3d1d0c38428f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:19.505082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-19b4aabb-4c21-43a4-9bd4-3d1d0c38428f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:19.564397 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4aabb-4c21-43a4-9bd4-3d1d0c38428f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:19.568174 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d4837-f5fa-4528-b7c8-72cab19ecc38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:19.568814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d4837-f5fa-4528-b7c8-72cab19ecc38 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:19.569098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d4837-f5fa-4528-b7c8-72cab19ecc38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:19.569374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d4837-f5fa-4528-b7c8-72cab19ecc38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:19.578393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d4837-f5fa-4528-b7c8-72cab19ecc38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:19.579862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d4837-f5fa-4528-b7c8-72cab19ecc38 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:19.590852 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1001/2016] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:20.020573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0619f-eb32-4deb-aaec-0b95f716ee5a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:20.022164 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8ae0619f-eb32-4deb-aaec-0b95f716ee5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:20.035410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0619f-eb32-4deb-aaec-0b95f716ee5a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:20.042128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905005b-588b-475a-b150-ec72b46b9b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:20.043255 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905005b-588b-475a-b150-ec72b46b9b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:20.043785 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905005b-588b-475a-b150-ec72b46b9b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:20.044612 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905005b-588b-475a-b150-ec72b46b9b55 admin admin] PATH_INFO: `/v3/projects/1a452d726b8042dc84b3f81639fb410f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:20.046239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905005b-588b-475a-b150-ec72b46b9b55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a452d726b8042dc84b3f81639fb410f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:20.048446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905005b-588b-475a-b150-ec72b46b9b55 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:20.171870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9905005b-588b-475a-b150-ec72b46b9b55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a452d726b8042dc84b3f81639fb410f', 'request_id': 'req-9905005b-588b-475a-b150-ec72b46b9b55'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:20.178523 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9905005b-588b-475a-b150-ec72b46b9b55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a452d726b8042dc84b3f81639fb410f', 'request_id': 'req-9905005b-588b-475a-b150-ec72b46b9b55'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:20.184309 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9905005b-588b-475a-b150-ec72b46b9b55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a452d726b8042dc84b3f81639fb410f', 'request_id': 'req-9905005b-588b-475a-b150-ec72b46b9b55'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:20.264801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9905005b-588b-475a-b150-ec72b46b9b55 admin admin] The token cache is being invalidate because project 1a452d726b8042dc84b3f81639fb410f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:20.264992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9905005b-588b-475a-b150-ec72b46b9b55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:20.265708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9905005b-588b-475a-b150-ec72b46b9b55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:20.267350 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1016/2017] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:20 2022] DELETE /identity/v3/projects/1a452d726b8042dc84b3f81639fb410f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:20.271232 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d4837-f5fa-4528-b7c8-72cab19ecc38 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:20.281370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d4837-f5fa-4528-b7c8-72cab19ecc38 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:20.337842 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a781b-9f26-4564-9048-17b4df150625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:20.338723 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a781b-9f26-4564-9048-17b4df150625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:20.339006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a781b-9f26-4564-9048-17b4df150625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:20.339307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a781b-9f26-4564-9048-17b4df150625 admin admin] PATH_INFO: `/v3/users/d7af99314b1941b08d57eccedd49a1a7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:20.340596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a781b-9f26-4564-9048-17b4df150625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7af99314b1941b08d57eccedd49a1a7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:20.342575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a781b-9f26-4564-9048-17b4df150625 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:20.498546 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-227a781b-9f26-4564-9048-17b4df150625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7af99314b1941b08d57eccedd49a1a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:20.510484 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-227a781b-9f26-4564-9048-17b4df150625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7af99314b1941b08d57eccedd49a1a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:20.511219 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-227a781b-9f26-4564-9048-17b4df150625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7af99314b1941b08d57eccedd49a1a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:20.567316 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-227a781b-9f26-4564-9048-17b4df150625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7af99314b1941b08d57eccedd49a1a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:20.568479 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-227a781b-9f26-4564-9048-17b4df150625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7af99314b1941b08d57eccedd49a1a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:20.582640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1002/2018] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:20 2022] DELETE /identity/v3/users/d7af99314b1941b08d57eccedd49a1a7 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:21.024260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905005b-588b-475a-b150-ec72b46b9b55 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:21.025693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9905005b-588b-475a-b150-ec72b46b9b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:21.039543 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905005b-588b-475a-b150-ec72b46b9b55 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:21.096250 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d85bf-7a51-44ad-9ec9-8503fcb0280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:21.097038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d85bf-7a51-44ad-9ec9-8503fcb0280a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:21.097389 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d85bf-7a51-44ad-9ec9-8503fcb0280a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:21.097673 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d85bf-7a51-44ad-9ec9-8503fcb0280a admin admin] PATH_INFO: `/v3/projects/3d81b35b82194f90b5052f0f6ac2bc90` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:21.098850 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d85bf-7a51-44ad-9ec9-8503fcb0280a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d81b35b82194f90b5052f0f6ac2bc90)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:21.101393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d85bf-7a51-44ad-9ec9-8503fcb0280a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:21.226523 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b22d85bf-7a51-44ad-9ec9-8503fcb0280a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d81b35b82194f90b5052f0f6ac2bc90', 'request_id': 'req-b22d85bf-7a51-44ad-9ec9-8503fcb0280a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:21.234613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b22d85bf-7a51-44ad-9ec9-8503fcb0280a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d81b35b82194f90b5052f0f6ac2bc90', 'request_id': 'req-b22d85bf-7a51-44ad-9ec9-8503fcb0280a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:21.240845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b22d85bf-7a51-44ad-9ec9-8503fcb0280a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d81b35b82194f90b5052f0f6ac2bc90', 'request_id': 'req-b22d85bf-7a51-44ad-9ec9-8503fcb0280a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:21.339178 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b22d85bf-7a51-44ad-9ec9-8503fcb0280a admin admin] The token cache is being invalidate because project 3d81b35b82194f90b5052f0f6ac2bc90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:21.339479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b22d85bf-7a51-44ad-9ec9-8503fcb0280a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:21.340144 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b22d85bf-7a51-44ad-9ec9-8503fcb0280a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:21.341870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1017/2019] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:21 2022] DELETE /identity/v3/projects/3d81b35b82194f90b5052f0f6ac2bc90 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:21.346888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c3123-8c31-4b68-991b-f9f257367ec4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:21.347706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c3123-8c31-4b68-991b-f9f257367ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:21.348326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c3123-8c31-4b68-991b-f9f257367ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:21.375693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7e8c3123-8c31-4b68-991b-f9f257367ec4 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:21.376946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7e8c3123-8c31-4b68-991b-f9f257367ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:21.448274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1003/2020] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:21.457946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf6489-bf96-473a-82a8-783e9d079c8a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:21.461403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf6489-bf96-473a-82a8-783e9d079c8a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:21.461403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf6489-bf96-473a-82a8-783e9d079c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:21.478657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-60bf6489-bf96-473a-82a8-783e9d079c8a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:21.479899 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-60bf6489-bf96-473a-82a8-783e9d079c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:21.489584 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1018/2021] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:21.492609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c3123-8c31-4b68-991b-f9f257367ec4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:21.502358 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c3123-8c31-4b68-991b-f9f257367ec4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:21.507527 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a80de-5df6-4eec-82df-bdcf729660e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:21.508793 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a80de-5df6-4eec-82df-bdcf729660e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:21.509267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a80de-5df6-4eec-82df-bdcf729660e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:21.509544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a80de-5df6-4eec-82df-bdcf729660e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:21.510981 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a80de-5df6-4eec-82df-bdcf729660e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:10:21.511311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a80de-5df6-4eec-82df-bdcf729660e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:21.513305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a80de-5df6-4eec-82df-bdcf729660e8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:21.526025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1004/2022] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:10:21.530476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf6489-bf96-473a-82a8-783e9d079c8a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:21.540363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf6489-bf96-473a-82a8-783e9d079c8a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:21.545416 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214e8e8-fad4-4b07-8dce-821a93706c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:21.546223 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214e8e8-fad4-4b07-8dce-821a93706c32 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:21.546528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214e8e8-fad4-4b07-8dce-821a93706c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:21.546805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214e8e8-fad4-4b07-8dce-821a93706c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:21.547545 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214e8e8-fad4-4b07-8dce-821a93706c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:21.549533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214e8e8-fad4-4b07-8dce-821a93706c32 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:21.643227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1019/2023] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:21 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:21.647445 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a80de-5df6-4eec-82df-bdcf729660e8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:21.657645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a80de-5df6-4eec-82df-bdcf729660e8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:21.717131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70d31d-8af9-4c15-a6d6-588e8cc48208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:21.717818 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70d31d-8af9-4c15-a6d6-588e8cc48208 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:21.718111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70d31d-8af9-4c15-a6d6-588e8cc48208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:21.718371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70d31d-8af9-4c15-a6d6-588e8cc48208 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:21.719073 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70d31d-8af9-4c15-a6d6-588e8cc48208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:21.721011 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70d31d-8af9-4c15-a6d6-588e8cc48208 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:21.815147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1005/2024] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:21 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:21.817626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214e8e8-fad4-4b07-8dce-821a93706c32 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:21.828655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214e8e8-fad4-4b07-8dce-821a93706c32 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:21.833244 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c8350-0aab-4545-a736-9eae1ab431b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:21.833896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c8350-0aab-4545-a736-9eae1ab431b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:21.834181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c8350-0aab-4545-a736-9eae1ab431b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:21.834458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c8350-0aab-4545-a736-9eae1ab431b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:21.835250 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c8350-0aab-4545-a736-9eae1ab431b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:21.836840 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c8350-0aab-4545-a736-9eae1ab431b5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:21.847009 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1020/2025] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:21.855992 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70d31d-8af9-4c15-a6d6-588e8cc48208 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:21.865894 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70d31d-8af9-4c15-a6d6-588e8cc48208 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:21.871274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35243eaf-7058-472a-998f-2f9fd35611de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:21.871932 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35243eaf-7058-472a-998f-2f9fd35611de admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:21.872274 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35243eaf-7058-472a-998f-2f9fd35611de admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:21.872494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35243eaf-7058-472a-998f-2f9fd35611de admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:21.873217 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35243eaf-7058-472a-998f-2f9fd35611de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:21.874848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35243eaf-7058-472a-998f-2f9fd35611de admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:21.885795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1006/2026] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:21.890115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c8350-0aab-4545-a736-9eae1ab431b5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:21.900701 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c8350-0aab-4545-a736-9eae1ab431b5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:21.905539 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd652ef-af4c-423b-a9fe-846533c3b5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:21.906418 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd652ef-af4c-423b-a9fe-846533c3b5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:21.906700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd652ef-af4c-423b-a9fe-846533c3b5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:21.906967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd652ef-af4c-423b-a9fe-846533c3b5b9 admin admin] PATH_INFO: `/v3/projects/bea0d71f0ba14d168d44b6433ad3a341/users/c7eaed71552f4fb4b6780299f35c8318/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:21.922734 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd652ef-af4c-423b-a9fe-846533c3b5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea0d71f0ba14d168d44b6433ad3a341, user_id=c7eaed71552f4fb4b6780299f35c8318, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:21.925396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd652ef-af4c-423b-a9fe-846533c3b5b9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:22.005428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1021/2027] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:21 2022] PUT /identity/v3/projects/bea0d71f0ba14d168d44b6433ad3a341/users/c7eaed71552f4fb4b6780299f35c8318/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:22.011568 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deabbb-4888-4935-a2da-922f0fe48b5a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:22.012015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deabbb-4888-4935-a2da-922f0fe48b5a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:22.012307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deabbb-4888-4935-a2da-922f0fe48b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:22.030819 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-71deabbb-4888-4935-a2da-922f0fe48b5a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:22.032063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-71deabbb-4888-4935-a2da-922f0fe48b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:22.090799 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1007/2028] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:22.100369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd652ef-af4c-423b-a9fe-846533c3b5b9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:22.102685 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-abd652ef-af4c-423b-a9fe-846533c3b5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:22.157446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd652ef-af4c-423b-a9fe-846533c3b5b9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:22.160977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa818b-3428-4842-b2a7-6d13eb7fee67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:22.161613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa818b-3428-4842-b2a7-6d13eb7fee67 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:22.165580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa818b-3428-4842-b2a7-6d13eb7fee67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:22.165580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa818b-3428-4842-b2a7-6d13eb7fee67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:22.171410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa818b-3428-4842-b2a7-6d13eb7fee67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:22.172834 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa818b-3428-4842-b2a7-6d13eb7fee67 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:22.182070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1022/2029] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:23.499764 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a276e-88b5-43ad-9f5f-9b573ef63cd6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:23.500189 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a276e-88b5-43ad-9f5f-9b573ef63cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:23.500425 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a276e-88b5-43ad-9f5f-9b573ef63cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:23.535510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0f0a276e-88b5-43ad-9f5f-9b573ef63cd6 None None] MFA Rules not processed for user `c7eaed71552f4fb4b6780299f35c8318`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:23.537062 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0f0a276e-88b5-43ad-9f5f-9b573ef63cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:23.617367 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1008/2030] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:23.623842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa818b-3428-4842-b2a7-6d13eb7fee67 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:23.634815 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa818b-3428-4842-b2a7-6d13eb7fee67 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:23.641399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88361c9f-85ed-4394-860d-6ab39fe1c8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:23.642062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88361c9f-85ed-4394-860d-6ab39fe1c8be admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:23.642338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88361c9f-85ed-4394-860d-6ab39fe1c8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:23.642804 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88361c9f-85ed-4394-860d-6ab39fe1c8be admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:23.643703 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88361c9f-85ed-4394-860d-6ab39fe1c8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:23.645782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88361c9f-85ed-4394-860d-6ab39fe1c8be admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:23.755163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1023/2031] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:23 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:23.759475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a276e-88b5-43ad-9f5f-9b573ef63cd6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:23.770243 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a276e-88b5-43ad-9f5f-9b573ef63cd6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:23.826840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bac38f-865d-4519-8298-80dd8dd1ba6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:23.827541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bac38f-865d-4519-8298-80dd8dd1ba6d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:23.827819 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bac38f-865d-4519-8298-80dd8dd1ba6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:23.828090 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bac38f-865d-4519-8298-80dd8dd1ba6d admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:23.828785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bac38f-865d-4519-8298-80dd8dd1ba6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:23.830670 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bac38f-865d-4519-8298-80dd8dd1ba6d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:23.939973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1009/2032] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:23 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:23.941777 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88361c9f-85ed-4394-860d-6ab39fe1c8be admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:23.952114 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88361c9f-85ed-4394-860d-6ab39fe1c8be admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:23.956879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f8fc8-d931-4f94-8aa1-8821720081e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:23.957540 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f8fc8-d931-4f94-8aa1-8821720081e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:23.957827 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f8fc8-d931-4f94-8aa1-8821720081e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:23.958100 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f8fc8-d931-4f94-8aa1-8821720081e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:23.958857 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f8fc8-d931-4f94-8aa1-8821720081e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:23.961013 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f8fc8-d931-4f94-8aa1-8821720081e1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:23.971567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1024/2033] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:23.975640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bac38f-865d-4519-8298-80dd8dd1ba6d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:23.986440 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bac38f-865d-4519-8298-80dd8dd1ba6d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:23.990747 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633cd03-8448-47ee-b376-3a5632daa665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:23.991688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633cd03-8448-47ee-b376-3a5632daa665 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:23.991968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633cd03-8448-47ee-b376-3a5632daa665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:23.992243 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633cd03-8448-47ee-b376-3a5632daa665 admin admin] PATH_INFO: `/v3/projects/0a5c9e9a3bb74c7c9733fc44ce01a196/users/9fa39c0cbb46457abf741818f04c3a18/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:24.006418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633cd03-8448-47ee-b376-3a5632daa665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5c9e9a3bb74c7c9733fc44ce01a196, user_id=9fa39c0cbb46457abf741818f04c3a18, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:24.009145 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633cd03-8448-47ee-b376-3a5632daa665 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:24.093327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1010/2034] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:23 2022] PUT /identity/v3/projects/0a5c9e9a3bb74c7c9733fc44ce01a196/users/9fa39c0cbb46457abf741818f04c3a18/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:24.097286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f8fc8-d931-4f94-8aa1-8821720081e1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:24.108397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f8fc8-d931-4f94-8aa1-8821720081e1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:24.166065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791059c-42d2-4843-b2b8-879d86661543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:24.166743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791059c-42d2-4843-b2b8-879d86661543 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:24.167029 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791059c-42d2-4843-b2b8-879d86661543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:24.167365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791059c-42d2-4843-b2b8-879d86661543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:24.168103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791059c-42d2-4843-b2b8-879d86661543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:24.169701 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791059c-42d2-4843-b2b8-879d86661543 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:24.179938 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1025/2035] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:10:24.184486 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633cd03-8448-47ee-b376-3a5632daa665 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:24.195316 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633cd03-8448-47ee-b376-3a5632daa665 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:24.200039 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd27dd-66a6-41b4-8d16-f14fe0886848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:24.200995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd27dd-66a6-41b4-8d16-f14fe0886848 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:24.201349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd27dd-66a6-41b4-8d16-f14fe0886848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:24.201699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd27dd-66a6-41b4-8d16-f14fe0886848 admin admin] PATH_INFO: `/v3/projects/0a5c9e9a3bb74c7c9733fc44ce01a196/users/9fa39c0cbb46457abf741818f04c3a18/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:24.203817 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd27dd-66a6-41b4-8d16-f14fe0886848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5c9e9a3bb74c7c9733fc44ce01a196, user_id=9fa39c0cbb46457abf741818f04c3a18, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:24.206578 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd27dd-66a6-41b4-8d16-f14fe0886848 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:24.217491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1011/2036] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:24 2022] PUT /identity/v3/projects/0a5c9e9a3bb74c7c9733fc44ce01a196/users/9fa39c0cbb46457abf741818f04c3a18/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:25.397001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96990491-8f67-4992-8a32-4ba4724d98b8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:25.398847 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96990491-8f67-4992-8a32-4ba4724d98b8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:25.399226 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96990491-8f67-4992-8a32-4ba4724d98b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:25.428332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-96990491-8f67-4992-8a32-4ba4724d98b8 None None] MFA Rules not processed for user `9fa39c0cbb46457abf741818f04c3a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:25.430151 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-96990491-8f67-4992-8a32-4ba4724d98b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:25.499429 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1026/2037] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:25.511275 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd27dd-66a6-41b4-8d16-f14fe0886848 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:25.512968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4edd27dd-66a6-41b4-8d16-f14fe0886848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:25.570525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd27dd-66a6-41b4-8d16-f14fe0886848 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:25.574150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b41be8-270b-4b61-946a-5fbd8876fac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:25.574794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b41be8-270b-4b61-946a-5fbd8876fac1 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:25.575076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b41be8-270b-4b61-946a-5fbd8876fac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:25.575397 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b41be8-270b-4b61-946a-5fbd8876fac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:25.632402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b41be8-270b-4b61-946a-5fbd8876fac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:25.633771 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b41be8-270b-4b61-946a-5fbd8876fac1 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:25.642478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1012/2038] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:28.407604 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96990491-8f67-4992-8a32-4ba4724d98b8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:28.417476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96990491-8f67-4992-8a32-4ba4724d98b8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:28.420990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fdeef-e5df-458b-9678-13be7a9453e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:28.421653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fdeef-e5df-458b-9678-13be7a9453e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:28.421931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fdeef-e5df-458b-9678-13be7a9453e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:28.422204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fdeef-e5df-458b-9678-13be7a9453e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:28.431938 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fdeef-e5df-458b-9678-13be7a9453e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:28.433366 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fdeef-e5df-458b-9678-13be7a9453e3 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:28.442924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1027/2039] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:36.683335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b41be8-270b-4b61-946a-5fbd8876fac1 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:36.686215 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-46b41be8-270b-4b61-946a-5fbd8876fac1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:36.756721 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b41be8-270b-4b61-946a-5fbd8876fac1 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:36.763084 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8d22c-74c6-429c-949f-a36cb56f82ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:36.764002 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8d22c-74c6-429c-949f-a36cb56f82ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:36.764351 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8d22c-74c6-429c-949f-a36cb56f82ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:36.765357 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8d22c-74c6-429c-949f-a36cb56f82ce admin admin] PATH_INFO: `/v3/users/17d907d673fd440b97aad2bd2b811461` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:36.766767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8d22c-74c6-429c-949f-a36cb56f82ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d907d673fd440b97aad2bd2b811461)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:36.768954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8d22c-74c6-429c-949f-a36cb56f82ce admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:37.024037 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-38b8d22c-74c6-429c-949f-a36cb56f82ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d907d673fd440b97aad2bd2b811461'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:37.037074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-38b8d22c-74c6-429c-949f-a36cb56f82ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d907d673fd440b97aad2bd2b811461'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:37.038011 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-38b8d22c-74c6-429c-949f-a36cb56f82ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d907d673fd440b97aad2bd2b811461'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:37.127119 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-38b8d22c-74c6-429c-949f-a36cb56f82ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d907d673fd440b97aad2bd2b811461'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:37.127871 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-38b8d22c-74c6-429c-949f-a36cb56f82ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d907d673fd440b97aad2bd2b811461'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:37.144483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1013/2040] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:36 2022] DELETE /identity/v3/users/17d907d673fd440b97aad2bd2b811461 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:37.146724 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb8a2e-4f99-4664-b02d-89eda14bc5a0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:37.147217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb8a2e-4f99-4664-b02d-89eda14bc5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:37.147391 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb8a2e-4f99-4664-b02d-89eda14bc5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:37.165994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-26eb8a2e-4f99-4664-b02d-89eda14bc5a0 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:37.168174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-26eb8a2e-4f99-4664-b02d-89eda14bc5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:37.229127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1028/2041] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:37.238935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8d22c-74c6-429c-949f-a36cb56f82ce admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:37.240363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-38b8d22c-74c6-429c-949f-a36cb56f82ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:37.300100 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8d22c-74c6-429c-949f-a36cb56f82ce admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:37.304815 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e50c8-491c-467d-b7aa-2b9699f3f71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:37.305613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e50c8-491c-467d-b7aa-2b9699f3f71e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:37.306017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e50c8-491c-467d-b7aa-2b9699f3f71e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:37.306307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e50c8-491c-467d-b7aa-2b9699f3f71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:37.316279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e50c8-491c-467d-b7aa-2b9699f3f71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:37.317696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e50c8-491c-467d-b7aa-2b9699f3f71e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:37.327078 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1014/2042] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:37.805768 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb8a2e-4f99-4664-b02d-89eda14bc5a0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:37.807458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-26eb8a2e-4f99-4664-b02d-89eda14bc5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:37.822519 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb8a2e-4f99-4664-b02d-89eda14bc5a0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:37.828098 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0425e-892a-47d9-9d69-2e92bebccbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:37.829382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0425e-892a-47d9-9d69-2e92bebccbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:37.829741 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0425e-892a-47d9-9d69-2e92bebccbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:37.830023 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0425e-892a-47d9-9d69-2e92bebccbd7 admin admin] PATH_INFO: `/v3/projects/db26ebb6129c4f92866f56f78965a661` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:37.832346 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0425e-892a-47d9-9d69-2e92bebccbd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db26ebb6129c4f92866f56f78965a661)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:37.836037 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0425e-892a-47d9-9d69-2e92bebccbd7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:37.976539 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-12f0425e-892a-47d9-9d69-2e92bebccbd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db26ebb6129c4f92866f56f78965a661', 'request_id': 'req-12f0425e-892a-47d9-9d69-2e92bebccbd7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:37.983077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-12f0425e-892a-47d9-9d69-2e92bebccbd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db26ebb6129c4f92866f56f78965a661', 'request_id': 'req-12f0425e-892a-47d9-9d69-2e92bebccbd7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:37.989312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-12f0425e-892a-47d9-9d69-2e92bebccbd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db26ebb6129c4f92866f56f78965a661', 'request_id': 'req-12f0425e-892a-47d9-9d69-2e92bebccbd7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:38.092629 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-12f0425e-892a-47d9-9d69-2e92bebccbd7 admin admin] The token cache is being invalidate because project db26ebb6129c4f92866f56f78965a661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:38.092936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-12f0425e-892a-47d9-9d69-2e92bebccbd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:38.095781 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-12f0425e-892a-47d9-9d69-2e92bebccbd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:38.095781 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1029/2043] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:37 2022] DELETE /identity/v3/projects/db26ebb6129c4f92866f56f78965a661 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:38.099196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e50c8-491c-467d-b7aa-2b9699f3f71e service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:38.111058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e50c8-491c-467d-b7aa-2b9699f3f71e service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:38.182599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afc4fd-508a-497e-a466-b4f6eb2b8885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:38.182599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afc4fd-508a-497e-a466-b4f6eb2b8885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:38.182599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afc4fd-508a-497e-a466-b4f6eb2b8885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:38.182599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afc4fd-508a-497e-a466-b4f6eb2b8885 admin admin] PATH_INFO: `/v3/users/164824868c6e4dfabe27059bcf4bee54` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:38.182970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afc4fd-508a-497e-a466-b4f6eb2b8885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=164824868c6e4dfabe27059bcf4bee54)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:38.183186 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afc4fd-508a-497e-a466-b4f6eb2b8885 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:38.229454 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164c23d-2deb-4796-a1bc-15a9a1fae7bd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:38.229948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164c23d-2deb-4796-a1bc-15a9a1fae7bd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:38.230054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164c23d-2deb-4796-a1bc-15a9a1fae7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:38.250837 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7164c23d-2deb-4796-a1bc-15a9a1fae7bd None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:38.252035 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7164c23d-2deb-4796-a1bc-15a9a1fae7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:38.308264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1030/2044] 10.222.0.24 () {58 vars in 1009 bytes} [Tue May 17 22:10:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:38.360657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164c23d-2deb-4796-a1bc-15a9a1fae7bd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:38.362101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7164c23d-2deb-4796-a1bc-15a9a1fae7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:38.373726 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21afc4fd-508a-497e-a466-b4f6eb2b8885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '164824868c6e4dfabe27059bcf4bee54'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:38.386112 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21afc4fd-508a-497e-a466-b4f6eb2b8885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '164824868c6e4dfabe27059bcf4bee54'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:38.386962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21afc4fd-508a-497e-a466-b4f6eb2b8885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '164824868c6e4dfabe27059bcf4bee54'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:38.431179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164c23d-2deb-4796-a1bc-15a9a1fae7bd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:38.438039 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee22b0-ecd3-4f6e-92c7-26eb98065a31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:38.438681 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee22b0-ecd3-4f6e-92c7-26eb98065a31 service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:38.438958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee22b0-ecd3-4f6e-92c7-26eb98065a31 service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:38.439269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee22b0-ecd3-4f6e-92c7-26eb98065a31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:38.441184 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b6ee22b0-ecd3-4f6e-92c7-26eb98065a31 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:38.452754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee22b0-ecd3-4f6e-92c7-26eb98065a31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:38.454338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee22b0-ecd3-4f6e-92c7-26eb98065a31 service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:38.458531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21afc4fd-508a-497e-a466-b4f6eb2b8885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '164824868c6e4dfabe27059bcf4bee54'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:38.464883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-21afc4fd-508a-497e-a466-b4f6eb2b8885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '164824868c6e4dfabe27059bcf4bee54'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:38.471383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1031/2045] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:10:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 22:10:38.473557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1015/2046] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:38 2022] DELETE /identity/v3/users/164824868c6e4dfabe27059bcf4bee54 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:38.996527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee22b0-ecd3-4f6e-92c7-26eb98065a31 service swift] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:38.998373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b6ee22b0-ecd3-4f6e-92c7-26eb98065a31 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:39.089129 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee22b0-ecd3-4f6e-92c7-26eb98065a31 service swift] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:39.150751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc9956-e009-40be-b5a3-86ba223221ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:39.151660 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc9956-e009-40be-b5a3-86ba223221ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:39.151939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc9956-e009-40be-b5a3-86ba223221ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:39.152237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc9956-e009-40be-b5a3-86ba223221ea admin admin] PATH_INFO: `/v3/projects/d9c46e65e7264cd49a156213c179e89d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:39.153390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc9956-e009-40be-b5a3-86ba223221ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9c46e65e7264cd49a156213c179e89d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:39.155521 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc9956-e009-40be-b5a3-86ba223221ea admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:39.277293 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-72fc9956-e009-40be-b5a3-86ba223221ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9c46e65e7264cd49a156213c179e89d', 'request_id': 'req-72fc9956-e009-40be-b5a3-86ba223221ea'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:39.283535 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-72fc9956-e009-40be-b5a3-86ba223221ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9c46e65e7264cd49a156213c179e89d', 'request_id': 'req-72fc9956-e009-40be-b5a3-86ba223221ea'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:39.289893 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-72fc9956-e009-40be-b5a3-86ba223221ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9c46e65e7264cd49a156213c179e89d', 'request_id': 'req-72fc9956-e009-40be-b5a3-86ba223221ea'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:39.411491 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-72fc9956-e009-40be-b5a3-86ba223221ea admin admin] The token cache is being invalidate because project d9c46e65e7264cd49a156213c179e89d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:39.411968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-72fc9956-e009-40be-b5a3-86ba223221ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:39.412745 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-72fc9956-e009-40be-b5a3-86ba223221ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:39.414843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1032/2047] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:38 2022] DELETE /identity/v3/projects/d9c46e65e7264cd49a156213c179e89d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:39.419860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50bc8b-1088-4b06-85ef-6ef42adb2b5f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:39.420364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50bc8b-1088-4b06-85ef-6ef42adb2b5f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:39.420466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50bc8b-1088-4b06-85ef-6ef42adb2b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:39.433592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4000-40a8-4805-b6b4-c606a1f70fdc None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:39.434139 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4000-40a8-4805-b6b4-c606a1f70fdc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:39.434472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4000-40a8-4805-b6b4-c606a1f70fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:39.464171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2f0a4000-40a8-4805-b6b4-c606a1f70fdc None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:39.465382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2f0a4000-40a8-4805-b6b4-c606a1f70fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:39.478485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ad50bc8b-1088-4b06-85ef-6ef42adb2b5f None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:39.479915 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ad50bc8b-1088-4b06-85ef-6ef42adb2b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:39.551906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1033/2048] 10.222.0.24 () {58 vars in 967 bytes} [Tue May 17 22:10:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:39.563025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1016/2049] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:39.565418 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b32769-30e7-4bd3-ba44-5c069524e345 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:39.565737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50bc8b-1088-4b06-85ef-6ef42adb2b5f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:39.565919 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b32769-30e7-4bd3-ba44-5c069524e345 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:39.566202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b32769-30e7-4bd3-ba44-5c069524e345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:39.567124 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ad50bc8b-1088-4b06-85ef-6ef42adb2b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:39.585770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-80b32769-30e7-4bd3-ba44-5c069524e345 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:39.587086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-80b32769-30e7-4bd3-ba44-5c069524e345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:39.595511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1034/2050] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:39.599479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b32769-30e7-4bd3-ba44-5c069524e345 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:39.609541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b32769-30e7-4bd3-ba44-5c069524e345 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:39.614562 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d97669-9f7c-45c7-8cc5-a1dfc3fd33de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:39.615259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d97669-9f7c-45c7-8cc5-a1dfc3fd33de admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:39.615530 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d97669-9f7c-45c7-8cc5-a1dfc3fd33de admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:39.616365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d97669-9f7c-45c7-8cc5-a1dfc3fd33de admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:39.617088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d97669-9f7c-45c7-8cc5-a1dfc3fd33de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:10:39.617389 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d97669-9f7c-45c7-8cc5-a1dfc3fd33de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:39.618971 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d97669-9f7c-45c7-8cc5-a1dfc3fd33de admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:39.631282 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1035/2051] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:10:39.635588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d97669-9f7c-45c7-8cc5-a1dfc3fd33de admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:39.640989 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50bc8b-1088-4b06-85ef-6ef42adb2b5f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:39.644879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d97669-9f7c-45c7-8cc5-a1dfc3fd33de admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:39.646121 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1467f3b-3064-43e8-a178-92a654af8e68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:39.646802 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1467f3b-3064-43e8-a178-92a654af8e68 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:39.648050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1467f3b-3064-43e8-a178-92a654af8e68 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:39.648328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1467f3b-3064-43e8-a178-92a654af8e68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:39.650149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca20f7c-40c5-4318-b682-6b63f109c712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:39.650824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca20f7c-40c5-4318-b682-6b63f109c712 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:39.651055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca20f7c-40c5-4318-b682-6b63f109c712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:39.651362 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca20f7c-40c5-4318-b682-6b63f109c712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:39.652030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca20f7c-40c5-4318-b682-6b63f109c712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:39.653894 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca20f7c-40c5-4318-b682-6b63f109c712 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:39.656571 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1467f3b-3064-43e8-a178-92a654af8e68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:39.658171 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1467f3b-3064-43e8-a178-92a654af8e68 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:39.666406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1017/2052] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:10:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 22:10:39.733238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1036/2053] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:39 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:10:39.736849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1467f3b-3064-43e8-a178-92a654af8e68 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:39.748709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1467f3b-3064-43e8-a178-92a654af8e68 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:39.809322 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b8f71-03c2-4c7c-9531-16a71746ed0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:39.809985 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b8f71-03c2-4c7c-9531-16a71746ed0d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:39.810268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b8f71-03c2-4c7c-9531-16a71746ed0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:39.810544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b8f71-03c2-4c7c-9531-16a71746ed0d admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:39.811279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b8f71-03c2-4c7c-9531-16a71746ed0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:39.813159 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b8f71-03c2-4c7c-9531-16a71746ed0d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:39.916602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1018/2054] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:39 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:39.920694 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca20f7c-40c5-4318-b682-6b63f109c712 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:39.931728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca20f7c-40c5-4318-b682-6b63f109c712 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:39.946115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52c2de-6f7b-48d0-8e5b-765fb5985906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:39.948549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52c2de-6f7b-48d0-8e5b-765fb5985906 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:39.948549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52c2de-6f7b-48d0-8e5b-765fb5985906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:39.948549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52c2de-6f7b-48d0-8e5b-765fb5985906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:39.948549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52c2de-6f7b-48d0-8e5b-765fb5985906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:39.949769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52c2de-6f7b-48d0-8e5b-765fb5985906 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:39.963480 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1037/2055] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:39.964721 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b8f71-03c2-4c7c-9531-16a71746ed0d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:39.975655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b8f71-03c2-4c7c-9531-16a71746ed0d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:39.986458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3c9a9-53a2-4aa2-a1c2-5438dbc860eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:39.986458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3c9a9-53a2-4aa2-a1c2-5438dbc860eb admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:39.986458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3c9a9-53a2-4aa2-a1c2-5438dbc860eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:39.986458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3c9a9-53a2-4aa2-a1c2-5438dbc860eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:39.986833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3c9a9-53a2-4aa2-a1c2-5438dbc860eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:39.986833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3c9a9-53a2-4aa2-a1c2-5438dbc860eb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:39.996211 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1019/2056] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:40.000317 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52c2de-6f7b-48d0-8e5b-765fb5985906 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:40.010296 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52c2de-6f7b-48d0-8e5b-765fb5985906 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:40.014843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074f867-a806-475d-94ba-ecbe4f5c2495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:40.015738 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074f867-a806-475d-94ba-ecbe4f5c2495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:40.016013 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074f867-a806-475d-94ba-ecbe4f5c2495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:40.016287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074f867-a806-475d-94ba-ecbe4f5c2495 admin admin] PATH_INFO: `/v3/projects/71951135b0b2410ba4bb940b21880170/users/19b93a5b3ef04336a25adc168925b221/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:40.035226 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074f867-a806-475d-94ba-ecbe4f5c2495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71951135b0b2410ba4bb940b21880170, user_id=19b93a5b3ef04336a25adc168925b221, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:40.038445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074f867-a806-475d-94ba-ecbe4f5c2495 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:40.104962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1038/2057] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:39 2022] PUT /identity/v3/projects/71951135b0b2410ba4bb940b21880170/users/19b93a5b3ef04336a25adc168925b221/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:40.116813 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17395fb9-7857-47d1-b8f3-8a5e8c37e7c4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:40.117118 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17395fb9-7857-47d1-b8f3-8a5e8c37e7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:40.117394 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17395fb9-7857-47d1-b8f3-8a5e8c37e7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:40.151912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-17395fb9-7857-47d1-b8f3-8a5e8c37e7c4 None None] MFA Rules not processed for user `19b93a5b3ef04336a25adc168925b221`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:40.153156 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-17395fb9-7857-47d1-b8f3-8a5e8c37e7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:40.215590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1020/2058] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:40.219992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074f867-a806-475d-94ba-ecbe4f5c2495 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:40.252460 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ce521-4cc4-47ed-b31c-46dd8e0362ee None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:40.252755 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ce521-4cc4-47ed-b31c-46dd8e0362ee None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:40.253039 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ce521-4cc4-47ed-b31c-46dd8e0362ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:40.273655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e74ce521-4cc4-47ed-b31c-46dd8e0362ee None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:40.273655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e74ce521-4cc4-47ed-b31c-46dd8e0362ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:40.282465 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074f867-a806-475d-94ba-ecbe4f5c2495 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:40.288726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb2864-dd16-4b5c-beb4-86927467e052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:40.289748 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb2864-dd16-4b5c-beb4-86927467e052 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:40.290034 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb2864-dd16-4b5c-beb4-86927467e052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:40.290309 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb2864-dd16-4b5c-beb4-86927467e052 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:40.291149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb2864-dd16-4b5c-beb4-86927467e052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:40.293073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb2864-dd16-4b5c-beb4-86927467e052 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:40.335497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1021/2059] 10.222.0.24 () {58 vars in 1009 bytes} [Tue May 17 22:10:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:40.346872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ce521-4cc4-47ed-b31c-46dd8e0362ee None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:40.410448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1039/2060] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:40 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:40.416058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb2864-dd16-4b5c-beb4-86927467e052 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:40.417391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ce521-4cc4-47ed-b31c-46dd8e0362ee None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:40.478492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb2864-dd16-4b5c-beb4-86927467e052 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:40.478943 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a801bab-50af-41ce-8f16-51a6e9c7859f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:40.479637 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a801bab-50af-41ce-8f16-51a6e9c7859f service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:40.479919 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a801bab-50af-41ce-8f16-51a6e9c7859f service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:40.480196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a801bab-50af-41ce-8f16-51a6e9c7859f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:40.483138 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35012d81-d0f6-43c4-85d8-5e9475449a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:40.483798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35012d81-d0f6-43c4-85d8-5e9475449a00 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:40.484082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35012d81-d0f6-43c4-85d8-5e9475449a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:40.484354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35012d81-d0f6-43c4-85d8-5e9475449a00 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:40.485055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35012d81-d0f6-43c4-85d8-5e9475449a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:40.486972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35012d81-d0f6-43c4-85d8-5e9475449a00 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:40.534213 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a801bab-50af-41ce-8f16-51a6e9c7859f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:40.535853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a801bab-50af-41ce-8f16-51a6e9c7859f service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:40.545016 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1022/2061] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:10:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 22:10:40.567361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1040/2062] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:40 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:10:40.571306 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a801bab-50af-41ce-8f16-51a6e9c7859f service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:40.581554 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a801bab-50af-41ce-8f16-51a6e9c7859f service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:40.587315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d4607-8e94-406a-848d-7e6e805041fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:40.587839 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d4607-8e94-406a-848d-7e6e805041fb admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:40.588125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d4607-8e94-406a-848d-7e6e805041fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:40.588406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d4607-8e94-406a-848d-7e6e805041fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:40.589142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d4607-8e94-406a-848d-7e6e805041fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:40.590769 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d4607-8e94-406a-848d-7e6e805041fb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:40.602085 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1023/2063] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:40.606287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35012d81-d0f6-43c4-85d8-5e9475449a00 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:40.617049 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35012d81-d0f6-43c4-85d8-5e9475449a00 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:40.621661 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e320287-b1d3-476a-b6f6-e92b3bf447c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:40.622605 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e320287-b1d3-476a-b6f6-e92b3bf447c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:40.622799 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e320287-b1d3-476a-b6f6-e92b3bf447c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:40.623240 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e320287-b1d3-476a-b6f6-e92b3bf447c8 admin admin] PATH_INFO: `/v3/projects/48f65a81f4104caeb7a471f2a55022e4/users/763d8d82d8b64aa08d62d74a69353ab2/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:40.638735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e320287-b1d3-476a-b6f6-e92b3bf447c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f65a81f4104caeb7a471f2a55022e4, user_id=763d8d82d8b64aa08d62d74a69353ab2, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:40.641450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e320287-b1d3-476a-b6f6-e92b3bf447c8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:40.727942 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1041/2064] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:40 2022] PUT /identity/v3/projects/48f65a81f4104caeb7a471f2a55022e4/users/763d8d82d8b64aa08d62d74a69353ab2/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:40.732124 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d4607-8e94-406a-848d-7e6e805041fb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:40.742923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d4607-8e94-406a-848d-7e6e805041fb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:40.799067 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd894973-f13e-4c37-981e-438119364738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:40.799778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd894973-f13e-4c37-981e-438119364738 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:40.800053 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd894973-f13e-4c37-981e-438119364738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:40.800325 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd894973-f13e-4c37-981e-438119364738 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:40.801045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd894973-f13e-4c37-981e-438119364738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:40.802615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd894973-f13e-4c37-981e-438119364738 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:40.813427 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1024/2065] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:40.817643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e320287-b1d3-476a-b6f6-e92b3bf447c8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:40.828184 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e320287-b1d3-476a-b6f6-e92b3bf447c8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:40.832726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa29e64-8ef8-4145-892a-54d57a57d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:40.833590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa29e64-8ef8-4145-892a-54d57a57d7b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:40.833861 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa29e64-8ef8-4145-892a-54d57a57d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:40.834131 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa29e64-8ef8-4145-892a-54d57a57d7b1 admin admin] PATH_INFO: `/v3/projects/48f65a81f4104caeb7a471f2a55022e4/users/763d8d82d8b64aa08d62d74a69353ab2/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:40.836284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa29e64-8ef8-4145-892a-54d57a57d7b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f65a81f4104caeb7a471f2a55022e4, user_id=763d8d82d8b64aa08d62d74a69353ab2, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:40.838914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa29e64-8ef8-4145-892a-54d57a57d7b1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:40.849071 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1042/2066] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:40 2022] PUT /identity/v3/projects/48f65a81f4104caeb7a471f2a55022e4/users/763d8d82d8b64aa08d62d74a69353ab2/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:40.859733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee8aba-6f4b-4ac3-9758-1bf46401ea85 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:40.860029 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee8aba-6f4b-4ac3-9758-1bf46401ea85 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:40.860310 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee8aba-6f4b-4ac3-9758-1bf46401ea85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:40.891167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-07ee8aba-6f4b-4ac3-9758-1bf46401ea85 None None] MFA Rules not processed for user `763d8d82d8b64aa08d62d74a69353ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:40.891167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-07ee8aba-6f4b-4ac3-9758-1bf46401ea85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:40.972828 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1025/2067] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:40.984700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa29e64-8ef8-4145-892a-54d57a57d7b1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:40.987050 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5fa29e64-8ef8-4145-892a-54d57a57d7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:41.045543 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa29e64-8ef8-4145-892a-54d57a57d7b1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:41.049293 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e7fbe-96ff-49b7-b5f6-64f6df9191a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:41.050046 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e7fbe-96ff-49b7-b5f6-64f6df9191a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:41.050313 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e7fbe-96ff-49b7-b5f6-64f6df9191a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:41.050602 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e7fbe-96ff-49b7-b5f6-64f6df9191a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:41.061070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e7fbe-96ff-49b7-b5f6-64f6df9191a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:41.062518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e7fbe-96ff-49b7-b5f6-64f6df9191a1 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:41.072079 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1043/2068] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:41.111258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4c9a3-a4ad-4a18-842a-1a3e37940b78 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:41.111585 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4c9a3-a4ad-4a18-842a-1a3e37940b78 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:41.111824 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4c9a3-a4ad-4a18-842a-1a3e37940b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:41.134911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-12a4c9a3-a4ad-4a18-842a-1a3e37940b78 None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:41.135652 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e7fbe-96ff-49b7-b5f6-64f6df9191a1 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:41.136110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-12a4c9a3-a4ad-4a18-842a-1a3e37940b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:41.191388 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1026/2069] 10.222.0.24 () {58 vars in 967 bytes} [Tue May 17 22:10:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:41.198430 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e7fbe-96ff-49b7-b5f6-64f6df9191a1 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:41.203914 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4c9a3-a4ad-4a18-842a-1a3e37940b78 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:41.204315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014794e-bdb9-401b-bc69-fe83ee2a1045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:41.205233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014794e-bdb9-401b-bc69-fe83ee2a1045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:41.205516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014794e-bdb9-401b-bc69-fe83ee2a1045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:41.205790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014794e-bdb9-401b-bc69-fe83ee2a1045 admin admin] PATH_INFO: `/v3/users/19b93a5b3ef04336a25adc168925b221` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:41.207002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014794e-bdb9-401b-bc69-fe83ee2a1045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b93a5b3ef04336a25adc168925b221)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:41.208956 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014794e-bdb9-401b-bc69-fe83ee2a1045 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:41.270198 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4c9a3-a4ad-4a18-842a-1a3e37940b78 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:41.275814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de16ab-ad9b-4f67-9993-053992d29723 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:41.276486 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de16ab-ad9b-4f67-9993-053992d29723 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:41.276767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de16ab-ad9b-4f67-9993-053992d29723 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:41.277039 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de16ab-ad9b-4f67-9993-053992d29723 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:41.285085 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de16ab-ad9b-4f67-9993-053992d29723 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:41.286660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de16ab-ad9b-4f67-9993-053992d29723 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:41.295654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1027/2070] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:10:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 22:10:41.429412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0014794e-bdb9-401b-bc69-fe83ee2a1045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b93a5b3ef04336a25adc168925b221'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:41.441120 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0014794e-bdb9-401b-bc69-fe83ee2a1045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b93a5b3ef04336a25adc168925b221'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:41.550040 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0014794e-bdb9-401b-bc69-fe83ee2a1045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b93a5b3ef04336a25adc168925b221'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:41.550942 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0014794e-bdb9-401b-bc69-fe83ee2a1045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b93a5b3ef04336a25adc168925b221'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:41.551568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0014794e-bdb9-401b-bc69-fe83ee2a1045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b93a5b3ef04336a25adc168925b221'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:41.566162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1044/2071] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:41 2022] DELETE /identity/v3/users/19b93a5b3ef04336a25adc168925b221 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:41.571159 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee1e65-2c0d-47e8-88f5-d20699640ad2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:41.571631 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee1e65-2c0d-47e8-88f5-d20699640ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:41.571762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee1e65-2c0d-47e8-88f5-d20699640ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:41.589376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-38ee1e65-2c0d-47e8-88f5-d20699640ad2 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:41.590625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-38ee1e65-2c0d-47e8-88f5-d20699640ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:41.652862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1028/2072] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:41.662766 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014794e-bdb9-401b-bc69-fe83ee2a1045 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:41.664391 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0014794e-bdb9-401b-bc69-fe83ee2a1045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:41.746255 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014794e-bdb9-401b-bc69-fe83ee2a1045 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:41.749917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729df4dd-eef6-4058-9645-0c97cb17c757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:41.750556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729df4dd-eef6-4058-9645-0c97cb17c757 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:41.750835 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729df4dd-eef6-4058-9645-0c97cb17c757 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:41.751165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729df4dd-eef6-4058-9645-0c97cb17c757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:41.765962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729df4dd-eef6-4058-9645-0c97cb17c757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:41.768074 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729df4dd-eef6-4058-9645-0c97cb17c757 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:41.781807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1045/2073] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:42.227441 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee1e65-2c0d-47e8-88f5-d20699640ad2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:42.227441 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-38ee1e65-2c0d-47e8-88f5-d20699640ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:42.239587 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee1e65-2c0d-47e8-88f5-d20699640ad2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:42.245739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2855a-49a8-431b-b6ab-3552c0346e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:42.246583 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2855a-49a8-431b-b6ab-3552c0346e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:42.246862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2855a-49a8-431b-b6ab-3552c0346e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:42.247279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2855a-49a8-431b-b6ab-3552c0346e8d admin admin] PATH_INFO: `/v3/projects/71951135b0b2410ba4bb940b21880170` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:42.248527 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2855a-49a8-431b-b6ab-3552c0346e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=71951135b0b2410ba4bb940b21880170)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:42.250649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2855a-49a8-431b-b6ab-3552c0346e8d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:42.390311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9fb2855a-49a8-431b-b6ab-3552c0346e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71951135b0b2410ba4bb940b21880170', 'request_id': 'req-9fb2855a-49a8-431b-b6ab-3552c0346e8d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:42.481112 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9fb2855a-49a8-431b-b6ab-3552c0346e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71951135b0b2410ba4bb940b21880170', 'request_id': 'req-9fb2855a-49a8-431b-b6ab-3552c0346e8d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:42.489503 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9fb2855a-49a8-431b-b6ab-3552c0346e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71951135b0b2410ba4bb940b21880170', 'request_id': 'req-9fb2855a-49a8-431b-b6ab-3552c0346e8d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:42.499566 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9fb2855a-49a8-431b-b6ab-3552c0346e8d admin admin] The token cache is being invalidate because project 71951135b0b2410ba4bb940b21880170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:42.499906 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9fb2855a-49a8-431b-b6ab-3552c0346e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:42.500620 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9fb2855a-49a8-431b-b6ab-3552c0346e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:42.502261 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1029/2074] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:42 2022] DELETE /identity/v3/projects/71951135b0b2410ba4bb940b21880170 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:42.506896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729df4dd-eef6-4058-9645-0c97cb17c757 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:42.517396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729df4dd-eef6-4058-9645-0c97cb17c757 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:42.587575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727a9b7-80c4-44c9-8bb1-16080cb6aa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:42.588408 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727a9b7-80c4-44c9-8bb1-16080cb6aa33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:42.588717 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727a9b7-80c4-44c9-8bb1-16080cb6aa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:42.588970 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727a9b7-80c4-44c9-8bb1-16080cb6aa33 admin admin] PATH_INFO: `/v3/users/763d8d82d8b64aa08d62d74a69353ab2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:42.590165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727a9b7-80c4-44c9-8bb1-16080cb6aa33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=763d8d82d8b64aa08d62d74a69353ab2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:42.592180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727a9b7-80c4-44c9-8bb1-16080cb6aa33 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:42.781319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7727a9b7-80c4-44c9-8bb1-16080cb6aa33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763d8d82d8b64aa08d62d74a69353ab2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:42.793928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7727a9b7-80c4-44c9-8bb1-16080cb6aa33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763d8d82d8b64aa08d62d74a69353ab2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:42.864156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7727a9b7-80c4-44c9-8bb1-16080cb6aa33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763d8d82d8b64aa08d62d74a69353ab2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:42.864794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7727a9b7-80c4-44c9-8bb1-16080cb6aa33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763d8d82d8b64aa08d62d74a69353ab2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:42.865398 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7727a9b7-80c4-44c9-8bb1-16080cb6aa33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763d8d82d8b64aa08d62d74a69353ab2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:42.878723 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1046/2075] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:42 2022] DELETE /identity/v3/users/763d8d82d8b64aa08d62d74a69353ab2 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:43.401825 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2855a-49a8-431b-b6ab-3552c0346e8d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:43.404139 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9fb2855a-49a8-431b-b6ab-3552c0346e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:43.423743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2855a-49a8-431b-b6ab-3552c0346e8d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:43.480437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50125044-51dc-4cb2-99b2-5eb64180d767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:43.481297 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50125044-51dc-4cb2-99b2-5eb64180d767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:43.481579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50125044-51dc-4cb2-99b2-5eb64180d767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:43.481855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50125044-51dc-4cb2-99b2-5eb64180d767 admin admin] PATH_INFO: `/v3/projects/48f65a81f4104caeb7a471f2a55022e4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:43.483030 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50125044-51dc-4cb2-99b2-5eb64180d767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f65a81f4104caeb7a471f2a55022e4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:43.484943 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50125044-51dc-4cb2-99b2-5eb64180d767 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:43.602869 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-50125044-51dc-4cb2-99b2-5eb64180d767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f65a81f4104caeb7a471f2a55022e4', 'request_id': 'req-50125044-51dc-4cb2-99b2-5eb64180d767'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:43.678609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-50125044-51dc-4cb2-99b2-5eb64180d767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f65a81f4104caeb7a471f2a55022e4', 'request_id': 'req-50125044-51dc-4cb2-99b2-5eb64180d767'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:43.684851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-50125044-51dc-4cb2-99b2-5eb64180d767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f65a81f4104caeb7a471f2a55022e4', 'request_id': 'req-50125044-51dc-4cb2-99b2-5eb64180d767'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:43.695974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-50125044-51dc-4cb2-99b2-5eb64180d767 admin admin] The token cache is being invalidate because project 48f65a81f4104caeb7a471f2a55022e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:43.696264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-50125044-51dc-4cb2-99b2-5eb64180d767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:43.697565 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-50125044-51dc-4cb2-99b2-5eb64180d767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:43.699138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1030/2076] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:43 2022] DELETE /identity/v3/projects/48f65a81f4104caeb7a471f2a55022e4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:43.704233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9109a-aa25-461e-acb2-9ef6ef664997 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:43.704724 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9109a-aa25-461e-acb2-9ef6ef664997 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:43.704836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9109a-aa25-461e-acb2-9ef6ef664997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:43.723761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1bb9109a-aa25-461e-acb2-9ef6ef664997 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:43.724934 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1bb9109a-aa25-461e-acb2-9ef6ef664997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:43.784469 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1047/2077] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:43.792695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363be44-d121-480f-b29a-7a36dcf99bf4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:43.792943 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363be44-d121-480f-b29a-7a36dcf99bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:43.793349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363be44-d121-480f-b29a-7a36dcf99bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:43.811709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c363be44-d121-480f-b29a-7a36dcf99bf4 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:43.812909 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c363be44-d121-480f-b29a-7a36dcf99bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:43.821070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1031/2078] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:43.825927 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9109a-aa25-461e-acb2-9ef6ef664997 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:43.835695 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9109a-aa25-461e-acb2-9ef6ef664997 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:43.840501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72c310-2d98-4fe6-b853-2d24e404f589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:43.841142 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c310-2d98-4fe6-b853-2d24e404f589 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:43.841424 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c310-2d98-4fe6-b853-2d24e404f589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:43.841698 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c310-2d98-4fe6-b853-2d24e404f589 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:43.842419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72c310-2d98-4fe6-b853-2d24e404f589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:10:43.842725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72c310-2d98-4fe6-b853-2d24e404f589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:43.844356 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72c310-2d98-4fe6-b853-2d24e404f589 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:43.856377 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1048/2079] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:10:43.860534 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363be44-d121-480f-b29a-7a36dcf99bf4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:43.870574 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363be44-d121-480f-b29a-7a36dcf99bf4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:43.875254 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36a069-f529-4eb4-8fe3-59934840da6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:43.875892 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36a069-f529-4eb4-8fe3-59934840da6b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:43.876167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36a069-f529-4eb4-8fe3-59934840da6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:43.876435 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36a069-f529-4eb4-8fe3-59934840da6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:43.877111 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36a069-f529-4eb4-8fe3-59934840da6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:43.878974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36a069-f529-4eb4-8fe3-59934840da6b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:43.982687 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1032/2080] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:43 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:43.988300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72c310-2d98-4fe6-b853-2d24e404f589 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:43.998494 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72c310-2d98-4fe6-b853-2d24e404f589 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:44.014645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36a069-f529-4eb4-8fe3-59934840da6b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:44.016396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4e36a069-f529-4eb4-8fe3-59934840da6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:44.062869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f7bb3-5c49-44fd-8e7c-c8eee461ff1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:44.062869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f7bb3-5c49-44fd-8e7c-c8eee461ff1a admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:44.062869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f7bb3-5c49-44fd-8e7c-c8eee461ff1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:44.062869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f7bb3-5c49-44fd-8e7c-c8eee461ff1a admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:44.079034 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f7bb3-5c49-44fd-8e7c-c8eee461ff1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:44.079034 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f7bb3-5c49-44fd-8e7c-c8eee461ff1a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:44.097172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36a069-f529-4eb4-8fe3-59934840da6b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:44.102044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41008f6b-78f9-4967-89e1-8a4257098e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:44.103564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41008f6b-78f9-4967-89e1-8a4257098e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:44.103879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41008f6b-78f9-4967-89e1-8a4257098e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:44.104150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41008f6b-78f9-4967-89e1-8a4257098e0e admin admin] PATH_INFO: `/v3/users/0fc61ff90d7041968220543a037ddf3a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:44.105466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41008f6b-78f9-4967-89e1-8a4257098e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fc61ff90d7041968220543a037ddf3a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:44.107603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41008f6b-78f9-4967-89e1-8a4257098e0e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:44.201806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1049/2081] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:43 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:44.205896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f7bb3-5c49-44fd-8e7c-c8eee461ff1a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:44.216265 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f7bb3-5c49-44fd-8e7c-c8eee461ff1a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:44.220904 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea934f2a-5c7a-4fdf-a2ed-9cb6a0eb43f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:44.221544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea934f2a-5c7a-4fdf-a2ed-9cb6a0eb43f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:44.221826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea934f2a-5c7a-4fdf-a2ed-9cb6a0eb43f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:44.222101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea934f2a-5c7a-4fdf-a2ed-9cb6a0eb43f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:44.222877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea934f2a-5c7a-4fdf-a2ed-9cb6a0eb43f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:44.224497 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea934f2a-5c7a-4fdf-a2ed-9cb6a0eb43f6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:44.235239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1050/2082] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:10:44.239085 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea934f2a-5c7a-4fdf-a2ed-9cb6a0eb43f6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:44.249062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea934f2a-5c7a-4fdf-a2ed-9cb6a0eb43f6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:44.253727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ace2a5-aa42-46c0-afc5-377c7d7a4865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:44.254379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ace2a5-aa42-46c0-afc5-377c7d7a4865 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:44.254662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ace2a5-aa42-46c0-afc5-377c7d7a4865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:44.254943 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ace2a5-aa42-46c0-afc5-377c7d7a4865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:44.255688 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ace2a5-aa42-46c0-afc5-377c7d7a4865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:44.257283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ace2a5-aa42-46c0-afc5-377c7d7a4865 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:44.268610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1051/2083] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:10:44.272784 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ace2a5-aa42-46c0-afc5-377c7d7a4865 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:44.283065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ace2a5-aa42-46c0-afc5-377c7d7a4865 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:44.287692 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd74e63-1bd5-43e8-ac88-3bb1c3d39abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:44.288552 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd74e63-1bd5-43e8-ac88-3bb1c3d39abb admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:44.288829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd74e63-1bd5-43e8-ac88-3bb1c3d39abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:44.289220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd74e63-1bd5-43e8-ac88-3bb1c3d39abb admin admin] PATH_INFO: `/v3/projects/03aaecac29c94467bd1d4f96396e8f8d/users/83f370f62be0477b8f086b72c97de204/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:44.304352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd74e63-1bd5-43e8-ac88-3bb1c3d39abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=03aaecac29c94467bd1d4f96396e8f8d, user_id=83f370f62be0477b8f086b72c97de204, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:44.307236 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd74e63-1bd5-43e8-ac88-3bb1c3d39abb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:44.320780 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-41008f6b-78f9-4967-89e1-8a4257098e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fc61ff90d7041968220543a037ddf3a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:44.332471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-41008f6b-78f9-4967-89e1-8a4257098e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fc61ff90d7041968220543a037ddf3a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:44.333163 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-41008f6b-78f9-4967-89e1-8a4257098e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fc61ff90d7041968220543a037ddf3a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:44.393237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1052/2084] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:44 2022] PUT /identity/v3/projects/03aaecac29c94467bd1d4f96396e8f8d/users/83f370f62be0477b8f086b72c97de204/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:44.408387 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d2648-7593-4d88-8a03-f3dba91bb5c6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:44.408708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d2648-7593-4d88-8a03-f3dba91bb5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:44.408943 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d2648-7593-4d88-8a03-f3dba91bb5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:44.415922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-41008f6b-78f9-4967-89e1-8a4257098e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fc61ff90d7041968220543a037ddf3a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:44.416549 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-41008f6b-78f9-4967-89e1-8a4257098e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fc61ff90d7041968220543a037ddf3a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:44.429358 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1033/2085] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:44 2022] DELETE /identity/v3/users/0fc61ff90d7041968220543a037ddf3a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:44.434393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f949eb-5307-43da-b76d-2f1596a03c81 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:44.434686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f949eb-5307-43da-b76d-2f1596a03c81 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:44.434966 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f949eb-5307-43da-b76d-2f1596a03c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:44.437797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-719d2648-7593-4d88-8a03-f3dba91bb5c6 None None] MFA Rules not processed for user `83f370f62be0477b8f086b72c97de204`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:44.438995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-719d2648-7593-4d88-8a03-f3dba91bb5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:44.452178 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f4f949eb-5307-43da-b76d-2f1596a03c81 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:44.453624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f4f949eb-5307-43da-b76d-2f1596a03c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:44.503926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1053/2086] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:44.508430 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d2648-7593-4d88-8a03-f3dba91bb5c6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:44.510512 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-719d2648-7593-4d88-8a03-f3dba91bb5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:44.515043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1034/2087] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:44.523910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d2648-7593-4d88-8a03-f3dba91bb5c6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:44.525360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f949eb-5307-43da-b76d-2f1596a03c81 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:44.526828 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f4f949eb-5307-43da-b76d-2f1596a03c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:44.529443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba0c8b-24a8-4c86-af15-20f84eee692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:44.530094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba0c8b-24a8-4c86-af15-20f84eee692c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:44.530373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba0c8b-24a8-4c86-af15-20f84eee692c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:44.530644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba0c8b-24a8-4c86-af15-20f84eee692c admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:44.531379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba0c8b-24a8-4c86-af15-20f84eee692c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:44.533257 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba0c8b-24a8-4c86-af15-20f84eee692c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:44.582764 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f949eb-5307-43da-b76d-2f1596a03c81 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:44.586822 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3bbd8-9c33-457c-a801-32534cb7b967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:44.588388 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3bbd8-9c33-457c-a801-32534cb7b967 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:44.588650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3bbd8-9c33-457c-a801-32534cb7b967 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:44.593813 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3bbd8-9c33-457c-a801-32534cb7b967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:44.598618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3bbd8-9c33-457c-a801-32534cb7b967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:44.600130 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3bbd8-9c33-457c-a801-32534cb7b967 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:44.609718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1035/2088] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:10:44.652775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1054/2089] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:44 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:10:44.654259 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3bbd8-9c33-457c-a801-32534cb7b967 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:44.664794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3bbd8-9c33-457c-a801-32534cb7b967 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:44.725011 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a48e1-adb9-4ace-baec-27161b8291f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:44.725684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a48e1-adb9-4ace-baec-27161b8291f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:44.725969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a48e1-adb9-4ace-baec-27161b8291f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:44.726247 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a48e1-adb9-4ace-baec-27161b8291f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:44.726952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a48e1-adb9-4ace-baec-27161b8291f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:44.728921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a48e1-adb9-4ace-baec-27161b8291f3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:44.819158 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1036/2090] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:44 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:10:44.824039 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba0c8b-24a8-4c86-af15-20f84eee692c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:44.834374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba0c8b-24a8-4c86-af15-20f84eee692c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:44.839338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc0ef2-a960-4bb6-8890-4297ba84758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:44.840134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc0ef2-a960-4bb6-8890-4297ba84758b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:44.840360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc0ef2-a960-4bb6-8890-4297ba84758b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:44.840516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc0ef2-a960-4bb6-8890-4297ba84758b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:44.841273 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc0ef2-a960-4bb6-8890-4297ba84758b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:44.842856 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc0ef2-a960-4bb6-8890-4297ba84758b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:44.853336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1055/2091] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:44.857592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a48e1-adb9-4ace-baec-27161b8291f3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:44.866107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc0ef2-a960-4bb6-8890-4297ba84758b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:44.867905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a48e1-adb9-4ace-baec-27161b8291f3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:44.868138 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3fcc0ef2-a960-4bb6-8890-4297ba84758b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:44.873137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf569-027e-447c-b366-117fc84544ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:44.874034 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf569-027e-447c-b366-117fc84544ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:44.874323 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf569-027e-447c-b366-117fc84544ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:44.874592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf569-027e-447c-b366-117fc84544ad admin admin] PATH_INFO: `/v3/projects/a23ce3363d9d42c996a7fa474c512dfe/users/fbb1de912f63424e98469adaa7772a22/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:44.885299 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc0ef2-a960-4bb6-8890-4297ba84758b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:44.894584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bf569-027e-447c-b366-117fc84544ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23ce3363d9d42c996a7fa474c512dfe, user_id=fbb1de912f63424e98469adaa7772a22, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:44.897230 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3ea70-896a-4eca-894d-31c3324b3c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:44.897489 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bf569-027e-447c-b366-117fc84544ad admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:44.898076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3ea70-896a-4eca-894d-31c3324b3c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:44.898357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3ea70-896a-4eca-894d-31c3324b3c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:44.898686 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3ea70-896a-4eca-894d-31c3324b3c30 admin admin] PATH_INFO: `/v3/projects/53795e38f3b84b859ad65f6203156d20` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:44.899966 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3ea70-896a-4eca-894d-31c3324b3c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53795e38f3b84b859ad65f6203156d20)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:44.902018 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3ea70-896a-4eca-894d-31c3324b3c30 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:44.972890 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1037/2092] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:44 2022] PUT /identity/v3/projects/a23ce3363d9d42c996a7fa474c512dfe/users/fbb1de912f63424e98469adaa7772a22/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:44.976684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf569-027e-447c-b366-117fc84544ad admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:45.042788 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-07c3ea70-896a-4eca-894d-31c3324b3c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53795e38f3b84b859ad65f6203156d20', 'request_id': 'req-07c3ea70-896a-4eca-894d-31c3324b3c30'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:45.044599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf569-027e-447c-b366-117fc84544ad admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:45.049017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-07c3ea70-896a-4eca-894d-31c3324b3c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53795e38f3b84b859ad65f6203156d20', 'request_id': 'req-07c3ea70-896a-4eca-894d-31c3324b3c30'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:45.054693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-07c3ea70-896a-4eca-894d-31c3324b3c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53795e38f3b84b859ad65f6203156d20', 'request_id': 'req-07c3ea70-896a-4eca-894d-31c3324b3c30'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:45.101976 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b89d02-ebd8-4a33-876f-cf7b099a71c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:45.103289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b89d02-ebd8-4a33-876f-cf7b099a71c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:45.114969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b89d02-ebd8-4a33-876f-cf7b099a71c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:45.114969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b89d02-ebd8-4a33-876f-cf7b099a71c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:45.114969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b89d02-ebd8-4a33-876f-cf7b099a71c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:45.114969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b89d02-ebd8-4a33-876f-cf7b099a71c4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:45.116747 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1038/2093] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:10:45.121396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b89d02-ebd8-4a33-876f-cf7b099a71c4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:45.131311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b89d02-ebd8-4a33-876f-cf7b099a71c4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:45.135553 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-07c3ea70-896a-4eca-894d-31c3324b3c30 admin admin] The token cache is being invalidate because project 53795e38f3b84b859ad65f6203156d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:45.135840 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-07c3ea70-896a-4eca-894d-31c3324b3c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:45.136486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-07c3ea70-896a-4eca-894d-31c3324b3c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:45.137680 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdb1e1-227e-4e15-808b-b2d8104fcc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:45.138065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1056/2094] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:44 2022] DELETE /identity/v3/projects/53795e38f3b84b859ad65f6203156d20 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:45.140016 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdb1e1-227e-4e15-808b-b2d8104fcc34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:45.140454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdb1e1-227e-4e15-808b-b2d8104fcc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:45.140752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdb1e1-227e-4e15-808b-b2d8104fcc34 admin admin] PATH_INFO: `/v3/projects/a23ce3363d9d42c996a7fa474c512dfe/users/fbb1de912f63424e98469adaa7772a22/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:45.142889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdb1e1-227e-4e15-808b-b2d8104fcc34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23ce3363d9d42c996a7fa474c512dfe, user_id=fbb1de912f63424e98469adaa7772a22, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:45.143486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3ec9c-03c5-48d1-a8ba-10838aec4389 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:45.143994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3ec9c-03c5-48d1-a8ba-10838aec4389 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:45.144464 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3ec9c-03c5-48d1-a8ba-10838aec4389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:45.145763 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdb1e1-227e-4e15-808b-b2d8104fcc34 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:45.156962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1039/2095] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:45 2022] PUT /identity/v3/projects/a23ce3363d9d42c996a7fa474c512dfe/users/fbb1de912f63424e98469adaa7772a22/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:45.164459 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-dbc3ec9c-03c5-48d1-a8ba-10838aec4389 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:45.166339 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dbc3ec9c-03c5-48d1-a8ba-10838aec4389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:45.168620 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7658a-08de-4fa0-a8e2-ee1a1d0c3585 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:45.169025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7658a-08de-4fa0-a8e2-ee1a1d0c3585 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:45.169413 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7658a-08de-4fa0-a8e2-ee1a1d0c3585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:45.198206 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-44e7658a-08de-4fa0-a8e2-ee1a1d0c3585 None None] MFA Rules not processed for user `fbb1de912f63424e98469adaa7772a22`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:45.199859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-44e7658a-08de-4fa0-a8e2-ee1a1d0c3585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:45.250844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1057/2096] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:45.257960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6abbe-ee81-411e-8f68-760417b4c7a6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:45.258249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6abbe-ee81-411e-8f68-760417b4c7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:45.258557 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6abbe-ee81-411e-8f68-760417b4c7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:45.268615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1040/2097] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:45.277369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-91e6abbe-ee81-411e-8f68-760417b4c7a6 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:45.278839 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-91e6abbe-ee81-411e-8f68-760417b4c7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:45.279537 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7658a-08de-4fa0-a8e2-ee1a1d0c3585 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:45.280855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-44e7658a-08de-4fa0-a8e2-ee1a1d0c3585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:45.286594 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1058/2098] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:45.292136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6abbe-ee81-411e-8f68-760417b4c7a6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:45.304123 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6abbe-ee81-411e-8f68-760417b4c7a6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:45.317800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90007f2-f8e6-43ef-9e63-1082ae60a52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:45.318577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90007f2-f8e6-43ef-9e63-1082ae60a52b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:45.318907 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90007f2-f8e6-43ef-9e63-1082ae60a52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:45.319227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90007f2-f8e6-43ef-9e63-1082ae60a52b admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:45.319963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90007f2-f8e6-43ef-9e63-1082ae60a52b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:10:45.320271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90007f2-f8e6-43ef-9e63-1082ae60a52b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:45.322445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90007f2-f8e6-43ef-9e63-1082ae60a52b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:45.334482 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1059/2099] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:10:45.339609 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90007f2-f8e6-43ef-9e63-1082ae60a52b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:45.349000 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90007f2-f8e6-43ef-9e63-1082ae60a52b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:45.349726 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7658a-08de-4fa0-a8e2-ee1a1d0c3585 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:45.353968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ec43a-400e-4a25-b444-7550277881db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:45.354402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e87a68-d3f6-4ff0-b5ea-b00f9aaea212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:45.354614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ec43a-400e-4a25-b444-7550277881db admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:45.354898 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ec43a-400e-4a25-b444-7550277881db admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:45.355064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e87a68-d3f6-4ff0-b5ea-b00f9aaea212 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:45.355271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ec43a-400e-4a25-b444-7550277881db admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:45.355357 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e87a68-d3f6-4ff0-b5ea-b00f9aaea212 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:45.355601 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e87a68-d3f6-4ff0-b5ea-b00f9aaea212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:45.355881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ec43a-400e-4a25-b444-7550277881db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:45.357758 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ec43a-400e-4a25-b444-7550277881db admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:45.365056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e87a68-d3f6-4ff0-b5ea-b00f9aaea212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:45.366523 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e87a68-d3f6-4ff0-b5ea-b00f9aaea212 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:45.377227 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1041/2100] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:10:45.463780 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1060/2101] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:45 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:45.467706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e87a68-d3f6-4ff0-b5ea-b00f9aaea212 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:45.478267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e87a68-d3f6-4ff0-b5ea-b00f9aaea212 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:45.534083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2d2f2-d9bf-4aeb-93a4-5857c34dcf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:45.534899 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2d2f2-d9bf-4aeb-93a4-5857c34dcf3c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:45.535214 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2d2f2-d9bf-4aeb-93a4-5857c34dcf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:45.535490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2d2f2-d9bf-4aeb-93a4-5857c34dcf3c admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:45.536190 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2d2f2-d9bf-4aeb-93a4-5857c34dcf3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:45.538092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2d2f2-d9bf-4aeb-93a4-5857c34dcf3c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:45.671285 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1042/2102] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:45 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:45.672456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ec43a-400e-4a25-b444-7550277881db admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:45.683184 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ec43a-400e-4a25-b444-7550277881db admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:45.687817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f00d9e-d6af-415a-a387-fc22d81e4785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:45.688454 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f00d9e-d6af-415a-a387-fc22d81e4785 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:45.688770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f00d9e-d6af-415a-a387-fc22d81e4785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:45.689046 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f00d9e-d6af-415a-a387-fc22d81e4785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:45.689756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f00d9e-d6af-415a-a387-fc22d81e4785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:45.691361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f00d9e-d6af-415a-a387-fc22d81e4785 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:45.701712 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1061/2103] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:10:45.705654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2d2f2-d9bf-4aeb-93a4-5857c34dcf3c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:45.715449 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2d2f2-d9bf-4aeb-93a4-5857c34dcf3c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:45.720288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ed550-691c-415e-90e1-6f527a7dd34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:45.720977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ed550-691c-415e-90e1-6f527a7dd34e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:45.721261 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ed550-691c-415e-90e1-6f527a7dd34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:45.721540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ed550-691c-415e-90e1-6f527a7dd34e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:45.722272 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ed550-691c-415e-90e1-6f527a7dd34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:45.723947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ed550-691c-415e-90e1-6f527a7dd34e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:45.733780 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1043/2104] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:45.737753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f00d9e-d6af-415a-a387-fc22d81e4785 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:45.748067 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f00d9e-d6af-415a-a387-fc22d81e4785 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:45.752514 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a7a7c-fbf3-48ff-976e-2e37aa5ab83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:45.753407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a7a7c-fbf3-48ff-976e-2e37aa5ab83f admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:45.753682 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a7a7c-fbf3-48ff-976e-2e37aa5ab83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:45.753949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a7a7c-fbf3-48ff-976e-2e37aa5ab83f admin admin] PATH_INFO: `/v3/projects/f3b9176d44ed415bacfaf45f3f8472a5/users/b1ef9ab26a7442479ec952d43e392081/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:45.768361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a7a7c-fbf3-48ff-976e-2e37aa5ab83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b9176d44ed415bacfaf45f3f8472a5, user_id=b1ef9ab26a7442479ec952d43e392081, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:45.771384 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a7a7c-fbf3-48ff-976e-2e37aa5ab83f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:45.899260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1062/2105] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:45 2022] PUT /identity/v3/projects/f3b9176d44ed415bacfaf45f3f8472a5/users/b1ef9ab26a7442479ec952d43e392081/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:45.906128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d2c6-d9d1-4fdd-9ce1-88dfda32bfaa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:45.906803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d2c6-d9d1-4fdd-9ce1-88dfda32bfaa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:45.907334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d2c6-d9d1-4fdd-9ce1-88dfda32bfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:45.930463 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8292d2c6-d9d1-4fdd-9ce1-88dfda32bfaa None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:45.932475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8292d2c6-d9d1-4fdd-9ce1-88dfda32bfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:46.012885 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1044/2106] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:46.024461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a7a7c-fbf3-48ff-976e-2e37aa5ab83f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:46.026616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ef2a7a7c-fbf3-48ff-976e-2e37aa5ab83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:46.090939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a7a7c-fbf3-48ff-976e-2e37aa5ab83f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:46.095946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139cc53-f256-4551-8591-a08290b182b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:46.096671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139cc53-f256-4551-8591-a08290b182b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:46.097005 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139cc53-f256-4551-8591-a08290b182b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:46.097345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139cc53-f256-4551-8591-a08290b182b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:46.107567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139cc53-f256-4551-8591-a08290b182b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:46.109018 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139cc53-f256-4551-8591-a08290b182b4 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:46.118836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1063/2107] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:46.286307 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292d2c6-d9d1-4fdd-9ce1-88dfda32bfaa None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:46.287724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8292d2c6-d9d1-4fdd-9ce1-88dfda32bfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:46.299533 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292d2c6-d9d1-4fdd-9ce1-88dfda32bfaa None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:46.304845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce7dd0-2ed6-4a49-8642-6da4a18f8b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:46.306536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce7dd0-2ed6-4a49-8642-6da4a18f8b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:46.306861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce7dd0-2ed6-4a49-8642-6da4a18f8b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:46.307239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce7dd0-2ed6-4a49-8642-6da4a18f8b27 admin admin] PATH_INFO: `/v3/users/83f370f62be0477b8f086b72c97de204` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:46.308646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce7dd0-2ed6-4a49-8642-6da4a18f8b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f370f62be0477b8f086b72c97de204)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:46.310942 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce7dd0-2ed6-4a49-8642-6da4a18f8b27 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:46.518753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-00ce7dd0-2ed6-4a49-8642-6da4a18f8b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f370f62be0477b8f086b72c97de204'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:46.532849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-00ce7dd0-2ed6-4a49-8642-6da4a18f8b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f370f62be0477b8f086b72c97de204'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:46.534853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-00ce7dd0-2ed6-4a49-8642-6da4a18f8b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f370f62be0477b8f086b72c97de204'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:46.592922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-00ce7dd0-2ed6-4a49-8642-6da4a18f8b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f370f62be0477b8f086b72c97de204'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:46.593538 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-00ce7dd0-2ed6-4a49-8642-6da4a18f8b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f370f62be0477b8f086b72c97de204'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:46.607353 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1045/2108] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:46 2022] DELETE /identity/v3/users/83f370f62be0477b8f086b72c97de204 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:46.611805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842dcf2-fc62-4ac6-ab71-38b6b1fb6402 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:46.612092 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842dcf2-fc62-4ac6-ab71-38b6b1fb6402 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:46.612371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842dcf2-fc62-4ac6-ab71-38b6b1fb6402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:46.630517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d842dcf2-fc62-4ac6-ab71-38b6b1fb6402 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:46.631716 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d842dcf2-fc62-4ac6-ab71-38b6b1fb6402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:46.697588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1064/2109] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:46.720630 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce7dd0-2ed6-4a49-8642-6da4a18f8b27 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:46.722943 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-00ce7dd0-2ed6-4a49-8642-6da4a18f8b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:46.790039 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce7dd0-2ed6-4a49-8642-6da4a18f8b27 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:46.794607 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b37a3-a65b-478d-9246-951385d56616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:46.795289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b37a3-a65b-478d-9246-951385d56616 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:46.795574 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b37a3-a65b-478d-9246-951385d56616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:46.795852 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b37a3-a65b-478d-9246-951385d56616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:46.806606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b37a3-a65b-478d-9246-951385d56616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:46.807487 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b37a3-a65b-478d-9246-951385d56616 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:46.817579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1046/2110] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:47.432438 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842dcf2-fc62-4ac6-ab71-38b6b1fb6402 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:47.434702 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d842dcf2-fc62-4ac6-ab71-38b6b1fb6402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:47.451859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842dcf2-fc62-4ac6-ab71-38b6b1fb6402 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:47.480790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:47.480790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:47.480790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:47.480790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a admin admin] PATH_INFO: `/v3/projects/03aaecac29c94467bd1d4f96396e8f8d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:47.481212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03aaecac29c94467bd1d4f96396e8f8d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:47.482069 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:47.626493 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03aaecac29c94467bd1d4f96396e8f8d', 'request_id': 'req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:47.633154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03aaecac29c94467bd1d4f96396e8f8d', 'request_id': 'req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:47.639148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03aaecac29c94467bd1d4f96396e8f8d', 'request_id': 'req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:47.721383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a admin admin] The token cache is being invalidate because project 03aaecac29c94467bd1d4f96396e8f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:47.721763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:47.723156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:47.725883 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1065/2111] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:47 2022] DELETE /identity/v3/projects/03aaecac29c94467bd1d4f96396e8f8d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:47.732039 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b37a3-a65b-478d-9246-951385d56616 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:47.750819 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b37a3-a65b-478d-9246-951385d56616 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:47.818278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcaf5b-27bd-444a-b92f-52d2e11ccb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:47.819401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcaf5b-27bd-444a-b92f-52d2e11ccb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:47.819736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcaf5b-27bd-444a-b92f-52d2e11ccb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:47.820009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcaf5b-27bd-444a-b92f-52d2e11ccb88 admin admin] PATH_INFO: `/v3/users/fbb1de912f63424e98469adaa7772a22` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:47.821205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcaf5b-27bd-444a-b92f-52d2e11ccb88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb1de912f63424e98469adaa7772a22)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:47.823383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcaf5b-27bd-444a-b92f-52d2e11ccb88 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:48.033393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e9fcaf5b-27bd-444a-b92f-52d2e11ccb88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb1de912f63424e98469adaa7772a22'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:48.048954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e9fcaf5b-27bd-444a-b92f-52d2e11ccb88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb1de912f63424e98469adaa7772a22'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:48.050484 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e9fcaf5b-27bd-444a-b92f-52d2e11ccb88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb1de912f63424e98469adaa7772a22'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:48.119869 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e9fcaf5b-27bd-444a-b92f-52d2e11ccb88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb1de912f63424e98469adaa7772a22'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:48.120906 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e9fcaf5b-27bd-444a-b92f-52d2e11ccb88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb1de912f63424e98469adaa7772a22'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:48.139949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1047/2112] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:47 2022] DELETE /identity/v3/users/fbb1de912f63424e98469adaa7772a22 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:48.581526 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:48.588086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:48.606612 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a8a8b-5dfc-46a6-ac28-98a223eaf86a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:48.678769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e678cc-8943-403e-a6e3-26d03cd71302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:48.680092 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e678cc-8943-403e-a6e3-26d03cd71302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:48.680516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e678cc-8943-403e-a6e3-26d03cd71302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:48.681465 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e678cc-8943-403e-a6e3-26d03cd71302 admin admin] PATH_INFO: `/v3/projects/a23ce3363d9d42c996a7fa474c512dfe` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:48.682962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e678cc-8943-403e-a6e3-26d03cd71302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23ce3363d9d42c996a7fa474c512dfe)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:48.697814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e678cc-8943-403e-a6e3-26d03cd71302 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:48.812909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-98e678cc-8943-403e-a6e3-26d03cd71302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23ce3363d9d42c996a7fa474c512dfe', 'request_id': 'req-98e678cc-8943-403e-a6e3-26d03cd71302'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:48.818935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-98e678cc-8943-403e-a6e3-26d03cd71302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23ce3363d9d42c996a7fa474c512dfe', 'request_id': 'req-98e678cc-8943-403e-a6e3-26d03cd71302'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:48.824286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-98e678cc-8943-403e-a6e3-26d03cd71302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23ce3363d9d42c996a7fa474c512dfe', 'request_id': 'req-98e678cc-8943-403e-a6e3-26d03cd71302'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:48.926057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-98e678cc-8943-403e-a6e3-26d03cd71302 admin admin] The token cache is being invalidate because project a23ce3363d9d42c996a7fa474c512dfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:48.926343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-98e678cc-8943-403e-a6e3-26d03cd71302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:48.926956 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-98e678cc-8943-403e-a6e3-26d03cd71302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:48.928642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1066/2113] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:48 2022] DELETE /identity/v3/projects/a23ce3363d9d42c996a7fa474c512dfe => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:48.933760 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a3a75-cbd5-46eb-a84a-5bb3d256d7fc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:48.934510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a3a75-cbd5-46eb-a84a-5bb3d256d7fc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:48.934732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a3a75-cbd5-46eb-a84a-5bb3d256d7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:48.953216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-748a3a75-cbd5-46eb-a84a-5bb3d256d7fc None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:48.954528 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-748a3a75-cbd5-46eb-a84a-5bb3d256d7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:49.025558 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1048/2114] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:49.034846 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c377117-6f98-4dcf-bfc5-d253e2027ce1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:49.035173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c377117-6f98-4dcf-bfc5-d253e2027ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:49.035461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c377117-6f98-4dcf-bfc5-d253e2027ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:49.055494 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6c377117-6f98-4dcf-bfc5-d253e2027ce1 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:49.056789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6c377117-6f98-4dcf-bfc5-d253e2027ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:49.065624 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1067/2115] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:49.069841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a3a75-cbd5-46eb-a84a-5bb3d256d7fc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:49.080310 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a3a75-cbd5-46eb-a84a-5bb3d256d7fc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:49.085192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dba22-6ded-4983-8d3c-00686c07615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:49.085871 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dba22-6ded-4983-8d3c-00686c07615c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:49.086159 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dba22-6ded-4983-8d3c-00686c07615c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:49.086439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dba22-6ded-4983-8d3c-00686c07615c admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:49.087981 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064dba22-6ded-4983-8d3c-00686c07615c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:10:49.088296 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064dba22-6ded-4983-8d3c-00686c07615c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:49.089917 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064dba22-6ded-4983-8d3c-00686c07615c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:49.107456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c377117-6f98-4dcf-bfc5-d253e2027ce1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:49.112997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1049/2116] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:10:49.117246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c377117-6f98-4dcf-bfc5-d253e2027ce1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:49.127147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806649d-b1b4-46bb-a514-0269249aaef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:49.127960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806649d-b1b4-46bb-a514-0269249aaef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:49.128350 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806649d-b1b4-46bb-a514-0269249aaef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:49.128731 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806649d-b1b4-46bb-a514-0269249aaef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:49.129793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806649d-b1b4-46bb-a514-0269249aaef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:49.132584 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806649d-b1b4-46bb-a514-0269249aaef8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:49.238701 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1068/2117] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:49 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:10:49.242801 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dba22-6ded-4983-8d3c-00686c07615c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:49.253841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dba22-6ded-4983-8d3c-00686c07615c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:49.328606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00da8a-10c0-4c7d-bde3-628b86b277bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:49.329678 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00da8a-10c0-4c7d-bde3-628b86b277bd admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:49.330161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00da8a-10c0-4c7d-bde3-628b86b277bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:49.330635 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00da8a-10c0-4c7d-bde3-628b86b277bd admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:49.331746 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00da8a-10c0-4c7d-bde3-628b86b277bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:49.334247 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00da8a-10c0-4c7d-bde3-628b86b277bd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:49.454746 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1050/2118] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:49 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:49.461746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806649d-b1b4-46bb-a514-0269249aaef8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:49.466373 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00da8a-10c0-4c7d-bde3-628b86b277bd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:49.470077 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2d00da8a-10c0-4c7d-bde3-628b86b277bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:49.474593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806649d-b1b4-46bb-a514-0269249aaef8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:49.483233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe37c15-b926-4809-bed4-3e0aaa28967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:49.484621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe37c15-b926-4809-bed4-3e0aaa28967d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:49.485057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe37c15-b926-4809-bed4-3e0aaa28967d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:49.485867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe37c15-b926-4809-bed4-3e0aaa28967d admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:49.487207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00da8a-10c0-4c7d-bde3-628b86b277bd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:49.488346 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe37c15-b926-4809-bed4-3e0aaa28967d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:49.490916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe37c15-b926-4809-bed4-3e0aaa28967d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:49.492772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40348c4-b034-4696-9067-8cb215fe3a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:49.493968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40348c4-b034-4696-9067-8cb215fe3a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:49.494358 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40348c4-b034-4696-9067-8cb215fe3a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:49.494739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40348c4-b034-4696-9067-8cb215fe3a41 admin admin] PATH_INFO: `/v3/users/1e74272ca9e94645a0740d904b1cba18` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:49.496151 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40348c4-b034-4696-9067-8cb215fe3a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e74272ca9e94645a0740d904b1cba18)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:49.498168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40348c4-b034-4696-9067-8cb215fe3a41 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:49.503599 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1069/2119] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:49.507426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe37c15-b926-4809-bed4-3e0aaa28967d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:49.519785 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe37c15-b926-4809-bed4-3e0aaa28967d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:49.525674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e633c-2f69-4f8d-98c7-b793ea089e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:49.527023 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e633c-2f69-4f8d-98c7-b793ea089e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:49.527350 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e633c-2f69-4f8d-98c7-b793ea089e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:49.527627 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e633c-2f69-4f8d-98c7-b793ea089e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:49.528367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e633c-2f69-4f8d-98c7-b793ea089e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:49.529975 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e633c-2f69-4f8d-98c7-b793ea089e86 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:49.541911 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1070/2120] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:10:49.545927 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e633c-2f69-4f8d-98c7-b793ea089e86 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:49.557478 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e633c-2f69-4f8d-98c7-b793ea089e86 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:49.565782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0c888-00df-4778-a7ab-52605ee690c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:49.566210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0c888-00df-4778-a7ab-52605ee690c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:49.566773 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0c888-00df-4778-a7ab-52605ee690c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:49.567330 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0c888-00df-4778-a7ab-52605ee690c6 admin admin] PATH_INFO: `/v3/projects/85b63eed38344ab1868e95d71d760f3a/users/4b68bd4646394e8995439c0a695a628d/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:49.588591 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0c888-00df-4778-a7ab-52605ee690c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b63eed38344ab1868e95d71d760f3a, user_id=4b68bd4646394e8995439c0a695a628d, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:49.591283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0c888-00df-4778-a7ab-52605ee690c6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:49.701511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1071/2121] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:49 2022] PUT /identity/v3/projects/85b63eed38344ab1868e95d71d760f3a/users/4b68bd4646394e8995439c0a695a628d/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:49.715442 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf84bd-edb3-4eac-9f41-9cd1d218a478 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:49.715956 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf84bd-edb3-4eac-9f41-9cd1d218a478 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:49.716405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf84bd-edb3-4eac-9f41-9cd1d218a478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:49.751284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-bcbf84bd-edb3-4eac-9f41-9cd1d218a478 None None] MFA Rules not processed for user `4b68bd4646394e8995439c0a695a628d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:49.753274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bcbf84bd-edb3-4eac-9f41-9cd1d218a478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:49.778398 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c40348c4-b034-4696-9067-8cb215fe3a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e74272ca9e94645a0740d904b1cba18'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:49.831139 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c40348c4-b034-4696-9067-8cb215fe3a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e74272ca9e94645a0740d904b1cba18'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:49.833480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c40348c4-b034-4696-9067-8cb215fe3a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e74272ca9e94645a0740d904b1cba18'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:49.910167 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1072/2122] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:49.914351 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf84bd-edb3-4eac-9f41-9cd1d218a478 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:49.922175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bcbf84bd-edb3-4eac-9f41-9cd1d218a478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:49.926629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c40348c4-b034-4696-9067-8cb215fe3a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e74272ca9e94645a0740d904b1cba18'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:49.927327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c40348c4-b034-4696-9067-8cb215fe3a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e74272ca9e94645a0740d904b1cba18'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:49.954970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1051/2123] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:49 2022] DELETE /identity/v3/users/1e74272ca9e94645a0740d904b1cba18 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:49.959219 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4cde2-e18e-4a7b-a4b5-522e7297c986 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:49.959515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4cde2-e18e-4a7b-a4b5-522e7297c986 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:49.959846 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4cde2-e18e-4a7b-a4b5-522e7297c986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:49.991868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8df4cde2-e18e-4a7b-a4b5-522e7297c986 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:49.993500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8df4cde2-e18e-4a7b-a4b5-522e7297c986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:50.014640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf84bd-edb3-4eac-9f41-9cd1d218a478 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:50.099017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f6d37-1e48-43d3-9986-e8f0c7418fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:50.100086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f6d37-1e48-43d3-9986-e8f0c7418fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:50.100475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f6d37-1e48-43d3-9986-e8f0c7418fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:50.101339 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f6d37-1e48-43d3-9986-e8f0c7418fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:50.102166 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f6d37-1e48-43d3-9986-e8f0c7418fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:50.105596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f6d37-1e48-43d3-9986-e8f0c7418fb5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:50.139392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1052/2124] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:50.161720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4cde2-e18e-4a7b-a4b5-522e7297c986 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:50.161720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8df4cde2-e18e-4a7b-a4b5-522e7297c986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:50.241657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1073/2125] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:49 2022] POST /identity/v3/projects => generated 385 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:10:50.246795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f6d37-1e48-43d3-9986-e8f0c7418fb5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:50.251475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4cde2-e18e-4a7b-a4b5-522e7297c986 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:50.333720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc4659-610b-48f1-9ab8-d05325ce6a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:50.335982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc4659-610b-48f1-9ab8-d05325ce6a3c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:50.338508 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc4659-610b-48f1-9ab8-d05325ce6a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:50.338992 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc4659-610b-48f1-9ab8-d05325ce6a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:50.381961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f6d37-1e48-43d3-9986-e8f0c7418fb5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:50.389876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c17d4-87be-40f9-b33b-fa16e403122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:50.390694 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c17d4-87be-40f9-b33b-fa16e403122c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:50.391264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c17d4-87be-40f9-b33b-fa16e403122c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:50.391640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c17d4-87be-40f9-b33b-fa16e403122c admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:50.392432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c17d4-87be-40f9-b33b-fa16e403122c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:50.394501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c17d4-87be-40f9-b33b-fa16e403122c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:50.474035 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc4659-610b-48f1-9ab8-d05325ce6a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:50.475522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc4659-610b-48f1-9ab8-d05325ce6a3c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:50.489087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1053/2126] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:10:50.521710 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1074/2127] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:50 2022] POST /identity/v3/users => generated 299 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:50.526762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc4659-610b-48f1-9ab8-d05325ce6a3c service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:50.539889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc4659-610b-48f1-9ab8-d05325ce6a3c service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:50.548008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd482c3e-b7b8-418d-80d0-23dc63c7ed3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:50.549826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd482c3e-b7b8-418d-80d0-23dc63c7ed3d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:50.551305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd482c3e-b7b8-418d-80d0-23dc63c7ed3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:50.551806 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd482c3e-b7b8-418d-80d0-23dc63c7ed3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:50.553582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd482c3e-b7b8-418d-80d0-23dc63c7ed3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:50.557632 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd482c3e-b7b8-418d-80d0-23dc63c7ed3d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:50.578314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1054/2128] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:50.582171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c17d4-87be-40f9-b33b-fa16e403122c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:50.604201 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c17d4-87be-40f9-b33b-fa16e403122c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:50.610789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016bda9-a959-433e-ab3e-6a101f0054a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:50.611979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016bda9-a959-433e-ab3e-6a101f0054a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:50.612454 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016bda9-a959-433e-ab3e-6a101f0054a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:50.612910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016bda9-a959-433e-ab3e-6a101f0054a0 admin admin] PATH_INFO: `/v3/projects/c049efa853a040049b57c4e6a1d21c68/users/26b0d120bd0d4f4c92686462bc33873a/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:50.631839 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016bda9-a959-433e-ab3e-6a101f0054a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c049efa853a040049b57c4e6a1d21c68, user_id=26b0d120bd0d4f4c92686462bc33873a, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:50.635147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016bda9-a959-433e-ab3e-6a101f0054a0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:50.730293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd482c3e-b7b8-418d-80d0-23dc63c7ed3d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:50.731408 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1075/2129] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:50 2022] PUT /identity/v3/projects/c049efa853a040049b57c4e6a1d21c68/users/26b0d120bd0d4f4c92686462bc33873a/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:50.749098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd482c3e-b7b8-418d-80d0-23dc63c7ed3d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:50.833754 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e64865-e21a-49db-aa37-682cf9c70909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:50.834566 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e64865-e21a-49db-aa37-682cf9c70909 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:50.834858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e64865-e21a-49db-aa37-682cf9c70909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:50.835873 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e64865-e21a-49db-aa37-682cf9c70909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:50.836633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e64865-e21a-49db-aa37-682cf9c70909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:50.839007 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e64865-e21a-49db-aa37-682cf9c70909 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:50.855817 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1055/2130] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:50.856531 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016bda9-a959-433e-ab3e-6a101f0054a0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:50.872176 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016bda9-a959-433e-ab3e-6a101f0054a0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:50.879040 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e00f81-0933-4efd-a88a-d464a3a5eb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:50.880125 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e00f81-0933-4efd-a88a-d464a3a5eb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:50.880747 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e00f81-0933-4efd-a88a-d464a3a5eb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:50.880849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e00f81-0933-4efd-a88a-d464a3a5eb20 admin admin] PATH_INFO: `/v3/projects/c049efa853a040049b57c4e6a1d21c68/users/26b0d120bd0d4f4c92686462bc33873a/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:50.883129 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e00f81-0933-4efd-a88a-d464a3a5eb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c049efa853a040049b57c4e6a1d21c68, user_id=26b0d120bd0d4f4c92686462bc33873a, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:50.886320 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e00f81-0933-4efd-a88a-d464a3a5eb20 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:50.904435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1076/2131] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:50 2022] PUT /identity/v3/projects/c049efa853a040049b57c4e6a1d21c68/users/26b0d120bd0d4f4c92686462bc33873a/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:50.914477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c490c6-08b8-4146-93bd-4790073dcd7a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:50.914817 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c490c6-08b8-4146-93bd-4790073dcd7a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:50.915289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c490c6-08b8-4146-93bd-4790073dcd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:50.954985 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-36c490c6-08b8-4146-93bd-4790073dcd7a None None] MFA Rules not processed for user `26b0d120bd0d4f4c92686462bc33873a`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:50.956242 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-36c490c6-08b8-4146-93bd-4790073dcd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:51.036218 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e00f81-0933-4efd-a88a-d464a3a5eb20 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:51.036763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-38e00f81-0933-4efd-a88a-d464a3a5eb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:51.091904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1056/2132] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:51.102478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c490c6-08b8-4146-93bd-4790073dcd7a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:51.105541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-36c490c6-08b8-4146-93bd-4790073dcd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:51.143865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e00f81-0933-4efd-a88a-d464a3a5eb20 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:51.150283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d485b-5091-46ce-a2fb-e401acb61558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:51.150541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d485b-5091-46ce-a2fb-e401acb61558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:51.150955 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d485b-5091-46ce-a2fb-e401acb61558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:51.151505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d485b-5091-46ce-a2fb-e401acb61558 admin admin] PATH_INFO: `/v3/projects/f3e17c0513714e4b8fd503c36267948c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:51.153036 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d485b-5091-46ce-a2fb-e401acb61558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e17c0513714e4b8fd503c36267948c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:51.155130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d485b-5091-46ce-a2fb-e401acb61558 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:51.180399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c490c6-08b8-4146-93bd-4790073dcd7a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:51.185970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0b2bf-e407-4e4a-81c1-384309e039e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:51.187431 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0b2bf-e407-4e4a-81c1-384309e039e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:51.187772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0b2bf-e407-4e4a-81c1-384309e039e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:51.188057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0b2bf-e407-4e4a-81c1-384309e039e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:51.291314 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c23d485b-5091-46ce-a2fb-e401acb61558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e17c0513714e4b8fd503c36267948c', 'request_id': 'req-c23d485b-5091-46ce-a2fb-e401acb61558'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:51.292010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0b2bf-e407-4e4a-81c1-384309e039e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:51.295316 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0b2bf-e407-4e4a-81c1-384309e039e8 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:51.305153 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c23d485b-5091-46ce-a2fb-e401acb61558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e17c0513714e4b8fd503c36267948c', 'request_id': 'req-c23d485b-5091-46ce-a2fb-e401acb61558'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:51.309599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1057/2133] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:10:51.322703 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c23d485b-5091-46ce-a2fb-e401acb61558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e17c0513714e4b8fd503c36267948c', 'request_id': 'req-c23d485b-5091-46ce-a2fb-e401acb61558'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:51.401028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c23d485b-5091-46ce-a2fb-e401acb61558 admin admin] The token cache is being invalidate because project f3e17c0513714e4b8fd503c36267948c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:51.401338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c23d485b-5091-46ce-a2fb-e401acb61558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:51.402123 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c23d485b-5091-46ce-a2fb-e401acb61558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:51.404961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1077/2134] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:51 2022] DELETE /identity/v3/projects/f3e17c0513714e4b8fd503c36267948c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:51.410068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e8d9-4981-4d68-ac5b-806e62d9150e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:51.410371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e8d9-4981-4d68-ac5b-806e62d9150e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:51.412110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e8d9-4981-4d68-ac5b-806e62d9150e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:51.446405 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d4f5e8d9-4981-4d68-ac5b-806e62d9150e None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:51.448083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d4f5e8d9-4981-4d68-ac5b-806e62d9150e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:51.531126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1058/2135] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:51.539656 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04f65a-7bfa-42ab-acf0-a519f7687a21 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:51.540142 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04f65a-7bfa-42ab-acf0-a519f7687a21 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:51.540953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04f65a-7bfa-42ab-acf0-a519f7687a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:51.560290 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5a04f65a-7bfa-42ab-acf0-a519f7687a21 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:51.561596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5a04f65a-7bfa-42ab-acf0-a519f7687a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:51.570134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1078/2136] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:51.574767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5e8d9-4981-4d68-ac5b-806e62d9150e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:51.585987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5e8d9-4981-4d68-ac5b-806e62d9150e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:51.587489 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04f65a-7bfa-42ab-acf0-a519f7687a21 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:51.589483 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5a04f65a-7bfa-42ab-acf0-a519f7687a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:51.593349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60cbab-45ca-42fc-b1a3-cefcd0a206a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:51.594034 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60cbab-45ca-42fc-b1a3-cefcd0a206a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:51.594327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60cbab-45ca-42fc-b1a3-cefcd0a206a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:51.594608 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60cbab-45ca-42fc-b1a3-cefcd0a206a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:51.596588 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60cbab-45ca-42fc-b1a3-cefcd0a206a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:10:51.596904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60cbab-45ca-42fc-b1a3-cefcd0a206a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:51.598512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60cbab-45ca-42fc-b1a3-cefcd0a206a1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:51.603933 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04f65a-7bfa-42ab-acf0-a519f7687a21 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:51.610219 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20649b-2283-45c3-b9fe-6ebb2698b360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:51.611234 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20649b-2283-45c3-b9fe-6ebb2698b360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:51.611518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20649b-2283-45c3-b9fe-6ebb2698b360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:51.611796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20649b-2283-45c3-b9fe-6ebb2698b360 admin admin] PATH_INFO: `/v3/users/c7eaed71552f4fb4b6780299f35c8318` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:51.613095 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20649b-2283-45c3-b9fe-6ebb2698b360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7eaed71552f4fb4b6780299f35c8318)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:51.615224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20649b-2283-45c3-b9fe-6ebb2698b360 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:51.636987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1059/2137] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:10:51.640973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60cbab-45ca-42fc-b1a3-cefcd0a206a1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:51.651900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60cbab-45ca-42fc-b1a3-cefcd0a206a1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:51.658529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb80691-c7e1-4141-8556-9ca4575accf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:51.660358 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb80691-c7e1-4141-8556-9ca4575accf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:51.660849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb80691-c7e1-4141-8556-9ca4575accf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:51.661497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb80691-c7e1-4141-8556-9ca4575accf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:51.662825 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb80691-c7e1-4141-8556-9ca4575accf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:51.666646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb80691-c7e1-4141-8556-9ca4575accf9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:51.798294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1060/2138] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:51 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:10:51.802668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb80691-c7e1-4141-8556-9ca4575accf9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:51.853963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eb20649b-2283-45c3-b9fe-6ebb2698b360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7eaed71552f4fb4b6780299f35c8318'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:51.876995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eb20649b-2283-45c3-b9fe-6ebb2698b360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7eaed71552f4fb4b6780299f35c8318'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:51.899395 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb80691-c7e1-4141-8556-9ca4575accf9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:51.904789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3223c-f31b-4041-ab30-95ac084fc693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:51.905472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3223c-f31b-4041-ab30-95ac084fc693 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:51.905786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3223c-f31b-4041-ab30-95ac084fc693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:51.906069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3223c-f31b-4041-ab30-95ac084fc693 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:51.906894 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3223c-f31b-4041-ab30-95ac084fc693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:51.908873 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3223c-f31b-4041-ab30-95ac084fc693 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:51.994193 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eb20649b-2283-45c3-b9fe-6ebb2698b360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7eaed71552f4fb4b6780299f35c8318'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:51.994849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eb20649b-2283-45c3-b9fe-6ebb2698b360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7eaed71552f4fb4b6780299f35c8318'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:51.995585 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eb20649b-2283-45c3-b9fe-6ebb2698b360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7eaed71552f4fb4b6780299f35c8318'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:52.000379 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1061/2139] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:51 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:52.007399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3223c-f31b-4041-ab30-95ac084fc693 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:52.011037 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e6c3223c-f31b-4041-ab30-95ac084fc693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:52.020953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1079/2140] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:51 2022] DELETE /identity/v3/users/c7eaed71552f4fb4b6780299f35c8318 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:52.042488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3223c-f31b-4041-ab30-95ac084fc693 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:52.148977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bed96e-1b26-4f11-b55b-a2aa28d17b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:52.149141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bed96e-1b26-4f11-b55b-a2aa28d17b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:52.149452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bed96e-1b26-4f11-b55b-a2aa28d17b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:52.149700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bed96e-1b26-4f11-b55b-a2aa28d17b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:52.150524 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bed96e-1b26-4f11-b55b-a2aa28d17b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:52.152880 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bed96e-1b26-4f11-b55b-a2aa28d17b0e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:52.173453 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1062/2141] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:52.174648 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20649b-2283-45c3-b9fe-6ebb2698b360 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:52.189477 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20649b-2283-45c3-b9fe-6ebb2698b360 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:52.207009 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae64ef-694f-4c73-8753-bd5a9c3ea890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:52.207599 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae64ef-694f-4c73-8753-bd5a9c3ea890 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:52.208218 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae64ef-694f-4c73-8753-bd5a9c3ea890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:52.208621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae64ef-694f-4c73-8753-bd5a9c3ea890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:52.209563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae64ef-694f-4c73-8753-bd5a9c3ea890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:52.211265 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae64ef-694f-4c73-8753-bd5a9c3ea890 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:52.241251 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bed96e-1b26-4f11-b55b-a2aa28d17b0e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:52.260860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1080/2142] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:52.262822 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bed96e-1b26-4f11-b55b-a2aa28d17b0e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:52.282959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e475d-3372-4f90-a623-8e9783b790f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:52.283905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e475d-3372-4f90-a623-8e9783b790f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:52.284190 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e475d-3372-4f90-a623-8e9783b790f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:52.284465 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e475d-3372-4f90-a623-8e9783b790f1 admin admin] PATH_INFO: `/v3/projects/93c1c0a74d6a4392947ee727aa1d3da3/users/98f1a5f6023e47c8b84edab34b308094/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:52.320283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e475d-3372-4f90-a623-8e9783b790f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c1c0a74d6a4392947ee727aa1d3da3, user_id=98f1a5f6023e47c8b84edab34b308094, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:52.323835 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e475d-3372-4f90-a623-8e9783b790f1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:52.382334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1063/2143] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:52 2022] PUT /identity/v3/projects/93c1c0a74d6a4392947ee727aa1d3da3/users/98f1a5f6023e47c8b84edab34b308094/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:52.388156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f26a7-9a12-43f4-a89c-03e3ccf28500 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:52.388457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f26a7-9a12-43f4-a89c-03e3ccf28500 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:52.388765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f26a7-9a12-43f4-a89c-03e3ccf28500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:52.418168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e475d-3372-4f90-a623-8e9783b790f1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:52.420116 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b74e475d-3372-4f90-a623-8e9783b790f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:52.435873 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-516f26a7-9a12-43f4-a89c-03e3ccf28500 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:52.437924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-516f26a7-9a12-43f4-a89c-03e3ccf28500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:52.538420 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1081/2144] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:52.552433 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f26a7-9a12-43f4-a89c-03e3ccf28500 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:52.557517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-516f26a7-9a12-43f4-a89c-03e3ccf28500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:52.575843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e475d-3372-4f90-a623-8e9783b790f1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:52.596600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987c8e0-01da-4b12-9c7c-49f62e158f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:52.597513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987c8e0-01da-4b12-9c7c-49f62e158f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:52.597866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987c8e0-01da-4b12-9c7c-49f62e158f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:52.598086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987c8e0-01da-4b12-9c7c-49f62e158f79 admin admin] PATH_INFO: `/v3/projects/bea0d71f0ba14d168d44b6433ad3a341` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:52.599666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987c8e0-01da-4b12-9c7c-49f62e158f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea0d71f0ba14d168d44b6433ad3a341)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:52.612260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987c8e0-01da-4b12-9c7c-49f62e158f79 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:52.687690 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f26a7-9a12-43f4-a89c-03e3ccf28500 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:52.692410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fcc74-ace6-498b-9597-af7f8666a7d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:52.693246 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fcc74-ace6-498b-9597-af7f8666a7d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:52.693363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fcc74-ace6-498b-9597-af7f8666a7d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:52.693746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fcc74-ace6-498b-9597-af7f8666a7d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:52.710656 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fcc74-ace6-498b-9597-af7f8666a7d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:52.713074 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fcc74-ace6-498b-9597-af7f8666a7d8 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:52.734773 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1082/2145] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:52.801916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b987c8e0-01da-4b12-9c7c-49f62e158f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea0d71f0ba14d168d44b6433ad3a341', 'request_id': 'req-b987c8e0-01da-4b12-9c7c-49f62e158f79'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:52.870996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b987c8e0-01da-4b12-9c7c-49f62e158f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea0d71f0ba14d168d44b6433ad3a341', 'request_id': 'req-b987c8e0-01da-4b12-9c7c-49f62e158f79'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:52.878183 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b987c8e0-01da-4b12-9c7c-49f62e158f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea0d71f0ba14d168d44b6433ad3a341', 'request_id': 'req-b987c8e0-01da-4b12-9c7c-49f62e158f79'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:52.902460 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b987c8e0-01da-4b12-9c7c-49f62e158f79 admin admin] The token cache is being invalidate because project bea0d71f0ba14d168d44b6433ad3a341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:52.902860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b987c8e0-01da-4b12-9c7c-49f62e158f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:52.903735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b987c8e0-01da-4b12-9c7c-49f62e158f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:52.905633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1064/2146] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:52 2022] DELETE /identity/v3/projects/bea0d71f0ba14d168d44b6433ad3a341 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:52.909431 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fcc74-ace6-498b-9597-af7f8666a7d8 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:52.922029 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fcc74-ace6-498b-9597-af7f8666a7d8 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:52.932110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145daa5-aecd-47f8-9f70-9fb30ad53655 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:52.932408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145daa5-aecd-47f8-9f70-9fb30ad53655 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:52.932692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145daa5-aecd-47f8-9f70-9fb30ad53655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:52.980315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f145daa5-aecd-47f8-9f70-9fb30ad53655 None None] MFA Rules not processed for user `b1ef9ab26a7442479ec952d43e392081`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:52.981832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f145daa5-aecd-47f8-9f70-9fb30ad53655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:53.004909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1b6d6-fe8f-448d-8eb6-5ead263c61c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:53.008770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1b6d6-fe8f-448d-8eb6-5ead263c61c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:53.008770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1b6d6-fe8f-448d-8eb6-5ead263c61c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:53.008770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1b6d6-fe8f-448d-8eb6-5ead263c61c7 admin admin] PATH_INFO: `/v3/users/9fa39c0cbb46457abf741818f04c3a18` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:53.008770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1b6d6-fe8f-448d-8eb6-5ead263c61c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fa39c0cbb46457abf741818f04c3a18)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:53.010733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1b6d6-fe8f-448d-8eb6-5ead263c61c7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:53.056947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1065/2147] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:53.061537 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145daa5-aecd-47f8-9f70-9fb30ad53655 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:53.062849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f145daa5-aecd-47f8-9f70-9fb30ad53655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:53.076295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145daa5-aecd-47f8-9f70-9fb30ad53655 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:53.081175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5334544-e6cf-466e-a10d-5752088f7852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:53.081786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5334544-e6cf-466e-a10d-5752088f7852 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:53.086238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5334544-e6cf-466e-a10d-5752088f7852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:53.086238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5334544-e6cf-466e-a10d-5752088f7852 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:53.086238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5334544-e6cf-466e-a10d-5752088f7852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:53.086238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5334544-e6cf-466e-a10d-5752088f7852 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:53.200612 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1066/2148] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:53 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:10:53.204481 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5334544-e6cf-466e-a10d-5752088f7852 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:53.234175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-20e1b6d6-fe8f-448d-8eb6-5ead263c61c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa39c0cbb46457abf741818f04c3a18'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:53.246557 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-20e1b6d6-fe8f-448d-8eb6-5ead263c61c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa39c0cbb46457abf741818f04c3a18'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:53.268220 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5334544-e6cf-466e-a10d-5752088f7852 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:53.278529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96dc4f-2c7a-4fd9-969c-4b1f38e4f0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:53.278529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96dc4f-2c7a-4fd9-969c-4b1f38e4f0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:53.278529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96dc4f-2c7a-4fd9-969c-4b1f38e4f0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:53.278529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96dc4f-2c7a-4fd9-969c-4b1f38e4f0b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:53.278887 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96dc4f-2c7a-4fd9-969c-4b1f38e4f0b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:53.278887 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96dc4f-2c7a-4fd9-969c-4b1f38e4f0b6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:53.330009 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-20e1b6d6-fe8f-448d-8eb6-5ead263c61c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa39c0cbb46457abf741818f04c3a18'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:53.330836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-20e1b6d6-fe8f-448d-8eb6-5ead263c61c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa39c0cbb46457abf741818f04c3a18'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:53.332324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-20e1b6d6-fe8f-448d-8eb6-5ead263c61c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa39c0cbb46457abf741818f04c3a18'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:53.352043 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1083/2149] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:10:52 2022] DELETE /identity/v3/users/9fa39c0cbb46457abf741818f04c3a18 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:53.370312 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1067/2150] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:53 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:10:53.377478 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1b6d6-fe8f-448d-8eb6-5ead263c61c7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:53.378983 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-20e1b6d6-fe8f-448d-8eb6-5ead263c61c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:53.501086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1b6d6-fe8f-448d-8eb6-5ead263c61c7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:53.505757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0244db1-524a-4405-8140-5c6927a444c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:53.506426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0244db1-524a-4405-8140-5c6927a444c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:53.507760 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0244db1-524a-4405-8140-5c6927a444c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:53.507760 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0244db1-524a-4405-8140-5c6927a444c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:53.507760 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0244db1-524a-4405-8140-5c6927a444c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:53.509899 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0244db1-524a-4405-8140-5c6927a444c0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:53.520321 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1084/2151] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:53.525168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96dc4f-2c7a-4fd9-969c-4b1f38e4f0b6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:53.535606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96dc4f-2c7a-4fd9-969c-4b1f38e4f0b6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:53.541155 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36009ce-43a7-4909-ba0f-7d53c3eb8379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:53.542467 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36009ce-43a7-4909-ba0f-7d53c3eb8379 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:53.542467 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36009ce-43a7-4909-ba0f-7d53c3eb8379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:53.542907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36009ce-43a7-4909-ba0f-7d53c3eb8379 admin admin] PATH_INFO: `/v3/projects/0ba2803308604bdcb3bc3f71a44dd87b/users/3d2af87387b44de6a8a4ec914c94b5b1/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:53.572652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36009ce-43a7-4909-ba0f-7d53c3eb8379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba2803308604bdcb3bc3f71a44dd87b, user_id=3d2af87387b44de6a8a4ec914c94b5b1, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:53.575732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36009ce-43a7-4909-ba0f-7d53c3eb8379 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:53.670668 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0244db1-524a-4405-8140-5c6927a444c0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:53.672485 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c0244db1-524a-4405-8140-5c6927a444c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:53.677451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1068/2152] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:53 2022] PUT /identity/v3/projects/0ba2803308604bdcb3bc3f71a44dd87b/users/3d2af87387b44de6a8a4ec914c94b5b1/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:53.680211 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36009ce-43a7-4909-ba0f-7d53c3eb8379 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:53.690718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0244db1-524a-4405-8140-5c6927a444c0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:53.769141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d12085-a9b5-4dbc-bb24-cbadb8395008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:53.770014 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d12085-a9b5-4dbc-bb24-cbadb8395008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:53.770299 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d12085-a9b5-4dbc-bb24-cbadb8395008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:53.770573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d12085-a9b5-4dbc-bb24-cbadb8395008 admin admin] PATH_INFO: `/v3/projects/0a5c9e9a3bb74c7c9733fc44ce01a196` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:53.772009 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d12085-a9b5-4dbc-bb24-cbadb8395008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5c9e9a3bb74c7c9733fc44ce01a196)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:53.772362 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36009ce-43a7-4909-ba0f-7d53c3eb8379 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:53.773931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d12085-a9b5-4dbc-bb24-cbadb8395008 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:53.780973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd20d0-2b6a-4850-a1ed-7c70b7c88e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:53.781682 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd20d0-2b6a-4850-a1ed-7c70b7c88e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:53.781975 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd20d0-2b6a-4850-a1ed-7c70b7c88e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:53.782250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd20d0-2b6a-4850-a1ed-7c70b7c88e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:53.783148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd20d0-2b6a-4850-a1ed-7c70b7c88e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:53.784701 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd20d0-2b6a-4850-a1ed-7c70b7c88e76 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:53.796044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1069/2153] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:53.800079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd20d0-2b6a-4850-a1ed-7c70b7c88e76 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:53.816251 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd20d0-2b6a-4850-a1ed-7c70b7c88e76 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:53.825446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec8e63-db17-4141-99aa-b887218fa23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:53.826413 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec8e63-db17-4141-99aa-b887218fa23f admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:53.826698 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec8e63-db17-4141-99aa-b887218fa23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:53.827025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec8e63-db17-4141-99aa-b887218fa23f admin admin] PATH_INFO: `/v3/projects/0ba2803308604bdcb3bc3f71a44dd87b/users/3d2af87387b44de6a8a4ec914c94b5b1/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:53.830617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec8e63-db17-4141-99aa-b887218fa23f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba2803308604bdcb3bc3f71a44dd87b, user_id=3d2af87387b44de6a8a4ec914c94b5b1, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:53.834790 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec8e63-db17-4141-99aa-b887218fa23f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:53.848742 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1070/2154] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:53 2022] PUT /identity/v3/projects/0ba2803308604bdcb3bc3f71a44dd87b/users/3d2af87387b44de6a8a4ec914c94b5b1/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:53.931913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a0d12085-a9b5-4dbc-bb24-cbadb8395008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5c9e9a3bb74c7c9733fc44ce01a196', 'request_id': 'req-a0d12085-a9b5-4dbc-bb24-cbadb8395008'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:53.938468 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a0d12085-a9b5-4dbc-bb24-cbadb8395008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5c9e9a3bb74c7c9733fc44ce01a196', 'request_id': 'req-a0d12085-a9b5-4dbc-bb24-cbadb8395008'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:53.947985 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a0d12085-a9b5-4dbc-bb24-cbadb8395008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5c9e9a3bb74c7c9733fc44ce01a196', 'request_id': 'req-a0d12085-a9b5-4dbc-bb24-cbadb8395008'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:54.049837 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a0d12085-a9b5-4dbc-bb24-cbadb8395008 admin admin] The token cache is being invalidate because project 0a5c9e9a3bb74c7c9733fc44ce01a196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:10:54.050233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a0d12085-a9b5-4dbc-bb24-cbadb8395008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:54.051372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a0d12085-a9b5-4dbc-bb24-cbadb8395008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:10:54.054063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1085/2155] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:10:53 2022] DELETE /identity/v3/projects/0a5c9e9a3bb74c7c9733fc44ce01a196 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:10:54.059248 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab0dd8-e547-4993-a910-6c8f5380fb38 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:54.059715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab0dd8-e547-4993-a910-6c8f5380fb38 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:54.059820 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab0dd8-e547-4993-a910-6c8f5380fb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:54.094393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6fab0dd8-e547-4993-a910-6c8f5380fb38 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:54.095818 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6fab0dd8-e547-4993-a910-6c8f5380fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:54.166812 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1071/2156] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:54.174589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd728e3-3b45-4f0d-8b50-02fddfdd54ac None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:54.174877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd728e3-3b45-4f0d-8b50-02fddfdd54ac None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:54.175191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd728e3-3b45-4f0d-8b50-02fddfdd54ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:54.210371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5fd728e3-3b45-4f0d-8b50-02fddfdd54ac None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:54.212352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5fd728e3-3b45-4f0d-8b50-02fddfdd54ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:54.222481 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1086/2157] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:54.227010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab0dd8-e547-4993-a910-6c8f5380fb38 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:54.247964 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab0dd8-e547-4993-a910-6c8f5380fb38 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:54.256742 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86501f-a226-4b99-9878-6a3e8f5fa995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:54.257469 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86501f-a226-4b99-9878-6a3e8f5fa995 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:54.257752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86501f-a226-4b99-9878-6a3e8f5fa995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:54.258028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86501f-a226-4b99-9878-6a3e8f5fa995 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:54.261057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86501f-a226-4b99-9878-6a3e8f5fa995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:10:54.261444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86501f-a226-4b99-9878-6a3e8f5fa995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:54.263273 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86501f-a226-4b99-9878-6a3e8f5fa995 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:54.282373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499e19d-a05b-4ae4-872c-379ea6762abb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:54.283022 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499e19d-a05b-4ae4-872c-379ea6762abb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:54.283537 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499e19d-a05b-4ae4-872c-379ea6762abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:54.284210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1072/2158] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:10:54.288348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86501f-a226-4b99-9878-6a3e8f5fa995 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:54.303426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86501f-a226-4b99-9878-6a3e8f5fa995 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:54.311491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb30dc-ad58-40bc-b940-3c43bc0d1545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:54.312745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb30dc-ad58-40bc-b940-3c43bc0d1545 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:54.313602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb30dc-ad58-40bc-b940-3c43bc0d1545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:54.314071 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb30dc-ad58-40bc-b940-3c43bc0d1545 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:54.314999 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb30dc-ad58-40bc-b940-3c43bc0d1545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:54.318324 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb30dc-ad58-40bc-b940-3c43bc0d1545 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:54.322012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6499e19d-a05b-4ae4-872c-379ea6762abb None None] MFA Rules not processed for user `98f1a5f6023e47c8b84edab34b308094`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:54.323822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6499e19d-a05b-4ae4-872c-379ea6762abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:54.393147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1087/2159] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:54.404459 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499e19d-a05b-4ae4-872c-379ea6762abb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:54.406156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6499e19d-a05b-4ae4-872c-379ea6762abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:54.426233 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1073/2160] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:10:54 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:10:54.430022 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb30dc-ad58-40bc-b940-3c43bc0d1545 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:54.507763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499e19d-a05b-4ae4-872c-379ea6762abb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:54.516374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb30dc-ad58-40bc-b940-3c43bc0d1545 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:54.522033 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70105a-cd5d-4b79-a645-70f1ce8f4a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:54.523193 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70105a-cd5d-4b79-a645-70f1ce8f4a0c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:54.523678 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70105a-cd5d-4b79-a645-70f1ce8f4a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:54.524140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70105a-cd5d-4b79-a645-70f1ce8f4a0c admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:54.525712 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70105a-cd5d-4b79-a645-70f1ce8f4a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:54.530692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70105a-cd5d-4b79-a645-70f1ce8f4a0c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:54.603342 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08349c0-3bf6-41d3-8464-abe61018da01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:54.603998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08349c0-3bf6-41d3-8464-abe61018da01 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:54.604277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08349c0-3bf6-41d3-8464-abe61018da01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:54.604641 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08349c0-3bf6-41d3-8464-abe61018da01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:54.632751 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1074/2161] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:10:54 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:10:54.636419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70105a-cd5d-4b79-a645-70f1ce8f4a0c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:54.654185 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70105a-cd5d-4b79-a645-70f1ce8f4a0c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:54.677796 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d41b21-4de7-462e-a412-648eb7b4971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:54.680170 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d41b21-4de7-462e-a412-648eb7b4971e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:54.681153 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d41b21-4de7-462e-a412-648eb7b4971e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:54.682655 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08349c0-3bf6-41d3-8464-abe61018da01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:54.683156 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d41b21-4de7-462e-a412-648eb7b4971e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:54.684326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d41b21-4de7-462e-a412-648eb7b4971e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:54.685076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08349c0-3bf6-41d3-8464-abe61018da01 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:54.689682 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d41b21-4de7-462e-a412-648eb7b4971e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:54.697147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1088/2162] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:10:54.735501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1075/2163] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:54.740208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08349c0-3bf6-41d3-8464-abe61018da01 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:54.764520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08349c0-3bf6-41d3-8464-abe61018da01 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:54.775587 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca7585-13bf-4c32-a1e4-689a3babe3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:54.776280 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca7585-13bf-4c32-a1e4-689a3babe3df admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:54.776551 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca7585-13bf-4c32-a1e4-689a3babe3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:54.776829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca7585-13bf-4c32-a1e4-689a3babe3df admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:54.777567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca7585-13bf-4c32-a1e4-689a3babe3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:54.779726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca7585-13bf-4c32-a1e4-689a3babe3df admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:54.809317 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1089/2164] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:10:54.810657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d41b21-4de7-462e-a412-648eb7b4971e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:54.829167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d41b21-4de7-462e-a412-648eb7b4971e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:54.843895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b296ee-95e6-47b0-a6dd-766ff6302448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:54.844872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b296ee-95e6-47b0-a6dd-766ff6302448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:54.845463 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b296ee-95e6-47b0-a6dd-766ff6302448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:54.847374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b296ee-95e6-47b0-a6dd-766ff6302448 admin admin] PATH_INFO: `/v3/projects/91cd24e20fc14361b194a7155e6f7df7/users/4f0cfe30572e491083dc3df7df7a94aa/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:54.867473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b296ee-95e6-47b0-a6dd-766ff6302448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cd24e20fc14361b194a7155e6f7df7, user_id=4f0cfe30572e491083dc3df7df7a94aa, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:54.870434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b296ee-95e6-47b0-a6dd-766ff6302448 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:55.006683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1076/2165] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:10:54 2022] PUT /identity/v3/projects/91cd24e20fc14361b194a7155e6f7df7/users/4f0cfe30572e491083dc3df7df7a94aa/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:10:55.021670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74466a-c566-46a2-9a31-0007ff1fd809 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:55.021670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74466a-c566-46a2-9a31-0007ff1fd809 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:55.021670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74466a-c566-46a2-9a31-0007ff1fd809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:55.061398 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9b74466a-c566-46a2-9a31-0007ff1fd809 None None] MFA Rules not processed for user `4f0cfe30572e491083dc3df7df7a94aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:55.063270 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9b74466a-c566-46a2-9a31-0007ff1fd809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:55.217904 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1090/2166] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:10:55.452633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b296ee-95e6-47b0-a6dd-766ff6302448 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:55.516579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b296ee-95e6-47b0-a6dd-766ff6302448 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:55.520413 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a586b-3d42-43c1-9a22-7dbc5cf7426d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:55.521075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a586b-3d42-43c1-9a22-7dbc5cf7426d service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:55.521363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a586b-3d42-43c1-9a22-7dbc5cf7426d service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:55.521643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a586b-3d42-43c1-9a22-7dbc5cf7426d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:55.531263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a586b-3d42-43c1-9a22-7dbc5cf7426d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:55.532645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a586b-3d42-43c1-9a22-7dbc5cf7426d service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:55.543532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1077/2167] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:10:57.001121 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90072f83-5d57-4d50-916e-fc47999482df None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:57.001572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90072f83-5d57-4d50-916e-fc47999482df None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:57.001647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90072f83-5d57-4d50-916e-fc47999482df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:57.048453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-90072f83-5d57-4d50-916e-fc47999482df None None] MFA Rules not processed for user `98f1a5f6023e47c8b84edab34b308094`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:10:57.049933 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-90072f83-5d57-4d50-916e-fc47999482df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:57.157610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1091/2168] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:10:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:10:57.219572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a586b-3d42-43c1-9a22-7dbc5cf7426d service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:10:57.221174 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e33a586b-3d42-43c1-9a22-7dbc5cf7426d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:57.235243 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a586b-3d42-43c1-9a22-7dbc5cf7426d service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:10:57.239277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9522e-abde-4e4d-a8ad-025d2e2f6bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:10:57.239986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9522e-abde-4e4d-a8ad-025d2e2f6bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:10:57.240273 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9522e-abde-4e4d-a8ad-025d2e2f6bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:10:57.240579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9522e-abde-4e4d-a8ad-025d2e2f6bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:10:57.242535 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6cf9522e-abde-4e4d-a8ad-025d2e2f6bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:10:57.372646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9522e-abde-4e4d-a8ad-025d2e2f6bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:10:57.382021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9522e-abde-4e4d-a8ad-025d2e2f6bb3 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:10:57.397348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1078/2169] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:10:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:11:01.846200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b5181-626c-4e05-b2e5-f282fdb12edf None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:01.846708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b5181-626c-4e05-b2e5-f282fdb12edf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:01.846873 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b5181-626c-4e05-b2e5-f282fdb12edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:01.881713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-761b5181-626c-4e05-b2e5-f282fdb12edf None None] MFA Rules not processed for user `3d2af87387b44de6a8a4ec914c94b5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:01.883511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-761b5181-626c-4e05-b2e5-f282fdb12edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:01.970323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1092/2170] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:01.983447 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9522e-abde-4e4d-a8ad-025d2e2f6bb3 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:01.988604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6cf9522e-abde-4e4d-a8ad-025d2e2f6bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:02.115847 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9522e-abde-4e4d-a8ad-025d2e2f6bb3 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:02.130350 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac0dab-cdb1-43a4-9cae-cb9844843ade service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68748827b9f14eb7958d5b202c5d6877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:02.130350 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac0dab-cdb1-43a4-9cae-cb9844843ade service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:02.130350 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac0dab-cdb1-43a4-9cae-cb9844843ade service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:02.130350 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac0dab-cdb1-43a4-9cae-cb9844843ade service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:02.130861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c9ac0dab-cdb1-43a4-9cae-cb9844843ade service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:02.211752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac0dab-cdb1-43a4-9cae-cb9844843ade service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:02.213217 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac0dab-cdb1-43a4-9cae-cb9844843ade service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:02.223273 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1079/2171] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:11:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:11:02.448959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac168054-2e0b-4b61-bc02-0e024881d4ca None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:02.449473 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac168054-2e0b-4b61-bc02-0e024881d4ca None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:02.449790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac168054-2e0b-4b61-bc02-0e024881d4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:02.469670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ac168054-2e0b-4b61-bc02-0e024881d4ca None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:02.470879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ac168054-2e0b-4b61-bc02-0e024881d4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:02.536039 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1093/2172] 10.222.0.24 () {58 vars in 1009 bytes} [Tue May 17 22:11:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:11:02.550458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac0dab-cdb1-43a4-9cae-cb9844843ade service glance] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:02.550458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c9ac0dab-cdb1-43a4-9cae-cb9844843ade service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:02.618939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac0dab-cdb1-43a4-9cae-cb9844843ade service glance] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:02.623829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c165a-4d57-4bd6-9135-787f9c33b391 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:02.624469 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c165a-4d57-4bd6-9135-787f9c33b391 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:02.624749 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c165a-4d57-4bd6-9135-787f9c33b391 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:02.625021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c165a-4d57-4bd6-9135-787f9c33b391 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:02.634070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c165a-4d57-4bd6-9135-787f9c33b391 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:02.635700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c165a-4d57-4bd6-9135-787f9c33b391 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:02.643783 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1080/2173] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:11:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 22:11:07.237234 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac168054-2e0b-4b61-bc02-0e024881d4ca None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:07.238689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ac168054-2e0b-4b61-bc02-0e024881d4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:07.337858 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac168054-2e0b-4b61-bc02-0e024881d4ca None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:07.343740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e33b58-c864-4641-9264-f3fcdde500d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:07.345430 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e33b58-c864-4641-9264-f3fcdde500d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:07.345938 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e33b58-c864-4641-9264-f3fcdde500d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:07.346704 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e33b58-c864-4641-9264-f3fcdde500d3 admin admin] PATH_INFO: `/v3/users/4b68bd4646394e8995439c0a695a628d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:07.348637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e33b58-c864-4641-9264-f3fcdde500d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b68bd4646394e8995439c0a695a628d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:07.350915 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e33b58-c864-4641-9264-f3fcdde500d3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:07.870675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e8e33b58-c864-4641-9264-f3fcdde500d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b68bd4646394e8995439c0a695a628d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:07.885014 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e8e33b58-c864-4641-9264-f3fcdde500d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b68bd4646394e8995439c0a695a628d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:08.005822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e8e33b58-c864-4641-9264-f3fcdde500d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b68bd4646394e8995439c0a695a628d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:08.005822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e8e33b58-c864-4641-9264-f3fcdde500d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b68bd4646394e8995439c0a695a628d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:08.005822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e8e33b58-c864-4641-9264-f3fcdde500d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b68bd4646394e8995439c0a695a628d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:08.026242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1094/2174] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:11:07 2022] DELETE /identity/v3/users/4b68bd4646394e8995439c0a695a628d => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:11:08.038973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46854b85-d8ae-4f41-ba2d-45e6a4e0a6a2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:08.039815 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46854b85-d8ae-4f41-ba2d-45e6a4e0a6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:08.040126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46854b85-d8ae-4f41-ba2d-45e6a4e0a6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:08.067798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-46854b85-d8ae-4f41-ba2d-45e6a4e0a6a2 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:08.067798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-46854b85-d8ae-4f41-ba2d-45e6a4e0a6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:08.294997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1081/2175] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:08.316487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e33b58-c864-4641-9264-f3fcdde500d3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:08.318112 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e8e33b58-c864-4641-9264-f3fcdde500d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:08.446778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e33b58-c864-4641-9264-f3fcdde500d3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:08.452547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6cd99-4a82-4675-9d0c-38279cb2fc14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:08.453565 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6cd99-4a82-4675-9d0c-38279cb2fc14 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:08.453991 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6cd99-4a82-4675-9d0c-38279cb2fc14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:08.454423 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6cd99-4a82-4675-9d0c-38279cb2fc14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:08.506057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6cd99-4a82-4675-9d0c-38279cb2fc14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:08.515147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6cd99-4a82-4675-9d0c-38279cb2fc14 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:08.540910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1095/2176] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:11:09.341337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46854b85-d8ae-4f41-ba2d-45e6a4e0a6a2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:09.342780 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-46854b85-d8ae-4f41-ba2d-45e6a4e0a6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:09.355381 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6cd99-4a82-4675-9d0c-38279cb2fc14 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:09.356824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5eb6cd99-4a82-4675-9d0c-38279cb2fc14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:09.366249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46854b85-d8ae-4f41-ba2d-45e6a4e0a6a2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:09.374942 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f2990-f4ad-4f20-b823-dba707c47cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:09.377253 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f2990-f4ad-4f20-b823-dba707c47cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:09.377921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f2990-f4ad-4f20-b823-dba707c47cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:09.378344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f2990-f4ad-4f20-b823-dba707c47cb3 admin admin] PATH_INFO: `/v3/users/4f0cfe30572e491083dc3df7df7a94aa` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:09.382860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6cd99-4a82-4675-9d0c-38279cb2fc14 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:09.390218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f2990-f4ad-4f20-b823-dba707c47cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f0cfe30572e491083dc3df7df7a94aa)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:09.390789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721fa4e-c0f5-4519-bd22-ce94264109f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:09.391947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721fa4e-c0f5-4519-bd22-ce94264109f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:09.392243 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f2990-f4ad-4f20-b823-dba707c47cb3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:09.392855 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721fa4e-c0f5-4519-bd22-ce94264109f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:09.393356 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721fa4e-c0f5-4519-bd22-ce94264109f1 admin admin] PATH_INFO: `/v3/projects/85b63eed38344ab1868e95d71d760f3a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:09.401058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721fa4e-c0f5-4519-bd22-ce94264109f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b63eed38344ab1868e95d71d760f3a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:09.404083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721fa4e-c0f5-4519-bd22-ce94264109f1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:09.588518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3721fa4e-c0f5-4519-bd22-ce94264109f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b63eed38344ab1868e95d71d760f3a', 'request_id': 'req-3721fa4e-c0f5-4519-bd22-ce94264109f1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:09.601416 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3721fa4e-c0f5-4519-bd22-ce94264109f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b63eed38344ab1868e95d71d760f3a', 'request_id': 'req-3721fa4e-c0f5-4519-bd22-ce94264109f1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:09.608590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3721fa4e-c0f5-4519-bd22-ce94264109f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b63eed38344ab1868e95d71d760f3a', 'request_id': 'req-3721fa4e-c0f5-4519-bd22-ce94264109f1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:09.673471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bf3f2990-f4ad-4f20-b823-dba707c47cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f0cfe30572e491083dc3df7df7a94aa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:09.698960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3721fa4e-c0f5-4519-bd22-ce94264109f1 admin admin] The token cache is being invalidate because project 85b63eed38344ab1868e95d71d760f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:11:09.700790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3721fa4e-c0f5-4519-bd22-ce94264109f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:09.701524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3721fa4e-c0f5-4519-bd22-ce94264109f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:09.718683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bf3f2990-f4ad-4f20-b823-dba707c47cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f0cfe30572e491083dc3df7df7a94aa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:09.722137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bf3f2990-f4ad-4f20-b823-dba707c47cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f0cfe30572e491083dc3df7df7a94aa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:09.726476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1096/2177] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:11:09 2022] DELETE /identity/v3/projects/85b63eed38344ab1868e95d71d760f3a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:11:09.730281 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721fa4e-c0f5-4519-bd22-ce94264109f1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:09.738488 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3721fa4e-c0f5-4519-bd22-ce94264109f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:09.802196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bf3f2990-f4ad-4f20-b823-dba707c47cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f0cfe30572e491083dc3df7df7a94aa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:09.803075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bf3f2990-f4ad-4f20-b823-dba707c47cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f0cfe30572e491083dc3df7df7a94aa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:09.823517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1082/2178] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:11:09 2022] DELETE /identity/v3/users/4f0cfe30572e491083dc3df7df7a94aa => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:11:09.829004 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd898e0-c550-4423-8cb8-4700c7dbd125 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:09.829478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd898e0-c550-4423-8cb8-4700c7dbd125 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:09.830313 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd898e0-c550-4423-8cb8-4700c7dbd125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:09.862324 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fdd898e0-c550-4423-8cb8-4700c7dbd125 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:09.865233 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fdd898e0-c550-4423-8cb8-4700c7dbd125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:09.882560 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721fa4e-c0f5-4519-bd22-ce94264109f1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:10.004567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1083/2179] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:10.014359 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a9fad-fe56-4468-a1a7-4c11cd9c7b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:10.015510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a9fad-fe56-4468-a1a7-4c11cd9c7b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:10.016094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a9fad-fe56-4468-a1a7-4c11cd9c7b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:10.017199 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd898e0-c550-4423-8cb8-4700c7dbd125 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:10.019048 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fdd898e0-c550-4423-8cb8-4700c7dbd125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:10.021580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a9fad-fe56-4468-a1a7-4c11cd9c7b0d admin admin] PATH_INFO: `/v3/users/26b0d120bd0d4f4c92686462bc33873a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:10.025343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a9fad-fe56-4468-a1a7-4c11cd9c7b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b0d120bd0d4f4c92686462bc33873a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:10.033541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a9fad-fe56-4468-a1a7-4c11cd9c7b0d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:10.128521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd898e0-c550-4423-8cb8-4700c7dbd125 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:10.134762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c02057-d23d-425b-a145-82220e6121de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:10.135949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c02057-d23d-425b-a145-82220e6121de service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:10.136468 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c02057-d23d-425b-a145-82220e6121de service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:10.136961 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c02057-d23d-425b-a145-82220e6121de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:10.153422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c02057-d23d-425b-a145-82220e6121de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:10.156222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c02057-d23d-425b-a145-82220e6121de service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:10.182131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1084/2180] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:11:10.271998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-df3a9fad-fe56-4468-a1a7-4c11cd9c7b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b0d120bd0d4f4c92686462bc33873a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:10.312754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-df3a9fad-fe56-4468-a1a7-4c11cd9c7b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b0d120bd0d4f4c92686462bc33873a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:10.393069 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-df3a9fad-fe56-4468-a1a7-4c11cd9c7b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b0d120bd0d4f4c92686462bc33873a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:10.393715 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-df3a9fad-fe56-4468-a1a7-4c11cd9c7b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b0d120bd0d4f4c92686462bc33873a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:10.394283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-df3a9fad-fe56-4468-a1a7-4c11cd9c7b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b0d120bd0d4f4c92686462bc33873a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:10.452833 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1097/2181] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:11:09 2022] DELETE /identity/v3/users/26b0d120bd0d4f4c92686462bc33873a => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:11:10.872995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c02057-d23d-425b-a145-82220e6121de service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:10.874447 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-05c02057-d23d-425b-a145-82220e6121de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:10.907758 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c02057-d23d-425b-a145-82220e6121de service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:11.027428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d22b29-2e17-4dfb-8b71-809ca2343355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:11.028688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d22b29-2e17-4dfb-8b71-809ca2343355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:11.028688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d22b29-2e17-4dfb-8b71-809ca2343355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:11.029510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d22b29-2e17-4dfb-8b71-809ca2343355 admin admin] PATH_INFO: `/v3/projects/91cd24e20fc14361b194a7155e6f7df7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:11.036012 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d22b29-2e17-4dfb-8b71-809ca2343355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91cd24e20fc14361b194a7155e6f7df7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:11.037967 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d22b29-2e17-4dfb-8b71-809ca2343355 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:11.180645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a9fad-fe56-4468-a1a7-4c11cd9c7b0d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:11.183352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-df3a9fad-fe56-4468-a1a7-4c11cd9c7b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:11.217179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a9fad-fe56-4468-a1a7-4c11cd9c7b0d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:11.228440 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70d22b29-2e17-4dfb-8b71-809ca2343355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91cd24e20fc14361b194a7155e6f7df7', 'request_id': 'req-70d22b29-2e17-4dfb-8b71-809ca2343355'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:11.307121 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70d22b29-2e17-4dfb-8b71-809ca2343355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91cd24e20fc14361b194a7155e6f7df7', 'request_id': 'req-70d22b29-2e17-4dfb-8b71-809ca2343355'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:11.316260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70d22b29-2e17-4dfb-8b71-809ca2343355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91cd24e20fc14361b194a7155e6f7df7', 'request_id': 'req-70d22b29-2e17-4dfb-8b71-809ca2343355'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:11.334100 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6fba4-3cbf-425e-8ec0-00d41a93a3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:11.335632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6fba4-3cbf-425e-8ec0-00d41a93a3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:11.337567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6fba4-3cbf-425e-8ec0-00d41a93a3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:11.337961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6fba4-3cbf-425e-8ec0-00d41a93a3c5 admin admin] PATH_INFO: `/v3/projects/c049efa853a040049b57c4e6a1d21c68` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:11.339903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6fba4-3cbf-425e-8ec0-00d41a93a3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c049efa853a040049b57c4e6a1d21c68)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:11.342817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6fba4-3cbf-425e-8ec0-00d41a93a3c5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:11.348891 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70d22b29-2e17-4dfb-8b71-809ca2343355 admin admin] The token cache is being invalidate because project 91cd24e20fc14361b194a7155e6f7df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:11:11.349165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70d22b29-2e17-4dfb-8b71-809ca2343355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:11.353345 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70d22b29-2e17-4dfb-8b71-809ca2343355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:11.360786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1085/2182] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:11:10 2022] DELETE /identity/v3/projects/91cd24e20fc14361b194a7155e6f7df7 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:11:11.362601 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac217ea4-f741-4400-874c-2e3e77f56888 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:11.362912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac217ea4-f741-4400-874c-2e3e77f56888 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:11.363281 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac217ea4-f741-4400-874c-2e3e77f56888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:11.400510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ac217ea4-f741-4400-874c-2e3e77f56888 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:11.401184 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ac217ea4-f741-4400-874c-2e3e77f56888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:11.423287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1086/2183] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:11:11.431707 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b11e74-d1f6-4520-8a66-feaf57c91f92 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:11.431707 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b11e74-d1f6-4520-8a66-feaf57c91f92 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:11.431707 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b11e74-d1f6-4520-8a66-feaf57c91f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:11.450781 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-95b11e74-d1f6-4520-8a66-feaf57c91f92 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:11.452023 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-95b11e74-d1f6-4520-8a66-feaf57c91f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:11.463526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1087/2184] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:11.465520 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758407f8-89ff-4759-9aad-1df5f85f07e1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:11.466650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758407f8-89ff-4759-9aad-1df5f85f07e1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:11.467171 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758407f8-89ff-4759-9aad-1df5f85f07e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:11.491814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-758407f8-89ff-4759-9aad-1df5f85f07e1 None None] MFA Rules not processed for user `8cc69cd4250c436e8b893887604b2273`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:11.493354 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-758407f8-89ff-4759-9aad-1df5f85f07e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:11.499684 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-91a6fba4-3cbf-425e-8ec0-00d41a93a3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c049efa853a040049b57c4e6a1d21c68', 'request_id': 'req-91a6fba4-3cbf-425e-8ec0-00d41a93a3c5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:11.512751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-91a6fba4-3cbf-425e-8ec0-00d41a93a3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c049efa853a040049b57c4e6a1d21c68', 'request_id': 'req-91a6fba4-3cbf-425e-8ec0-00d41a93a3c5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:11.520363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-91a6fba4-3cbf-425e-8ec0-00d41a93a3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c049efa853a040049b57c4e6a1d21c68', 'request_id': 'req-91a6fba4-3cbf-425e-8ec0-00d41a93a3c5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:11.583283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1088/2185] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:11.583283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758407f8-89ff-4759-9aad-1df5f85f07e1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:11.609580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-91a6fba4-3cbf-425e-8ec0-00d41a93a3c5 admin admin] The token cache is being invalidate because project c049efa853a040049b57c4e6a1d21c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:11:11.609580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-91a6fba4-3cbf-425e-8ec0-00d41a93a3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:11.610234 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-91a6fba4-3cbf-425e-8ec0-00d41a93a3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:11.616711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1098/2186] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:11:11 2022] DELETE /identity/v3/projects/c049efa853a040049b57c4e6a1d21c68 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:11:11.619221 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2a292-3934-4e3f-a6ee-981b72ae38da None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:11.619512 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2a292-3934-4e3f-a6ee-981b72ae38da None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:11.619786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2a292-3934-4e3f-a6ee-981b72ae38da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:11.650488 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d0a2a292-3934-4e3f-a6ee-981b72ae38da None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:11.652111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d0a2a292-3934-4e3f-a6ee-981b72ae38da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:11.711659 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758407f8-89ff-4759-9aad-1df5f85f07e1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:11.718507 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ddfaa-afe9-4001-bb7e-73915b06ef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:11.719565 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ddfaa-afe9-4001-bb7e-73915b06ef67 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:11.719967 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ddfaa-afe9-4001-bb7e-73915b06ef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:11.720347 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ddfaa-afe9-4001-bb7e-73915b06ef67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:11.721194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ddfaa-afe9-4001-bb7e-73915b06ef67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:11:11.721611 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ddfaa-afe9-4001-bb7e-73915b06ef67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:11.723459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ddfaa-afe9-4001-bb7e-73915b06ef67 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:11.737662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1099/2187] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:11.750805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0539319-88e0-4077-867a-a7d49fc800db None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:11.751311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0539319-88e0-4077-867a-a7d49fc800db None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:11.752353 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0539319-88e0-4077-867a-a7d49fc800db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:11.755194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1089/2188] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:11:11.758021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ddfaa-afe9-4001-bb7e-73915b06ef67 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:11.760369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-071ddfaa-afe9-4001-bb7e-73915b06ef67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:11.774974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ddfaa-afe9-4001-bb7e-73915b06ef67 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:11.787248 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefcfed-2ae2-4e7d-bbc9-566cd8f0f92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:11.788217 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefcfed-2ae2-4e7d-bbc9-566cd8f0f92b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:11.788682 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefcfed-2ae2-4e7d-bbc9-566cd8f0f92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:11.789741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefcfed-2ae2-4e7d-bbc9-566cd8f0f92b admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:11.790689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefcfed-2ae2-4e7d-bbc9-566cd8f0f92b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:11.792809 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefcfed-2ae2-4e7d-bbc9-566cd8f0f92b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:11.798571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e0539319-88e0-4077-867a-a7d49fc800db None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:11.800026 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e0539319-88e0-4077-867a-a7d49fc800db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:11.812705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1100/2189] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:11.815629 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0539319-88e0-4077-867a-a7d49fc800db None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:11.831479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0539319-88e0-4077-867a-a7d49fc800db None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:11.838336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac94071-7775-474d-9985-1c56cb94dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:11.839125 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94071-7775-474d-9985-1c56cb94dec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:11.839540 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94071-7775-474d-9985-1c56cb94dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:11.839892 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94071-7775-474d-9985-1c56cb94dec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:11.840714 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac94071-7775-474d-9985-1c56cb94dec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:11:11.841088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac94071-7775-474d-9985-1c56cb94dec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:11.843090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac94071-7775-474d-9985-1c56cb94dec6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:11.856821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1101/2190] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:11:11.861363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac94071-7775-474d-9985-1c56cb94dec6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:11.881379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac94071-7775-474d-9985-1c56cb94dec6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:11.886688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1090/2191] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:11:11 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:11:11.892851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefcfed-2ae2-4e7d-bbc9-566cd8f0f92b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:11.974925 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6334978-257e-46c8-b3ed-32df9958dbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:11.975597 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6334978-257e-46c8-b3ed-32df9958dbdb admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:11.976370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6334978-257e-46c8-b3ed-32df9958dbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:11.976726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6334978-257e-46c8-b3ed-32df9958dbdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:11.978350 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6334978-257e-46c8-b3ed-32df9958dbdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:11.980352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6334978-257e-46c8-b3ed-32df9958dbdb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:12.013820 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefcfed-2ae2-4e7d-bbc9-566cd8f0f92b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:12.018324 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25872f53-e6c2-4dee-afc2-aeb1f63f0738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:12.020266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25872f53-e6c2-4dee-afc2-aeb1f63f0738 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:12.020389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25872f53-e6c2-4dee-afc2-aeb1f63f0738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:12.022888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25872f53-e6c2-4dee-afc2-aeb1f63f0738 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:12.027262 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25872f53-e6c2-4dee-afc2-aeb1f63f0738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:12.029246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25872f53-e6c2-4dee-afc2-aeb1f63f0738 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:12.146732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1102/2193] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:11:11 2022] POST /identity/v3/projects => generated 377 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:11:12.147168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1091/2193] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:11:11 2022] POST /identity/v3/users => generated 295 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:11:12.160546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6334978-257e-46c8-b3ed-32df9958dbdb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:12.161847 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25872f53-e6c2-4dee-afc2-aeb1f63f0738 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:12.173108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25872f53-e6c2-4dee-afc2-aeb1f63f0738 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:12.255142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da3cd2-4355-42e4-bcd6-76550ab10e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:12.255913 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da3cd2-4355-42e4-bcd6-76550ab10e11 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:12.256201 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da3cd2-4355-42e4-bcd6-76550ab10e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:12.256480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da3cd2-4355-42e4-bcd6-76550ab10e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:12.257217 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da3cd2-4355-42e4-bcd6-76550ab10e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:12.259395 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da3cd2-4355-42e4-bcd6-76550ab10e11 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:12.264722 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6334978-257e-46c8-b3ed-32df9958dbdb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:12.269785 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ff74a-a6b2-448f-81fe-62be1c45b811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:12.271668 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ff74a-a6b2-448f-81fe-62be1c45b811 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:12.272147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ff74a-a6b2-448f-81fe-62be1c45b811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:12.272275 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1092/2194] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:11:12.272737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ff74a-a6b2-448f-81fe-62be1c45b811 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:12.274093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ff74a-a6b2-448f-81fe-62be1c45b811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:12.276256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ff74a-a6b2-448f-81fe-62be1c45b811 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:12.277750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da3cd2-4355-42e4-bcd6-76550ab10e11 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:12.291656 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da3cd2-4355-42e4-bcd6-76550ab10e11 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:12.298736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c8164-c436-4063-a948-23c7b93f0364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:12.299431 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c8164-c436-4063-a948-23c7b93f0364 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:12.299721 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c8164-c436-4063-a948-23c7b93f0364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:12.300001 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c8164-c436-4063-a948-23c7b93f0364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:12.300734 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c8164-c436-4063-a948-23c7b93f0364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:12.302390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c8164-c436-4063-a948-23c7b93f0364 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:12.314127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1093/2195] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:11:12.318976 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c8164-c436-4063-a948-23c7b93f0364 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:12.330028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c8164-c436-4063-a948-23c7b93f0364 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:12.337622 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a23aa-e486-4841-847a-1e14dc0d20b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:12.338768 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a23aa-e486-4841-847a-1e14dc0d20b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:12.339068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a23aa-e486-4841-847a-1e14dc0d20b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:12.339383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a23aa-e486-4841-847a-1e14dc0d20b0 admin admin] PATH_INFO: `/v3/projects/242e2fc5b0f343a9a004872a110276b4/users/029e4b8b86ef4fa7b9d03ffc9ddba2ee/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:12.358418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a23aa-e486-4841-847a-1e14dc0d20b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=242e2fc5b0f343a9a004872a110276b4, user_id=029e4b8b86ef4fa7b9d03ffc9ddba2ee, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:12.362817 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a23aa-e486-4841-847a-1e14dc0d20b0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:12.802312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1103/2196] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:11:12 2022] POST /identity/v3/users => generated 289 bytes in 641 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:11:12.802795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1094/2197] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:11:12 2022] PUT /identity/v3/projects/242e2fc5b0f343a9a004872a110276b4/users/029e4b8b86ef4fa7b9d03ffc9ddba2ee/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:11:12.812590 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ff74a-a6b2-448f-81fe-62be1c45b811 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:12.816690 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a193d1-9828-4fe4-8dcd-8af52346c1cc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:12.816690 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a193d1-9828-4fe4-8dcd-8af52346c1cc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:12.816690 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a193d1-9828-4fe4-8dcd-8af52346c1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:12.829973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ff74a-a6b2-448f-81fe-62be1c45b811 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:12.866613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e9a193d1-9828-4fe4-8dcd-8af52346c1cc None None] MFA Rules not processed for user `029e4b8b86ef4fa7b9d03ffc9ddba2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:12.867406 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e9a193d1-9828-4fe4-8dcd-8af52346c1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:12.962017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34748e92-b0bc-4eaf-8b01-95a7ba4e3473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:12.962796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34748e92-b0bc-4eaf-8b01-95a7ba4e3473 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:12.963186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34748e92-b0bc-4eaf-8b01-95a7ba4e3473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:12.963529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34748e92-b0bc-4eaf-8b01-95a7ba4e3473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:12.964338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34748e92-b0bc-4eaf-8b01-95a7ba4e3473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:12.966358 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34748e92-b0bc-4eaf-8b01-95a7ba4e3473 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:12.980099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1104/2198] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:11:12.982260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1095/2199] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:12.986995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34748e92-b0bc-4eaf-8b01-95a7ba4e3473 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:12.998396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a193d1-9828-4fe4-8dcd-8af52346c1cc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:12.999950 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e9a193d1-9828-4fe4-8dcd-8af52346c1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:13.019680 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34748e92-b0bc-4eaf-8b01-95a7ba4e3473 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:13.028378 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aec318-4800-456c-8dd5-06014402c41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:13.029411 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aec318-4800-456c-8dd5-06014402c41b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:13.029837 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aec318-4800-456c-8dd5-06014402c41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:13.030247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aec318-4800-456c-8dd5-06014402c41b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:13.031272 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aec318-4800-456c-8dd5-06014402c41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:13.034366 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aec318-4800-456c-8dd5-06014402c41b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:13.061936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1105/2200] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:11:13.063593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aec318-4800-456c-8dd5-06014402c41b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:13.088987 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aec318-4800-456c-8dd5-06014402c41b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:13.095016 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62453d-8a21-4832-822f-ae938b0a249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:13.096306 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62453d-8a21-4832-822f-ae938b0a249d admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:13.096663 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62453d-8a21-4832-822f-ae938b0a249d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:13.096947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62453d-8a21-4832-822f-ae938b0a249d admin admin] PATH_INFO: `/v3/projects/91d62af58bf94a8a959b4dad70e4b500/users/f6b2685b37a14ef6a824647b4b6f7586/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:13.115527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62453d-8a21-4832-822f-ae938b0a249d admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d62af58bf94a8a959b4dad70e4b500, user_id=f6b2685b37a14ef6a824647b4b6f7586, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:13.118967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62453d-8a21-4832-822f-ae938b0a249d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:13.123300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a193d1-9828-4fe4-8dcd-8af52346c1cc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:13.127055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68c255-8d0b-4943-aa5c-bf13a5cde9ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:13.127782 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68c255-8d0b-4943-aa5c-bf13a5cde9ac service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:13.128168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68c255-8d0b-4943-aa5c-bf13a5cde9ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:13.128429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68c255-8d0b-4943-aa5c-bf13a5cde9ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:13.140209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68c255-8d0b-4943-aa5c-bf13a5cde9ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:13.141651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68c255-8d0b-4943-aa5c-bf13a5cde9ac service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:13.154000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1096/2201] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:11:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:11:13.243517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1106/2202] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:11:13 2022] PUT /identity/v3/projects/91d62af58bf94a8a959b4dad70e4b500/users/f6b2685b37a14ef6a824647b4b6f7586/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:11:13.250430 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604069c-c2ae-481c-8920-be6f3cdc991b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:13.250702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604069c-c2ae-481c-8920-be6f3cdc991b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:13.250986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604069c-c2ae-481c-8920-be6f3cdc991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:13.282372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8604069c-c2ae-481c-8920-be6f3cdc991b None None] MFA Rules not processed for user `f6b2685b37a14ef6a824647b4b6f7586`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:13.283959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8604069c-c2ae-481c-8920-be6f3cdc991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:13.386401 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1097/2203] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:13.651751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62453d-8a21-4832-822f-ae938b0a249d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:13.653525 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1f62453d-8a21-4832-822f-ae938b0a249d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:13.759755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62453d-8a21-4832-822f-ae938b0a249d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:13.763348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311da17e-02f7-41bb-81aa-85153afc4948 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:13.764002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311da17e-02f7-41bb-81aa-85153afc4948 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:13.764344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311da17e-02f7-41bb-81aa-85153afc4948 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:13.764607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311da17e-02f7-41bb-81aa-85153afc4948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:13.777979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311da17e-02f7-41bb-81aa-85153afc4948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:13.779463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311da17e-02f7-41bb-81aa-85153afc4948 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:13.794703 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1107/2204] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:11:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:11:18.079142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064d18-a0ac-4bdc-9d84-f9311ccbc0b1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:18.079646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064d18-a0ac-4bdc-9d84-f9311ccbc0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:18.079827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064d18-a0ac-4bdc-9d84-f9311ccbc0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:18.102360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-66064d18-a0ac-4bdc-9d84-f9311ccbc0b1 None None] MFA Rules not processed for user `4bbb6a0a08464e738ef0d062dfe87182`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:18.106096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-66064d18-a0ac-4bdc-9d84-f9311ccbc0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:18.158895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1098/2205] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:18.336912 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7782b-2838-429e-a264-5535817f7d2e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:18.342305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7782b-2838-429e-a264-5535817f7d2e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:18.342305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7782b-2838-429e-a264-5535817f7d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:18.363894 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-46b7782b-2838-429e-a264-5535817f7d2e None None] MFA Rules not processed for user `b1ef9ab26a7442479ec952d43e392081`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:18.365080 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-46b7782b-2838-429e-a264-5535817f7d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:18.428307 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1108/2206] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:35.335541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9abbb-19a7-4e54-bc28-fadd22363814 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:35.335541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9abbb-19a7-4e54-bc28-fadd22363814 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:35.335541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9abbb-19a7-4e54-bc28-fadd22363814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:35.416217 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4eb9abbb-19a7-4e54-bc28-fadd22363814 None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:35.418310 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4eb9abbb-19a7-4e54-bc28-fadd22363814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:35.551199 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1099/2207] 10.222.0.24 () {58 vars in 1009 bytes} [Tue May 17 22:11:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:11:35.566167 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7782b-2838-429e-a264-5535817f7d2e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:35.569205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-46b7782b-2838-429e-a264-5535817f7d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:35.680013 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7782b-2838-429e-a264-5535817f7d2e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:35.686592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53a7c2-3188-4fc1-aa67-836d89474f47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:35.687561 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53a7c2-3188-4fc1-aa67-836d89474f47 service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:35.687995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53a7c2-3188-4fc1-aa67-836d89474f47 service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:35.688435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53a7c2-3188-4fc1-aa67-836d89474f47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:35.699976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53a7c2-3188-4fc1-aa67-836d89474f47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:35.702534 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53a7c2-3188-4fc1-aa67-836d89474f47 service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:35.714740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1109/2208] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:11:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 22:11:39.888548 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9abbb-19a7-4e54-bc28-fadd22363814 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:40.031021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9abbb-19a7-4e54-bc28-fadd22363814 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:40.036264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f60da-5086-444a-829c-82755f75e646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:40.037240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f60da-5086-444a-829c-82755f75e646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:40.039070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f60da-5086-444a-829c-82755f75e646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:40.039070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f60da-5086-444a-829c-82755f75e646 admin admin] PATH_INFO: `/v3/users/029e4b8b86ef4fa7b9d03ffc9ddba2ee` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:40.039323 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f60da-5086-444a-829c-82755f75e646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=029e4b8b86ef4fa7b9d03ffc9ddba2ee)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:40.041408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f60da-5086-444a-829c-82755f75e646 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:40.299975 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b18f60da-5086-444a-829c-82755f75e646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029e4b8b86ef4fa7b9d03ffc9ddba2ee'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:40.337499 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b18f60da-5086-444a-829c-82755f75e646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029e4b8b86ef4fa7b9d03ffc9ddba2ee'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:40.338505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b18f60da-5086-444a-829c-82755f75e646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029e4b8b86ef4fa7b9d03ffc9ddba2ee'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:40.411904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b18f60da-5086-444a-829c-82755f75e646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029e4b8b86ef4fa7b9d03ffc9ddba2ee'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:40.412790 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b18f60da-5086-444a-829c-82755f75e646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029e4b8b86ef4fa7b9d03ffc9ddba2ee'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:40.431070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1100/2209] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:11:39 2022] DELETE /identity/v3/users/029e4b8b86ef4fa7b9d03ffc9ddba2ee => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:11:40.436089 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcd618-7b25-401a-97fa-6fd00a1c0558 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:40.436648 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcd618-7b25-401a-97fa-6fd00a1c0558 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:40.437460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcd618-7b25-401a-97fa-6fd00a1c0558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:40.480264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c6fcd618-7b25-401a-97fa-6fd00a1c0558 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:40.481787 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c6fcd618-7b25-401a-97fa-6fd00a1c0558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:40.585002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1110/2210] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:40.602544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f60da-5086-444a-829c-82755f75e646 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:40.615456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b18f60da-5086-444a-829c-82755f75e646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:40.701912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f60da-5086-444a-829c-82755f75e646 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:40.710717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d125ecd-b95d-4318-a046-8c219e85f04a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:40.711429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d125ecd-b95d-4318-a046-8c219e85f04a service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:40.711710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d125ecd-b95d-4318-a046-8c219e85f04a service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:40.712032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d125ecd-b95d-4318-a046-8c219e85f04a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:40.723748 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d125ecd-b95d-4318-a046-8c219e85f04a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:40.734707 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d125ecd-b95d-4318-a046-8c219e85f04a service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:40.758092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1101/2211] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:11:41.842295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcd618-7b25-401a-97fa-6fd00a1c0558 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:41.843976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c6fcd618-7b25-401a-97fa-6fd00a1c0558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:41.858174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcd618-7b25-401a-97fa-6fd00a1c0558 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:41.865402 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82a95c-f9af-4232-82fe-1904b61915e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:41.866737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82a95c-f9af-4232-82fe-1904b61915e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:41.867238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82a95c-f9af-4232-82fe-1904b61915e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:41.867800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82a95c-f9af-4232-82fe-1904b61915e6 admin admin] PATH_INFO: `/v3/projects/242e2fc5b0f343a9a004872a110276b4` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:41.869432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82a95c-f9af-4232-82fe-1904b61915e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=242e2fc5b0f343a9a004872a110276b4)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:41.878923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82a95c-f9af-4232-82fe-1904b61915e6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:42.009850 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7c82a95c-f9af-4232-82fe-1904b61915e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '242e2fc5b0f343a9a004872a110276b4', 'request_id': 'req-7c82a95c-f9af-4232-82fe-1904b61915e6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:42.017756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7c82a95c-f9af-4232-82fe-1904b61915e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '242e2fc5b0f343a9a004872a110276b4', 'request_id': 'req-7c82a95c-f9af-4232-82fe-1904b61915e6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:42.024435 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7c82a95c-f9af-4232-82fe-1904b61915e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '242e2fc5b0f343a9a004872a110276b4', 'request_id': 'req-7c82a95c-f9af-4232-82fe-1904b61915e6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:42.110491 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7c82a95c-f9af-4232-82fe-1904b61915e6 admin admin] The token cache is being invalidate because project 242e2fc5b0f343a9a004872a110276b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:11:42.110784 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7c82a95c-f9af-4232-82fe-1904b61915e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:42.112062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7c82a95c-f9af-4232-82fe-1904b61915e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:42.113901 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1111/2212] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:11:41 2022] DELETE /identity/v3/projects/242e2fc5b0f343a9a004872a110276b4 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:11:47.147760 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d125ecd-b95d-4318-a046-8c219e85f04a service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:47.149213 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0d125ecd-b95d-4318-a046-8c219e85f04a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:47.162318 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d125ecd-b95d-4318-a046-8c219e85f04a service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:47.221267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b46b9-81db-4b16-9436-1498b2421260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:47.222457 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b46b9-81db-4b16-9436-1498b2421260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:47.222895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b46b9-81db-4b16-9436-1498b2421260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:47.223366 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b46b9-81db-4b16-9436-1498b2421260 admin admin] PATH_INFO: `/v3/users/f6b2685b37a14ef6a824647b4b6f7586` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:47.224813 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b46b9-81db-4b16-9436-1498b2421260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b2685b37a14ef6a824647b4b6f7586)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:47.226977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b46b9-81db-4b16-9436-1498b2421260 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:47.436737 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fe5b46b9-81db-4b16-9436-1498b2421260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b2685b37a14ef6a824647b4b6f7586'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:47.448809 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fe5b46b9-81db-4b16-9436-1498b2421260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b2685b37a14ef6a824647b4b6f7586'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:47.449655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fe5b46b9-81db-4b16-9436-1498b2421260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b2685b37a14ef6a824647b4b6f7586'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:47.517695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fe5b46b9-81db-4b16-9436-1498b2421260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b2685b37a14ef6a824647b4b6f7586'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:47.518342 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fe5b46b9-81db-4b16-9436-1498b2421260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b2685b37a14ef6a824647b4b6f7586'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:47.534841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1102/2213] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:11:47 2022] DELETE /identity/v3/users/f6b2685b37a14ef6a824647b4b6f7586 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:11:47.536108 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374ef83-ac17-4820-af1d-439b11cc99fe None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:47.536616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374ef83-ac17-4820-af1d-439b11cc99fe None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:47.536801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374ef83-ac17-4820-af1d-439b11cc99fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:47.554927 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3374ef83-ac17-4820-af1d-439b11cc99fe None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:47.556150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3374ef83-ac17-4820-af1d-439b11cc99fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:47.614818 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1112/2214] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:47.625107 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b46b9-81db-4b16-9436-1498b2421260 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:47.626478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fe5b46b9-81db-4b16-9436-1498b2421260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:47.689696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b46b9-81db-4b16-9436-1498b2421260 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:47.693660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c068-8671-41a8-abbd-ac8e7102cb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:47.695269 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c068-8671-41a8-abbd-ac8e7102cb4b service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:47.700525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c068-8671-41a8-abbd-ac8e7102cb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:47.700525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c068-8671-41a8-abbd-ac8e7102cb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:47.706226 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599c068-8671-41a8-abbd-ac8e7102cb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:47.707780 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599c068-8671-41a8-abbd-ac8e7102cb4b service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:47.726007 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1103/2215] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:11:48.480170 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f88b6-3542-4842-922e-2a4b8036c1ae None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:48.481319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f88b6-3542-4842-922e-2a4b8036c1ae None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:48.481319 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f88b6-3542-4842-922e-2a4b8036c1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:48.500617 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-327f88b6-3542-4842-922e-2a4b8036c1ae None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:48.501929 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-327f88b6-3542-4842-922e-2a4b8036c1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:48.539909 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c068-8671-41a8-abbd-ac8e7102cb4b service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:48.542003 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4599c068-8671-41a8-abbd-ac8e7102cb4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:48.558133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c068-8671-41a8-abbd-ac8e7102cb4b service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:48.566258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddbc6b-0296-4cf3-ab91-8eea7c6009d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:48.567536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddbc6b-0296-4cf3-ab91-8eea7c6009d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:48.568054 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddbc6b-0296-4cf3-ab91-8eea7c6009d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:48.568545 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddbc6b-0296-4cf3-ab91-8eea7c6009d0 admin admin] PATH_INFO: `/v3/projects/91d62af58bf94a8a959b4dad70e4b500` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:48.569991 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddbc6b-0296-4cf3-ab91-8eea7c6009d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d62af58bf94a8a959b4dad70e4b500)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:48.572223 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddbc6b-0296-4cf3-ab91-8eea7c6009d0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:48.588165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1113/2216] 10.222.0.24 () {58 vars in 1009 bytes} [Tue May 17 22:11:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:48.609383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f88b6-3542-4842-922e-2a4b8036c1ae None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:48.611128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-327f88b6-3542-4842-922e-2a4b8036c1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:48.702722 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f88b6-3542-4842-922e-2a4b8036c1ae None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:48.712862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-eeddbc6b-0296-4cf3-ab91-8eea7c6009d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d62af58bf94a8a959b4dad70e4b500', 'request_id': 'req-eeddbc6b-0296-4cf3-ab91-8eea7c6009d0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:48.772335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-eeddbc6b-0296-4cf3-ab91-8eea7c6009d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d62af58bf94a8a959b4dad70e4b500', 'request_id': 'req-eeddbc6b-0296-4cf3-ab91-8eea7c6009d0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:48.791264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-eeddbc6b-0296-4cf3-ab91-8eea7c6009d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d62af58bf94a8a959b4dad70e4b500', 'request_id': 'req-eeddbc6b-0296-4cf3-ab91-8eea7c6009d0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:48.792177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d5c53-49a2-446c-b0b4-ff77c7e60560 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:48.793899 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d5c53-49a2-446c-b0b4-ff77c7e60560 service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:48.794332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d5c53-49a2-446c-b0b4-ff77c7e60560 service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:48.794831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d5c53-49a2-446c-b0b4-ff77c7e60560 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:48.805955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-eeddbc6b-0296-4cf3-ab91-8eea7c6009d0 admin admin] The token cache is being invalidate because project 91d62af58bf94a8a959b4dad70e4b500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:11:48.806965 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-eeddbc6b-0296-4cf3-ab91-8eea7c6009d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:48.807871 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-eeddbc6b-0296-4cf3-ab91-8eea7c6009d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:11:48.810598 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1104/2217] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:11:48 2022] DELETE /identity/v3/projects/91d62af58bf94a8a959b4dad70e4b500 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:11:48.815835 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d896786-73d6-4adf-997a-af85fc74261d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:48.816794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d896786-73d6-4adf-997a-af85fc74261d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:48.816794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d896786-73d6-4adf-997a-af85fc74261d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:48.837997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1d896786-73d6-4adf-997a-af85fc74261d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:48.839496 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1d896786-73d6-4adf-997a-af85fc74261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:48.868237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d5c53-49a2-446c-b0b4-ff77c7e60560 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:48.869946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d5c53-49a2-446c-b0b4-ff77c7e60560 service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:48.879835 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1114/2218] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:11:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 22:11:48.967264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1105/2219] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:11:48.976351 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4fd50-cee9-46fa-bc66-f6dfa2f8ad95 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:48.976636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4fd50-cee9-46fa-bc66-f6dfa2f8ad95 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:48.976912 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4fd50-cee9-46fa-bc66-f6dfa2f8ad95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:49.008209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2df4fd50-cee9-46fa-bc66-f6dfa2f8ad95 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:49.009848 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2df4fd50-cee9-46fa-bc66-f6dfa2f8ad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:49.038519 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1115/2220] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:49.042314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d896786-73d6-4adf-997a-af85fc74261d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:49.053510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d896786-73d6-4adf-997a-af85fc74261d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:49.059617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8e4d4-04fb-4711-b784-269450f1f001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:49.060248 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8e4d4-04fb-4711-b784-269450f1f001 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:49.060603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8e4d4-04fb-4711-b784-269450f1f001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:49.060957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8e4d4-04fb-4711-b784-269450f1f001 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:49.061897 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8e4d4-04fb-4711-b784-269450f1f001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:11:49.062279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8e4d4-04fb-4711-b784-269450f1f001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:49.064384 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8e4d4-04fb-4711-b784-269450f1f001 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:49.087169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1106/2221] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:11:49.104907 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4fd50-cee9-46fa-bc66-f6dfa2f8ad95 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:49.119162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4fd50-cee9-46fa-bc66-f6dfa2f8ad95 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:49.125652 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255e99a-b4ca-4b0a-901a-b7adb61305ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:49.126395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255e99a-b4ca-4b0a-901a-b7adb61305ce admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:49.126747 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255e99a-b4ca-4b0a-901a-b7adb61305ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:49.127100 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255e99a-b4ca-4b0a-901a-b7adb61305ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:49.127951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255e99a-b4ca-4b0a-901a-b7adb61305ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:49.129982 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255e99a-b4ca-4b0a-901a-b7adb61305ce admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:49.222195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1116/2222] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:11:49 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:11:49.226014 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8e4d4-04fb-4711-b784-269450f1f001 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:49.243842 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8e4d4-04fb-4711-b784-269450f1f001 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:49.327965 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cbeb3-4359-4898-b29a-c6628fcb59eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:49.328832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cbeb3-4359-4898-b29a-c6628fcb59eb admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:49.331569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cbeb3-4359-4898-b29a-c6628fcb59eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:49.336935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cbeb3-4359-4898-b29a-c6628fcb59eb admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:49.336935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cbeb3-4359-4898-b29a-c6628fcb59eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:49.336935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cbeb3-4359-4898-b29a-c6628fcb59eb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:49.443683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1107/2223] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:11:49 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:11:49.449096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255e99a-b4ca-4b0a-901a-b7adb61305ce admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:49.469591 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255e99a-b4ca-4b0a-901a-b7adb61305ce admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:49.481934 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b506b29-7129-406f-8c3b-152e07a0f9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:49.483040 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b506b29-7129-406f-8c3b-152e07a0f9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:49.483926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b506b29-7129-406f-8c3b-152e07a0f9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:49.484379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b506b29-7129-406f-8c3b-152e07a0f9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:49.485399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b506b29-7129-406f-8c3b-152e07a0f9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:49.492653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b506b29-7129-406f-8c3b-152e07a0f9e1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:49.510160 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1117/2224] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:11:49.514541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cbeb3-4359-4898-b29a-c6628fcb59eb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:49.532094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cbeb3-4359-4898-b29a-c6628fcb59eb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:49.540572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6eb93-8b30-429a-8a94-914b6c467233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:49.542044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6eb93-8b30-429a-8a94-914b6c467233 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:49.543242 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6eb93-8b30-429a-8a94-914b6c467233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:49.543369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6eb93-8b30-429a-8a94-914b6c467233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:49.544140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6eb93-8b30-429a-8a94-914b6c467233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:49.546028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6eb93-8b30-429a-8a94-914b6c467233 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:49.561454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1108/2225] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:11:49.565459 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b506b29-7129-406f-8c3b-152e07a0f9e1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:49.584338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b506b29-7129-406f-8c3b-152e07a0f9e1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:49.600832 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b87b8-0a56-4655-b613-3a4c8495b98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:49.603239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b87b8-0a56-4655-b613-3a4c8495b98a admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:49.603739 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b87b8-0a56-4655-b613-3a4c8495b98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:49.604218 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b87b8-0a56-4655-b613-3a4c8495b98a admin admin] PATH_INFO: `/v3/projects/8cb417f91c56432a9f7d9ef7bcf528f9/users/091ee1085f2648649053108559390cd1/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:49.636264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b87b8-0a56-4655-b613-3a4c8495b98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb417f91c56432a9f7d9ef7bcf528f9, user_id=091ee1085f2648649053108559390cd1, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:49.641058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b87b8-0a56-4655-b613-3a4c8495b98a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:49.950321 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1118/2226] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:11:49 2022] PUT /identity/v3/projects/8cb417f91c56432a9f7d9ef7bcf528f9/users/091ee1085f2648649053108559390cd1/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:11:49.952216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154e705-f548-4ed5-9345-53dc443cfbf7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:49.952509 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154e705-f548-4ed5-9345-53dc443cfbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:49.952789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154e705-f548-4ed5-9345-53dc443cfbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:49.974826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1154e705-f548-4ed5-9345-53dc443cfbf7 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:49.976204 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1154e705-f548-4ed5-9345-53dc443cfbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:50.110232 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1109/2227] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:50.119230 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b87b8-0a56-4655-b613-3a4c8495b98a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:50.124963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-020b87b8-0a56-4655-b613-3a4c8495b98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:50.197948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b87b8-0a56-4655-b613-3a4c8495b98a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:50.202354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84728150-92d6-4ed3-bd94-28fc801b123d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:50.203073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84728150-92d6-4ed3-bd94-28fc801b123d service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:50.203389 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84728150-92d6-4ed3-bd94-28fc801b123d service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:50.203665 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84728150-92d6-4ed3-bd94-28fc801b123d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:50.216082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84728150-92d6-4ed3-bd94-28fc801b123d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:50.217552 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84728150-92d6-4ed3-bd94-28fc801b123d service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:50.230944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1119/2228] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:11:53.329962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d632d-64de-4106-b5d6-87ab557743a6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:53.330602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d632d-64de-4106-b5d6-87ab557743a6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:53.330602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d632d-64de-4106-b5d6-87ab557743a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:53.377183 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a04d632d-64de-4106-b5d6-87ab557743a6 None None] MFA Rules not processed for user `091ee1085f2648649053108559390cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:53.378419 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a04d632d-64de-4106-b5d6-87ab557743a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:53.455605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1110/2229] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:53.469692 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84728150-92d6-4ed3-bd94-28fc801b123d service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:53.472871 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-84728150-92d6-4ed3-bd94-28fc801b123d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:53.553738 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84728150-92d6-4ed3-bd94-28fc801b123d service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:53.558471 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d022c-69d5-478d-b8ce-9540a594dca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:53.560176 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d022c-69d5-478d-b8ce-9540a594dca4 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:53.561444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d022c-69d5-478d-b8ce-9540a594dca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:53.562083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d022c-69d5-478d-b8ce-9540a594dca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:53.572871 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d022c-69d5-478d-b8ce-9540a594dca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:53.575685 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d022c-69d5-478d-b8ce-9540a594dca4 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:53.586380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1120/2230] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:11:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:11:55.559176 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3e646-381b-4e8b-a0da-dc59ed62dc9d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:55.560344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3e646-381b-4e8b-a0da-dc59ed62dc9d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:55.560789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3e646-381b-4e8b-a0da-dc59ed62dc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:55.587204 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-71b3e646-381b-4e8b-a0da-dc59ed62dc9d None None] MFA Rules not processed for user `091ee1085f2648649053108559390cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:11:55.593308 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-71b3e646-381b-4e8b-a0da-dc59ed62dc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:55.597466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1111/2231] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:11:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:11:58.366536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d022c-69d5-478d-b8ce-9540a594dca4 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:11:58.369093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f00d022c-69d5-478d-b8ce-9540a594dca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:58.507564 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d022c-69d5-478d-b8ce-9540a594dca4 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:11:58.517322 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea7498-dd3b-4b49-9e92-df2caf50620c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cbd89f9b7a24b6cb993ca86e964c54d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:11:58.517993 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea7498-dd3b-4b49-9e92-df2caf50620c service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:11:58.518381 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea7498-dd3b-4b49-9e92-df2caf50620c service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:11:58.518609 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea7498-dd3b-4b49-9e92-df2caf50620c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:11:58.523259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-feea7498-dd3b-4b49-9e92-df2caf50620c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:11:58.550156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea7498-dd3b-4b49-9e92-df2caf50620c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:11:58.555644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea7498-dd3b-4b49-9e92-df2caf50620c service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:11:58.563936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1121/2232] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:11:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:12:18.262244 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ddca-bbb6-4378-a8e3-1a07e1bdd893 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:12:18.263015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ddca-bbb6-4378-a8e3-1a07e1bdd893 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:12:18.263015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ddca-bbb6-4378-a8e3-1a07e1bdd893 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:12:18.264970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1112/2233] 10.222.0.24 () {54 vars in 921 bytes} [Tue May 17 22:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:12:18.271220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181161d-4062-403e-a5bf-768ae673380a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:12:18.272076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181161d-4062-403e-a5bf-768ae673380a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:12:18.272076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181161d-4062-403e-a5bf-768ae673380a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:12:18.341883 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5181161d-4062-403e-a5bf-768ae673380a None None] MFA Rules not processed for user `8d06113649924eae83d04bc22337bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:12:18.343089 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5181161d-4062-403e-a5bf-768ae673380a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:12:18.428964 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1122/2234] 10.222.0.24 () {58 vars in 1018 bytes} [Tue May 17 22:12:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:12:18.442652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921ddca-bbb6-4378-a8e3-1a07e1bdd893 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:12:18.444378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f921ddca-bbb6-4378-a8e3-1a07e1bdd893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:12:18.536247 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921ddca-bbb6-4378-a8e3-1a07e1bdd893 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:12:18.544113 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b4638-1e4c-48b5-a228-95633b412c28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68748827b9f14eb7958d5b202c5d6877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:12:18.544811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b4638-1e4c-48b5-a228-95633b412c28 service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:12:18.545096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b4638-1e4c-48b5-a228-95633b412c28 service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:12:18.545377 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b4638-1e4c-48b5-a228-95633b412c28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:12:18.556740 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b4638-1e4c-48b5-a228-95633b412c28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:12:18.558214 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b4638-1e4c-48b5-a228-95633b412c28 service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:12:18.572246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1113/2235] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:12:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:12:18.790735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ced921-fee4-4596-ae68-7eb7e06e21e2 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:12:18.791021 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ced921-fee4-4596-ae68-7eb7e06e21e2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:12:18.791328 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ced921-fee4-4596-ae68-7eb7e06e21e2 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:12:18.792709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1123/2236] 10.222.0.24 () {54 vars in 921 bytes} [Tue May 17 22:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:12:18.798497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c321b5-cef4-4492-a7e0-5308cac292b1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:12:18.803313 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c321b5-cef4-4492-a7e0-5308cac292b1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:12:18.803313 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c321b5-cef4-4492-a7e0-5308cac292b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:12:18.840490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-28c321b5-cef4-4492-a7e0-5308cac292b1 None None] MFA Rules not processed for user `c084b56d682c44119654743809109bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:12:18.841844 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-28c321b5-cef4-4492-a7e0-5308cac292b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:12:18.849913 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1114/2237] 10.222.0.24 () {58 vars in 1018 bytes} [Tue May 17 22:12:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:12:18.864880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ced921-fee4-4596-ae68-7eb7e06e21e2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:12:18.878644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ced921-fee4-4596-ae68-7eb7e06e21e2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:12:18.882720 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9dbf4-0a7a-44f7-b451-b3023a3259c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:12:18.883394 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9dbf4-0a7a-44f7-b451-b3023a3259c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:12:18.883760 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9dbf4-0a7a-44f7-b451-b3023a3259c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:12:18.884040 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9dbf4-0a7a-44f7-b451-b3023a3259c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:12:18.895574 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9dbf4-0a7a-44f7-b451-b3023a3259c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:12:18.897205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9dbf4-0a7a-44f7-b451-b3023a3259c9 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:12:18.908066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1124/2238] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:12:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:12:19.004811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c71a4-df43-44af-830a-6d79de22bdea None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:12:19.005104 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c71a4-df43-44af-830a-6d79de22bdea None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:12:19.005389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c71a4-df43-44af-830a-6d79de22bdea None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:12:19.006861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1115/2239] 10.222.0.24 () {54 vars in 921 bytes} [Tue May 17 22:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 22:12:19.013348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c32c61-61c9-47f9-babd-1496cdf72afa None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:12:19.013629 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c32c61-61c9-47f9-babd-1496cdf72afa None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:12:19.013906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c32c61-61c9-47f9-babd-1496cdf72afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:12:19.037456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e0c32c61-61c9-47f9-babd-1496cdf72afa None None] MFA Rules not processed for user `8d06113649924eae83d04bc22337bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:12:19.038640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e0c32c61-61c9-47f9-babd-1496cdf72afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:12:19.050633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1125/2240] 10.222.0.24 () {58 vars in 1018 bytes} [Tue May 17 22:12:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:12:19.062137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c71a4-df43-44af-830a-6d79de22bdea None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:12:19.072770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c71a4-df43-44af-830a-6d79de22bdea None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:12:19.078725 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51f6ed-56e3-43c7-bc9c-3a85705a44c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:12:19.079432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51f6ed-56e3-43c7-bc9c-3a85705a44c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:12:19.079719 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51f6ed-56e3-43c7-bc9c-3a85705a44c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:12:19.080020 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51f6ed-56e3-43c7-bc9c-3a85705a44c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:12:19.091214 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51f6ed-56e3-43c7-bc9c-3a85705a44c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:12:19.092679 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51f6ed-56e3-43c7-bc9c-3a85705a44c9 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:12:19.104126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1116/2241] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:12:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:12:26.476515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1893443-ed61-4240-9e4c-8da85d19af64 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:12:26.477004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1893443-ed61-4240-9e4c-8da85d19af64 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:12:26.477105 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1893443-ed61-4240-9e4c-8da85d19af64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:12:26.494805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f1893443-ed61-4240-9e4c-8da85d19af64 None None] MFA Rules not processed for user `091ee1085f2648649053108559390cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:12:26.496140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f1893443-ed61-4240-9e4c-8da85d19af64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:12:26.503290 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1126/2242] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:12:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:12:28.356205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51f6ed-56e3-43c7-bc9c-3a85705a44c9 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:12:28.365551 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51f6ed-56e3-43c7-bc9c-3a85705a44c9 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:12:28.369323 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d471149-f1ee-4123-ba7b-6e7902da4515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:12:28.369933 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d471149-f1ee-4123-ba7b-6e7902da4515 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:12:28.370216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d471149-f1ee-4123-ba7b-6e7902da4515 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:12:28.370493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d471149-f1ee-4123-ba7b-6e7902da4515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:12:28.372905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7d471149-f1ee-4123-ba7b-6e7902da4515 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:12:28.435339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d471149-f1ee-4123-ba7b-6e7902da4515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:12:28.436784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d471149-f1ee-4123-ba7b-6e7902da4515 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:12:28.446428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1117/2243] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:12:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:12:34.025735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b9b54-5d91-4683-91af-0adf2dbefbdd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:12:34.026228 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b9b54-5d91-4683-91af-0adf2dbefbdd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:12:34.026323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b9b54-5d91-4683-91af-0adf2dbefbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:12:34.050674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8a1b9b54-5d91-4683-91af-0adf2dbefbdd None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:12:34.052389 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8a1b9b54-5d91-4683-91af-0adf2dbefbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:12:34.189258 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1127/2244] 10.222.0.24 () {58 vars in 1009 bytes} [Tue May 17 22:12:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:12:34.203145 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d471149-f1ee-4123-ba7b-6e7902da4515 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:12:34.205258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7d471149-f1ee-4123-ba7b-6e7902da4515 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:12:34.290064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d471149-f1ee-4123-ba7b-6e7902da4515 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:12:34.296408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1886e2-ddf1-4ffa-83b2-b128ccccfcee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:12:34.297290 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1886e2-ddf1-4ffa-83b2-b128ccccfcee service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:12:34.297713 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1886e2-ddf1-4ffa-83b2-b128ccccfcee service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:12:34.298147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1886e2-ddf1-4ffa-83b2-b128ccccfcee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:12:34.307581 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1886e2-ddf1-4ffa-83b2-b128ccccfcee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:12:34.310655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1886e2-ddf1-4ffa-83b2-b128ccccfcee service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:12:34.320363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1118/2245] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:12:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 22:12:58.836549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82483895-94ea-43cb-8cad-01099ea95ec1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:12:58.837168 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82483895-94ea-43cb-8cad-01099ea95ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:12:58.837168 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82483895-94ea-43cb-8cad-01099ea95ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:12:58.856983 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-82483895-94ea-43cb-8cad-01099ea95ec1 None None] MFA Rules not processed for user `98f1a5f6023e47c8b84edab34b308094`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:12:58.858334 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-82483895-94ea-43cb-8cad-01099ea95ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:12:58.944136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1128/2246] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:12:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:13:02.857040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830e1eb-4d88-4a64-9e71-f0ba72f68371 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:02.858023 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830e1eb-4d88-4a64-9e71-f0ba72f68371 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:02.858408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830e1eb-4d88-4a64-9e71-f0ba72f68371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:02.877515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0830e1eb-4d88-4a64-9e71-f0ba72f68371 None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:13:02.878809 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0830e1eb-4d88-4a64-9e71-f0ba72f68371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:13:02.888149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1119/2247] 10.222.0.24 () {58 vars in 967 bytes} [Tue May 17 22:13:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:13:02.916991 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82483895-94ea-43cb-8cad-01099ea95ec1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:13:02.931244 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82483895-94ea-43cb-8cad-01099ea95ec1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:13:02.935858 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e079f-9a4e-4a50-8c33-59f64ddc50bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:13:02.936672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e079f-9a4e-4a50-8c33-59f64ddc50bd service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:02.937054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e079f-9a4e-4a50-8c33-59f64ddc50bd service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:02.937601 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e079f-9a4e-4a50-8c33-59f64ddc50bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:02.946749 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e079f-9a4e-4a50-8c33-59f64ddc50bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:13:02.948524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e079f-9a4e-4a50-8c33-59f64ddc50bd service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:13:02.957949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1129/2248] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:13:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 22:13:12.314634 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d60d01-9983-454d-a39a-4455429ade35 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:12.315236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d60d01-9983-454d-a39a-4455429ade35 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:12.315236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d60d01-9983-454d-a39a-4455429ade35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:12.333640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-90d60d01-9983-454d-a39a-4455429ade35 None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:13:12.334888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-90d60d01-9983-454d-a39a-4455429ade35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:13:12.342409 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1120/2249] 10.222.0.24 () {58 vars in 1009 bytes} [Tue May 17 22:13:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:13:12.356288 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e079f-9a4e-4a50-8c33-59f64ddc50bd service swift] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:13:12.366811 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e079f-9a4e-4a50-8c33-59f64ddc50bd service swift] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:13:12.375012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bead03-30ab-48de-9a91-045b3538432b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:13:12.376669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bead03-30ab-48de-9a91-045b3538432b service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:12.377165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bead03-30ab-48de-9a91-045b3538432b service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:12.377618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bead03-30ab-48de-9a91-045b3538432b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:12.386154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bead03-30ab-48de-9a91-045b3538432b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:13:12.388022 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bead03-30ab-48de-9a91-045b3538432b service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:13:12.397172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1130/2250] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:13:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 22:13:31.864342 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f81abe-8bfc-4de1-8009-5a6fd76bda75 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:31.864911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f81abe-8bfc-4de1-8009-5a6fd76bda75 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:31.865084 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f81abe-8bfc-4de1-8009-5a6fd76bda75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:31.881123 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb132e1-aab6-4206-894a-3bec4848bd94 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:31.882474 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb132e1-aab6-4206-894a-3bec4848bd94 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:31.882984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb132e1-aab6-4206-894a-3bec4848bd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:31.884575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f3f81abe-8bfc-4de1-8009-5a6fd76bda75 None None] MFA Rules not processed for user `8cc69cd4250c436e8b893887604b2273`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:13:31.885958 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f3f81abe-8bfc-4de1-8009-5a6fd76bda75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:13:31.901923 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6fb132e1-aab6-4206-894a-3bec4848bd94 None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:13:31.903137 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6fb132e1-aab6-4206-894a-3bec4848bd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:13:31.911158 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1131/2251] 10.222.0.24 () {58 vars in 967 bytes} [Tue May 17 22:13:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:13:31.924279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb132e1-aab6-4206-894a-3bec4848bd94 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:13:31.937578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb132e1-aab6-4206-894a-3bec4848bd94 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:13:31.952796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf48e97-fde5-480a-967e-5ad4e7eb148f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:13:31.954447 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf48e97-fde5-480a-967e-5ad4e7eb148f service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:31.954982 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf48e97-fde5-480a-967e-5ad4e7eb148f service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:31.955337 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf48e97-fde5-480a-967e-5ad4e7eb148f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:31.967252 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1121/2252] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:13:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:13:31.976221 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf48e97-fde5-480a-967e-5ad4e7eb148f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:13:31.977824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf48e97-fde5-480a-967e-5ad4e7eb148f service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:13:31.988125 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1132/2253] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:13:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 22:13:32.118339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e16ced-e931-4d1d-a23f-78a2fbb093d4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:32.118638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e16ced-e931-4d1d-a23f-78a2fbb093d4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:32.118926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e16ced-e931-4d1d-a23f-78a2fbb093d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:32.138529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-63e16ced-e931-4d1d-a23f-78a2fbb093d4 None None] MFA Rules not processed for user `4bbb6a0a08464e738ef0d062dfe87182`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:13:32.139769 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-63e16ced-e931-4d1d-a23f-78a2fbb093d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:13:32.210325 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1122/2254] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:13:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:13:38.212406 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf48e97-fde5-480a-967e-5ad4e7eb148f service swift] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:13:38.227512 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf48e97-fde5-480a-967e-5ad4e7eb148f service swift] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:13:38.233072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd027d-c210-4608-b6a0-21c561793bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:13:38.233940 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd027d-c210-4608-b6a0-21c561793bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:38.234230 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd027d-c210-4608-b6a0-21c561793bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:38.235014 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd027d-c210-4608-b6a0-21c561793bd6 admin admin] PATH_INFO: `/v3/users/091ee1085f2648649053108559390cd1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:38.236252 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd027d-c210-4608-b6a0-21c561793bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=091ee1085f2648649053108559390cd1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:13:38.238161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd027d-c210-4608-b6a0-21c561793bd6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:13:38.405892 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-21cd027d-c210-4608-b6a0-21c561793bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091ee1085f2648649053108559390cd1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:38.418210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-21cd027d-c210-4608-b6a0-21c561793bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091ee1085f2648649053108559390cd1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:38.485288 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-21cd027d-c210-4608-b6a0-21c561793bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091ee1085f2648649053108559390cd1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:38.485910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-21cd027d-c210-4608-b6a0-21c561793bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091ee1085f2648649053108559390cd1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:38.486563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-21cd027d-c210-4608-b6a0-21c561793bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091ee1085f2648649053108559390cd1'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:38.498900 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1133/2255] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:13:38 2022] DELETE /identity/v3/users/091ee1085f2648649053108559390cd1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:13:38.829354 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e16ced-e931-4d1d-a23f-78a2fbb093d4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:13:38.840270 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e16ced-e931-4d1d-a23f-78a2fbb093d4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:13:38.913271 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8cff6-a8fa-40bb-9af8-e5eb15e1f0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:13:38.914243 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8cff6-a8fa-40bb-9af8-e5eb15e1f0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:38.914590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8cff6-a8fa-40bb-9af8-e5eb15e1f0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:38.915050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8cff6-a8fa-40bb-9af8-e5eb15e1f0b3 admin admin] PATH_INFO: `/v3/projects/8cb417f91c56432a9f7d9ef7bcf528f9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:38.916547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8cff6-a8fa-40bb-9af8-e5eb15e1f0b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cb417f91c56432a9f7d9ef7bcf528f9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:13:38.918525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8cff6-a8fa-40bb-9af8-e5eb15e1f0b3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:13:39.039348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c7c8cff6-a8fa-40bb-9af8-e5eb15e1f0b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cb417f91c56432a9f7d9ef7bcf528f9', 'request_id': 'req-c7c8cff6-a8fa-40bb-9af8-e5eb15e1f0b3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:39.098856 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c7c8cff6-a8fa-40bb-9af8-e5eb15e1f0b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cb417f91c56432a9f7d9ef7bcf528f9', 'request_id': 'req-c7c8cff6-a8fa-40bb-9af8-e5eb15e1f0b3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:39.105033 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c7c8cff6-a8fa-40bb-9af8-e5eb15e1f0b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cb417f91c56432a9f7d9ef7bcf528f9', 'request_id': 'req-c7c8cff6-a8fa-40bb-9af8-e5eb15e1f0b3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:39.117258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c7c8cff6-a8fa-40bb-9af8-e5eb15e1f0b3 admin admin] The token cache is being invalidate because project 8cb417f91c56432a9f7d9ef7bcf528f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:13:39.117543 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c7c8cff6-a8fa-40bb-9af8-e5eb15e1f0b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:39.118185 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c7c8cff6-a8fa-40bb-9af8-e5eb15e1f0b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:39.119760 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1123/2256] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:13:38 2022] DELETE /identity/v3/projects/8cb417f91c56432a9f7d9ef7bcf528f9 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:13:39.124674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c87690-d9b0-450b-b692-caffadc27cc5 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:39.125560 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c87690-d9b0-450b-b692-caffadc27cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:39.125855 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c87690-d9b0-450b-b692-caffadc27cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:39.143605 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e5c87690-d9b0-450b-b692-caffadc27cc5 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:13:39.144820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e5c87690-d9b0-450b-b692-caffadc27cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:13:39.204504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1134/2257] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:13:39.211991 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a863e-41b7-4927-b67a-12fd884d12f2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:39.212283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a863e-41b7-4927-b67a-12fd884d12f2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:39.212586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a863e-41b7-4927-b67a-12fd884d12f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:39.230964 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-498a863e-41b7-4927-b67a-12fd884d12f2 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:13:39.232171 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-498a863e-41b7-4927-b67a-12fd884d12f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:13:39.243454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1124/2258] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:13:39.247635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c87690-d9b0-450b-b692-caffadc27cc5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:13:39.258142 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c87690-d9b0-450b-b692-caffadc27cc5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:13:39.262659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b4c2a-2cac-46d2-acd3-adeb19d0ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:13:39.263407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b4c2a-2cac-46d2-acd3-adeb19d0ec11 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:39.263688 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b4c2a-2cac-46d2-acd3-adeb19d0ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:39.263963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b4c2a-2cac-46d2-acd3-adeb19d0ec11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:39.264687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b4c2a-2cac-46d2-acd3-adeb19d0ec11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:13:39.264992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b4c2a-2cac-46d2-acd3-adeb19d0ec11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:13:39.266761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b4c2a-2cac-46d2-acd3-adeb19d0ec11 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:13:39.277940 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1135/2259] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:13:39.282849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a863e-41b7-4927-b67a-12fd884d12f2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:13:39.291794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a863e-41b7-4927-b67a-12fd884d12f2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:13:39.296305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a284063-2b49-47ce-a391-8b6b23149c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:13:39.297635 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a284063-2b49-47ce-a391-8b6b23149c9d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:39.297926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a284063-2b49-47ce-a391-8b6b23149c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:39.298196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a284063-2b49-47ce-a391-8b6b23149c9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:39.298880 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a284063-2b49-47ce-a391-8b6b23149c9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:13:39.300794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a284063-2b49-47ce-a391-8b6b23149c9d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:13:39.378002 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1125/2260] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:13:39 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:13:39.381471 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b4c2a-2cac-46d2-acd3-adeb19d0ec11 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:13:39.391699 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b4c2a-2cac-46d2-acd3-adeb19d0ec11 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:13:39.445415 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad33e85-24a5-4676-aa1a-3d08db043d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:13:39.446071 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad33e85-24a5-4676-aa1a-3d08db043d15 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:39.446351 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad33e85-24a5-4676-aa1a-3d08db043d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:39.446626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad33e85-24a5-4676-aa1a-3d08db043d15 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:39.447337 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad33e85-24a5-4676-aa1a-3d08db043d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:13:39.449271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad33e85-24a5-4676-aa1a-3d08db043d15 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:13:39.554362 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1136/2261] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:13:39 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:13:39.558586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a284063-2b49-47ce-a391-8b6b23149c9d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:13:39.569642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a284063-2b49-47ce-a391-8b6b23149c9d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:13:39.574363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a3e53-03c4-466d-ba35-a75ed199ad8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:13:39.575012 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a3e53-03c4-466d-ba35-a75ed199ad8f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:39.575321 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a3e53-03c4-466d-ba35-a75ed199ad8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:39.575594 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a3e53-03c4-466d-ba35-a75ed199ad8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:39.576317 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a3e53-03c4-466d-ba35-a75ed199ad8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:13:39.577905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a3e53-03c4-466d-ba35-a75ed199ad8f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:13:39.588659 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1126/2262] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:13:39.592711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad33e85-24a5-4676-aa1a-3d08db043d15 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:13:39.603070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad33e85-24a5-4676-aa1a-3d08db043d15 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:13:39.607848 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050dc48-c461-4224-9d02-965f7e752af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:13:39.608497 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050dc48-c461-4224-9d02-965f7e752af9 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:39.608774 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050dc48-c461-4224-9d02-965f7e752af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:39.609043 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050dc48-c461-4224-9d02-965f7e752af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:39.609960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050dc48-c461-4224-9d02-965f7e752af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:13:39.611555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050dc48-c461-4224-9d02-965f7e752af9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:13:39.621188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1137/2263] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:13:39.625257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a3e53-03c4-466d-ba35-a75ed199ad8f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:13:39.634741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a3e53-03c4-466d-ba35-a75ed199ad8f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:13:39.639239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea04ae5-b7e2-4482-8e0a-f71316ef7bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:13:39.640091 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea04ae5-b7e2-4482-8e0a-f71316ef7bee admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:39.640367 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea04ae5-b7e2-4482-8e0a-f71316ef7bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:39.641151 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea04ae5-b7e2-4482-8e0a-f71316ef7bee admin admin] PATH_INFO: `/v3/projects/bd4276655426428f936a55af730f06d6/users/8e5c3e26c69b40b79ccab87de7fc1494/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:39.655536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea04ae5-b7e2-4482-8e0a-f71316ef7bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd4276655426428f936a55af730f06d6, user_id=8e5c3e26c69b40b79ccab87de7fc1494, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:13:39.659308 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea04ae5-b7e2-4482-8e0a-f71316ef7bee admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:13:39.736396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1127/2264] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:13:39 2022] PUT /identity/v3/projects/bd4276655426428f936a55af730f06d6/users/8e5c3e26c69b40b79ccab87de7fc1494/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:13:39.803801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d329c00-88d1-4593-9ea9-258da74b84d3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:39.804352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d329c00-88d1-4593-9ea9-258da74b84d3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:39.804755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d329c00-88d1-4593-9ea9-258da74b84d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:39.837317 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2d329c00-88d1-4593-9ea9-258da74b84d3 None None] MFA Rules not processed for user `8e5c3e26c69b40b79ccab87de7fc1494`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:13:39.838508 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2d329c00-88d1-4593-9ea9-258da74b84d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:13:39.905951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1138/2265] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:13:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:13:39.917120 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea04ae5-b7e2-4482-8e0a-f71316ef7bee admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:13:39.919028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0ea04ae5-b7e2-4482-8e0a-f71316ef7bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:13:39.981149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea04ae5-b7e2-4482-8e0a-f71316ef7bee admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:13:39.984770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662eda8-bb34-4767-baea-e09e3c414806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:13:39.985398 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662eda8-bb34-4767-baea-e09e3c414806 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:39.985676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662eda8-bb34-4767-baea-e09e3c414806 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:39.985948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662eda8-bb34-4767-baea-e09e3c414806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:40.000781 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662eda8-bb34-4767-baea-e09e3c414806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:13:40.002224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662eda8-bb34-4767-baea-e09e3c414806 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:13:40.011378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1128/2266] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:13:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:13:51.580126 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d329c00-88d1-4593-9ea9-258da74b84d3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:13:51.642427 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d329c00-88d1-4593-9ea9-258da74b84d3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:13:51.646987 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507c1c7-c407-41d9-8c45-ff7f9c0f51e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:13:51.647953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507c1c7-c407-41d9-8c45-ff7f9c0f51e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:51.648233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507c1c7-c407-41d9-8c45-ff7f9c0f51e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:51.648537 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507c1c7-c407-41d9-8c45-ff7f9c0f51e1 admin admin] PATH_INFO: `/v3/users/8e5c3e26c69b40b79ccab87de7fc1494` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:51.649691 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507c1c7-c407-41d9-8c45-ff7f9c0f51e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e5c3e26c69b40b79ccab87de7fc1494)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:13:51.651647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507c1c7-c407-41d9-8c45-ff7f9c0f51e1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:13:51.810677 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a507c1c7-c407-41d9-8c45-ff7f9c0f51e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e5c3e26c69b40b79ccab87de7fc1494'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:51.824193 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a507c1c7-c407-41d9-8c45-ff7f9c0f51e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e5c3e26c69b40b79ccab87de7fc1494'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:51.887431 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a507c1c7-c407-41d9-8c45-ff7f9c0f51e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e5c3e26c69b40b79ccab87de7fc1494'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:51.891954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a507c1c7-c407-41d9-8c45-ff7f9c0f51e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e5c3e26c69b40b79ccab87de7fc1494'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:51.891954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a507c1c7-c407-41d9-8c45-ff7f9c0f51e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e5c3e26c69b40b79ccab87de7fc1494'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:51.903276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1139/2267] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:13:51 2022] DELETE /identity/v3/users/8e5c3e26c69b40b79ccab87de7fc1494 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:13:51.908497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9f982-3b0b-4872-a35f-aa1ac6a2daf5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:51.909000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9f982-3b0b-4872-a35f-aa1ac6a2daf5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:51.909097 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9f982-3b0b-4872-a35f-aa1ac6a2daf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:51.927897 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-68f9f982-3b0b-4872-a35f-aa1ac6a2daf5 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:13:51.929149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-68f9f982-3b0b-4872-a35f-aa1ac6a2daf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:13:51.991963 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1129/2268] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:13:52.001903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507c1c7-c407-41d9-8c45-ff7f9c0f51e1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:13:52.003565 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a507c1c7-c407-41d9-8c45-ff7f9c0f51e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:13:52.067239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507c1c7-c407-41d9-8c45-ff7f9c0f51e1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:13:52.071809 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bf1d0-d1c2-4294-a0f2-422d22328bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:13:52.072532 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bf1d0-d1c2-4294-a0f2-422d22328bae service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:52.072880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bf1d0-d1c2-4294-a0f2-422d22328bae service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:52.073241 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bf1d0-d1c2-4294-a0f2-422d22328bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:52.082991 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bf1d0-d1c2-4294-a0f2-422d22328bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:13:52.084461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bf1d0-d1c2-4294-a0f2-422d22328bae service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:13:52.094024 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1140/2269] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:13:52.486581 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9f982-3b0b-4872-a35f-aa1ac6a2daf5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:13:52.488197 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-68f9f982-3b0b-4872-a35f-aa1ac6a2daf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:13:52.504335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9f982-3b0b-4872-a35f-aa1ac6a2daf5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:13:52.509092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:13:52.510663 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:13:52.510957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:13:52.511293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd admin admin] PATH_INFO: `/v3/projects/bd4276655426428f936a55af730f06d6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:13:52.512467 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd4276655426428f936a55af730f06d6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:13:52.514474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:13:52.646133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd4276655426428f936a55af730f06d6', 'request_id': 'req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:52.707609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd4276655426428f936a55af730f06d6', 'request_id': 'req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:52.713494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd4276655426428f936a55af730f06d6', 'request_id': 'req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:52.724742 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd admin admin] The token cache is being invalidate because project bd4276655426428f936a55af730f06d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:13:52.725024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:52.725644 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:13:52.727245 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1130/2270] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:13:52 2022] DELETE /identity/v3/projects/bd4276655426428f936a55af730f06d6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:14:02.694098 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bf1d0-d1c2-4294-a0f2-422d22328bae service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:02.695563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-135bf1d0-d1c2-4294-a0f2-422d22328bae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:02.706440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bf1d0-d1c2-4294-a0f2-422d22328bae service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:02.754671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca6e7-9248-4ac6-addd-6dad69e03638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:02.755345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca6e7-9248-4ac6-addd-6dad69e03638 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:02.755642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca6e7-9248-4ac6-addd-6dad69e03638 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:02.755922 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca6e7-9248-4ac6-addd-6dad69e03638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:02.757685 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-88dca6e7-9248-4ac6-addd-6dad69e03638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:02.825248 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dca6e7-9248-4ac6-addd-6dad69e03638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:02.826745 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dca6e7-9248-4ac6-addd-6dad69e03638 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:02.838073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1141/2271] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:14:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:14:04.024474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:04.026022 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:04.039073 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee103a-c7d6-4d19-9507-5a9f4ef7fbbd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:04.042916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf06dc-32c5-4510-896d-8985a0f98caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:04.043660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf06dc-32c5-4510-896d-8985a0f98caa service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:04.044013 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf06dc-32c5-4510-896d-8985a0f98caa service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:04.044396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf06dc-32c5-4510-896d-8985a0f98caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:04.046278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5eaf06dc-32c5-4510-896d-8985a0f98caa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:04.062830 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf06dc-32c5-4510-896d-8985a0f98caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:04.064380 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf06dc-32c5-4510-896d-8985a0f98caa service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:04.076561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1131/2272] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:14:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:14:08.709865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca6e7-9248-4ac6-addd-6dad69e03638 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:08.719244 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca6e7-9248-4ac6-addd-6dad69e03638 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:08.723080 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b7bd5-8bea-454f-b1b6-340f3900955a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:08.725005 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b7bd5-8bea-454f-b1b6-340f3900955a service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:08.725287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b7bd5-8bea-454f-b1b6-340f3900955a service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:08.725567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b7bd5-8bea-454f-b1b6-340f3900955a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:08.727588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-833b7bd5-8bea-454f-b1b6-340f3900955a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:08.786522 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b7bd5-8bea-454f-b1b6-340f3900955a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:08.787908 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b7bd5-8bea-454f-b1b6-340f3900955a service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:08.796704 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1142/2273] 10.222.0.24 () {60 vars in 1396 bytes} [Tue May 17 22:14:08 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:14:14.025883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf06dc-32c5-4510-896d-8985a0f98caa service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:14.027500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5eaf06dc-32c5-4510-896d-8985a0f98caa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:14.042138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf06dc-32c5-4510-896d-8985a0f98caa service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:14.048888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c751d4-48bf-4602-9879-d3e9e250ee20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:14.049761 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c751d4-48bf-4602-9879-d3e9e250ee20 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:14.050056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c751d4-48bf-4602-9879-d3e9e250ee20 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:14.050338 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c751d4-48bf-4602-9879-d3e9e250ee20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:14.052826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-75c751d4-48bf-4602-9879-d3e9e250ee20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:14.112235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c751d4-48bf-4602-9879-d3e9e250ee20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:14.114470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c751d4-48bf-4602-9879-d3e9e250ee20 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:14.123838 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1132/2274] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:14:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:14:15.729716 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac01f8-2f20-428b-a062-bdbbef6b0309 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:15.730290 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac01f8-2f20-428b-a062-bdbbef6b0309 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:15.730290 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac01f8-2f20-428b-a062-bdbbef6b0309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:15.747763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d0ac01f8-2f20-428b-a062-bdbbef6b0309 None None] MFA Rules not processed for user `532092f483874f05bc119211b9624492`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:14:15.748950 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d0ac01f8-2f20-428b-a062-bdbbef6b0309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:15.756226 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1143/2275] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:14:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:14:16.109747 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c751d4-48bf-4602-9879-d3e9e250ee20 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:16.119702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c751d4-48bf-4602-9879-d3e9e250ee20 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:16.123330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852d3f9-115a-4405-9630-29b681783434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:16.123963 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852d3f9-115a-4405-9630-29b681783434 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:16.124245 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852d3f9-115a-4405-9630-29b681783434 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:16.124517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852d3f9-115a-4405-9630-29b681783434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:16.126324 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0852d3f9-115a-4405-9630-29b681783434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:16.136458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852d3f9-115a-4405-9630-29b681783434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:16.137875 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852d3f9-115a-4405-9630-29b681783434 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:16.146377 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1133/2276] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:14:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:14:16.644327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac01f8-2f20-428b-a062-bdbbef6b0309 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:16.646896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d0ac01f8-2f20-428b-a062-bdbbef6b0309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:16.747922 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac01f8-2f20-428b-a062-bdbbef6b0309 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:16.757917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6642fd-29e3-46e8-bdcf-4ffeb654f648 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cbd89f9b7a24b6cb993ca86e964c54d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:16.758686 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6642fd-29e3-46e8-bdcf-4ffeb654f648 service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:16.759086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6642fd-29e3-46e8-bdcf-4ffeb654f648 service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:16.759515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6642fd-29e3-46e8-bdcf-4ffeb654f648 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:16.761716 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8e6642fd-29e3-46e8-bdcf-4ffeb654f648 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:16.776874 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6642fd-29e3-46e8-bdcf-4ffeb654f648 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:16.778848 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6642fd-29e3-46e8-bdcf-4ffeb654f648 service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:16.791989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1144/2277] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:14:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:14:17.745979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909af5-0408-4484-9ceb-6349e7893b6c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:17.746520 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909af5-0408-4484-9ceb-6349e7893b6c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:17.746520 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909af5-0408-4484-9ceb-6349e7893b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:17.764857 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-df909af5-0408-4484-9ceb-6349e7893b6c None None] MFA Rules not processed for user `626cf3ce22fd4d019022b52e21916a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:14:17.766828 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-df909af5-0408-4484-9ceb-6349e7893b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:17.774287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1134/2278] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:14:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:14:20.010042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6642fd-29e3-46e8-bdcf-4ffeb654f648 service placement] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:20.019544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6642fd-29e3-46e8-bdcf-4ffeb654f648 service placement] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:20.024044 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ead15-9e1d-4c83-818f-26eccd06f9af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:20.024682 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ead15-9e1d-4c83-818f-26eccd06f9af service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:20.025157 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ead15-9e1d-4c83-818f-26eccd06f9af service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:20.025596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ead15-9e1d-4c83-818f-26eccd06f9af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:20.027577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8f9ead15-9e1d-4c83-818f-26eccd06f9af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:20.037788 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ead15-9e1d-4c83-818f-26eccd06f9af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:20.039268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ead15-9e1d-4c83-818f-26eccd06f9af service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:20.047356 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1145/2279] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:14:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:14:21.387357 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df909af5-0408-4484-9ceb-6349e7893b6c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:21.388815 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-df909af5-0408-4484-9ceb-6349e7893b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:21.459161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df909af5-0408-4484-9ceb-6349e7893b6c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:21.464315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51f49c-4441-475d-bfd1-56ae78e95ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:21.465246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51f49c-4441-475d-bfd1-56ae78e95ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:21.465519 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51f49c-4441-475d-bfd1-56ae78e95ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:21.465797 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51f49c-4441-475d-bfd1-56ae78e95ce9 admin admin] PATH_INFO: `/v3/users/98f1a5f6023e47c8b84edab34b308094` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:21.467249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51f49c-4441-475d-bfd1-56ae78e95ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f1a5f6023e47c8b84edab34b308094)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:21.469192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51f49c-4441-475d-bfd1-56ae78e95ce9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:21.604239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ead15-9e1d-4c83-818f-26eccd06f9af service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:21.606737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8f9ead15-9e1d-4c83-818f-26eccd06f9af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:21.625172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ead15-9e1d-4c83-818f-26eccd06f9af service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:21.633498 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb0745-3759-4970-8475-8ef2c00159d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:21.637659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb0745-3759-4970-8475-8ef2c00159d4 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:21.638127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb0745-3759-4970-8475-8ef2c00159d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:21.638719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb0745-3759-4970-8475-8ef2c00159d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:21.641269 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-19cb0745-3759-4970-8475-8ef2c00159d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:21.654051 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7b51f49c-4441-475d-bfd1-56ae78e95ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f1a5f6023e47c8b84edab34b308094'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:21.658390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb0745-3759-4970-8475-8ef2c00159d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:21.660049 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb0745-3759-4970-8475-8ef2c00159d4 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:21.674504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1146/2280] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:14:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:14:21.694920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7b51f49c-4441-475d-bfd1-56ae78e95ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f1a5f6023e47c8b84edab34b308094'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:21.697106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7b51f49c-4441-475d-bfd1-56ae78e95ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f1a5f6023e47c8b84edab34b308094'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:21.767356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7b51f49c-4441-475d-bfd1-56ae78e95ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f1a5f6023e47c8b84edab34b308094'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:21.768318 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7b51f49c-4441-475d-bfd1-56ae78e95ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f1a5f6023e47c8b84edab34b308094'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:21.786747 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1135/2281] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:14:21 2022] DELETE /identity/v3/users/98f1a5f6023e47c8b84edab34b308094 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:14:22.069086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb0745-3759-4970-8475-8ef2c00159d4 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:22.080652 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb0745-3759-4970-8475-8ef2c00159d4 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:22.159137 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7f3c2-e027-428d-a6fd-dabf1042f822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:22.160053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7f3c2-e027-428d-a6fd-dabf1042f822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:22.161013 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7f3c2-e027-428d-a6fd-dabf1042f822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:22.161302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7f3c2-e027-428d-a6fd-dabf1042f822 admin admin] PATH_INFO: `/v3/projects/93c1c0a74d6a4392947ee727aa1d3da3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:22.162902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7f3c2-e027-428d-a6fd-dabf1042f822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c1c0a74d6a4392947ee727aa1d3da3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:22.166172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7f3c2-e027-428d-a6fd-dabf1042f822 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:22.299128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-83c7f3c2-e027-428d-a6fd-dabf1042f822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c1c0a74d6a4392947ee727aa1d3da3', 'request_id': 'req-83c7f3c2-e027-428d-a6fd-dabf1042f822'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:22.307949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-83c7f3c2-e027-428d-a6fd-dabf1042f822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c1c0a74d6a4392947ee727aa1d3da3', 'request_id': 'req-83c7f3c2-e027-428d-a6fd-dabf1042f822'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:22.315301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-83c7f3c2-e027-428d-a6fd-dabf1042f822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c1c0a74d6a4392947ee727aa1d3da3', 'request_id': 'req-83c7f3c2-e027-428d-a6fd-dabf1042f822'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:22.385787 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-83c7f3c2-e027-428d-a6fd-dabf1042f822 admin admin] The token cache is being invalidate because project 93c1c0a74d6a4392947ee727aa1d3da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:14:22.388195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-83c7f3c2-e027-428d-a6fd-dabf1042f822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:22.388195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-83c7f3c2-e027-428d-a6fd-dabf1042f822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:22.389981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1147/2282] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:14:22 2022] DELETE /identity/v3/projects/93c1c0a74d6a4392947ee727aa1d3da3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:14:22.398117 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a6298-b243-4c9e-b4ef-db6bbc875ffa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:22.398696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a6298-b243-4c9e-b4ef-db6bbc875ffa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:22.398973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a6298-b243-4c9e-b4ef-db6bbc875ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:22.429236 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b17a6298-b243-4c9e-b4ef-db6bbc875ffa None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:14:22.433177 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b17a6298-b243-4c9e-b4ef-db6bbc875ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:22.537020 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1136/2283] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:14:22.547874 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fa26d-4c3a-445c-ac4e-73e83655bbb4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:22.548323 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fa26d-4c3a-445c-ac4e-73e83655bbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:22.548836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fa26d-4c3a-445c-ac4e-73e83655bbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:22.570092 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5d5fa26d-4c3a-445c-ac4e-73e83655bbb4 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:14:22.572440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5d5fa26d-4c3a-445c-ac4e-73e83655bbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:22.583587 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1148/2284] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:14:22.588024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a6298-b243-4c9e-b4ef-db6bbc875ffa None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:22.598405 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a6298-b243-4c9e-b4ef-db6bbc875ffa None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:22.608794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59858f-08bb-47ca-824e-f8207ef15dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:22.609516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59858f-08bb-47ca-824e-f8207ef15dae admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:22.610166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59858f-08bb-47ca-824e-f8207ef15dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:22.610485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59858f-08bb-47ca-824e-f8207ef15dae admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:22.611258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59858f-08bb-47ca-824e-f8207ef15dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:14:22.611545 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59858f-08bb-47ca-824e-f8207ef15dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:22.613161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59858f-08bb-47ca-824e-f8207ef15dae admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:22.632792 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1137/2285] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:14:22.639075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fa26d-4c3a-445c-ac4e-73e83655bbb4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:22.649202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fa26d-4c3a-445c-ac4e-73e83655bbb4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:22.654097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4894e4-4144-4747-83a8-e0acc7fa6d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:22.654827 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4894e4-4144-4747-83a8-e0acc7fa6d7c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:22.655143 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4894e4-4144-4747-83a8-e0acc7fa6d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:22.655440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4894e4-4144-4747-83a8-e0acc7fa6d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:22.656418 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4894e4-4144-4747-83a8-e0acc7fa6d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:22.658341 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4894e4-4144-4747-83a8-e0acc7fa6d7c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:22.734786 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1149/2286] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:14:22 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:14:22.741577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59858f-08bb-47ca-824e-f8207ef15dae admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:22.752092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59858f-08bb-47ca-824e-f8207ef15dae admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:22.818461 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023a2bb-61f7-4b31-9432-ab24c55ddee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:22.819176 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023a2bb-61f7-4b31-9432-ab24c55ddee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:22.819458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023a2bb-61f7-4b31-9432-ab24c55ddee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:22.819733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023a2bb-61f7-4b31-9432-ab24c55ddee5 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:22.820503 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023a2bb-61f7-4b31-9432-ab24c55ddee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:22.822881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023a2bb-61f7-4b31-9432-ab24c55ddee5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:22.913208 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1138/2287] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:14:22 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:14:22.917346 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4894e4-4144-4747-83a8-e0acc7fa6d7c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:22.928407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4894e4-4144-4747-83a8-e0acc7fa6d7c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:22.933201 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d52345-b729-4bb8-a132-7d357bd9386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:22.933876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d52345-b729-4bb8-a132-7d357bd9386d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:22.934183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d52345-b729-4bb8-a132-7d357bd9386d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:22.934468 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d52345-b729-4bb8-a132-7d357bd9386d admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:22.935458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d52345-b729-4bb8-a132-7d357bd9386d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:22.937349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d52345-b729-4bb8-a132-7d357bd9386d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:22.953837 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1150/2288] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:14:22.955058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023a2bb-61f7-4b31-9432-ab24c55ddee5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:22.967403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023a2bb-61f7-4b31-9432-ab24c55ddee5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:22.980241 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f704249-0358-4bdd-87e5-809423af6fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:22.981161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f704249-0358-4bdd-87e5-809423af6fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:22.981697 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f704249-0358-4bdd-87e5-809423af6fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:22.982121 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f704249-0358-4bdd-87e5-809423af6fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:22.982963 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f704249-0358-4bdd-87e5-809423af6fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:22.984841 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f704249-0358-4bdd-87e5-809423af6fc0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:22.997224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1139/2289] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:14:23.001796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d52345-b729-4bb8-a132-7d357bd9386d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:23.012889 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d52345-b729-4bb8-a132-7d357bd9386d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:23.021789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b0dd0-33d8-4315-85f3-b71ffc8a15f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:23.022914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b0dd0-33d8-4315-85f3-b71ffc8a15f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:23.024145 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b0dd0-33d8-4315-85f3-b71ffc8a15f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:23.024555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b0dd0-33d8-4315-85f3-b71ffc8a15f7 admin admin] PATH_INFO: `/v3/projects/74eb5524f74d434b87ff129f9997176b/users/692710d8062c42b5a7fabf677bce0598/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:23.046547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b0dd0-33d8-4315-85f3-b71ffc8a15f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74eb5524f74d434b87ff129f9997176b, user_id=692710d8062c42b5a7fabf677bce0598, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:23.049332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b0dd0-33d8-4315-85f3-b71ffc8a15f7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:23.142363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1151/2290] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:14:23 2022] PUT /identity/v3/projects/74eb5524f74d434b87ff129f9997176b/users/692710d8062c42b5a7fabf677bce0598/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:14:23.150074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa6304-6137-4ee4-b8a2-8bc9d43e7ab4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:23.150364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa6304-6137-4ee4-b8a2-8bc9d43e7ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:23.150654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa6304-6137-4ee4-b8a2-8bc9d43e7ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:23.170816 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-deaa6304-6137-4ee4-b8a2-8bc9d43e7ab4 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:14:23.172059 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-deaa6304-6137-4ee4-b8a2-8bc9d43e7ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:23.268811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1140/2291] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:14:23.279259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b0dd0-33d8-4315-85f3-b71ffc8a15f7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:23.281314 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c91b0dd0-33d8-4315-85f3-b71ffc8a15f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:23.357232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b0dd0-33d8-4315-85f3-b71ffc8a15f7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:23.361194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecefed0-fc11-4871-865e-3d21cf4fbcb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:23.361849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecefed0-fc11-4871-865e-3d21cf4fbcb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:23.362134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecefed0-fc11-4871-865e-3d21cf4fbcb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:23.362413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecefed0-fc11-4871-865e-3d21cf4fbcb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:23.372979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecefed0-fc11-4871-865e-3d21cf4fbcb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:23.374451 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecefed0-fc11-4871-865e-3d21cf4fbcb0 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:23.385849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1152/2292] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:14:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:14:24.904898 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa6304-6137-4ee4-b8a2-8bc9d43e7ab4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:24.906732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-deaa6304-6137-4ee4-b8a2-8bc9d43e7ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:24.973105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa6304-6137-4ee4-b8a2-8bc9d43e7ab4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:24.977174 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40d316-2c2c-42a8-9755-005ecf7e9ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:24.977825 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40d316-2c2c-42a8-9755-005ecf7e9ead service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:24.979168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40d316-2c2c-42a8-9755-005ecf7e9ead service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:24.979168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40d316-2c2c-42a8-9755-005ecf7e9ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:24.980457 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1b40d316-2c2c-42a8-9755-005ecf7e9ead service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:25.040354 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40d316-2c2c-42a8-9755-005ecf7e9ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:25.041818 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40d316-2c2c-42a8-9755-005ecf7e9ead service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:25.051169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1141/2293] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:14:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:14:29.139372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c61b4-872e-47ec-be05-4096ce060448 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:29.140719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c61b4-872e-47ec-be05-4096ce060448 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:29.141404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c61b4-872e-47ec-be05-4096ce060448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:29.171892 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7f9c61b4-872e-47ec-be05-4096ce060448 None None] MFA Rules not processed for user `692710d8062c42b5a7fabf677bce0598`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:14:29.173104 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7f9c61b4-872e-47ec-be05-4096ce060448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:29.242137 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1153/2294] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:14:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:14:29.246680 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40d316-2c2c-42a8-9755-005ecf7e9ead service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:29.257233 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40d316-2c2c-42a8-9755-005ecf7e9ead service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:29.261894 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3250e-6128-4c5d-8b9b-9b938bd52124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:29.262547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3250e-6128-4c5d-8b9b-9b938bd52124 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:29.262834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3250e-6128-4c5d-8b9b-9b938bd52124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:29.263140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3250e-6128-4c5d-8b9b-9b938bd52124 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:29.263837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3250e-6128-4c5d-8b9b-9b938bd52124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:29.265729 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3250e-6128-4c5d-8b9b-9b938bd52124 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:29.367069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1142/2295] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:14:29 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:14:29.368283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c61b4-872e-47ec-be05-4096ce060448 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:29.382048 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c61b4-872e-47ec-be05-4096ce060448 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:29.443359 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612a6cd-d415-4e6b-a96c-716a6110dd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:29.444026 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612a6cd-d415-4e6b-a96c-716a6110dd81 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:29.444305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612a6cd-d415-4e6b-a96c-716a6110dd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:29.444585 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612a6cd-d415-4e6b-a96c-716a6110dd81 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:29.445285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612a6cd-d415-4e6b-a96c-716a6110dd81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:29.448607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612a6cd-d415-4e6b-a96c-716a6110dd81 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:29.539448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1154/2296] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:14:29 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:14:29.543697 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3250e-6128-4c5d-8b9b-9b938bd52124 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:29.556141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3250e-6128-4c5d-8b9b-9b938bd52124 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:29.562241 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753d9ef-830e-44c4-9c0a-25af5f88c0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:29.562926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753d9ef-830e-44c4-9c0a-25af5f88c0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:29.563255 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753d9ef-830e-44c4-9c0a-25af5f88c0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:29.563539 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753d9ef-830e-44c4-9c0a-25af5f88c0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:29.564416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753d9ef-830e-44c4-9c0a-25af5f88c0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:29.566348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753d9ef-830e-44c4-9c0a-25af5f88c0ee admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:29.579992 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1143/2297] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:14:29.584255 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612a6cd-d415-4e6b-a96c-716a6110dd81 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:29.598692 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612a6cd-d415-4e6b-a96c-716a6110dd81 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:29.618499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8082f1-2ced-4fad-ada6-3551f7971ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:29.619495 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8082f1-2ced-4fad-ada6-3551f7971ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:29.619776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8082f1-2ced-4fad-ada6-3551f7971ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:29.620049 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8082f1-2ced-4fad-ada6-3551f7971ef7 admin admin] PATH_INFO: `/v3/projects/dbb3be42fef14fc89a6a52794b282b76/users/2625be41eca942dc97521526d77c8631/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:29.650750 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8082f1-2ced-4fad-ada6-3551f7971ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb3be42fef14fc89a6a52794b282b76, user_id=2625be41eca942dc97521526d77c8631, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:29.654286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8082f1-2ced-4fad-ada6-3551f7971ef7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:29.733077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1155/2298] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:14:29 2022] PUT /identity/v3/projects/dbb3be42fef14fc89a6a52794b282b76/users/2625be41eca942dc97521526d77c8631/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:14:29.736997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753d9ef-830e-44c4-9c0a-25af5f88c0ee admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:29.756205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753d9ef-830e-44c4-9c0a-25af5f88c0ee admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:29.825076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcfd7d-d15a-429c-a487-7649124ba85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:29.825988 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcfd7d-d15a-429c-a487-7649124ba85f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:29.826459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcfd7d-d15a-429c-a487-7649124ba85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:29.826883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcfd7d-d15a-429c-a487-7649124ba85f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:29.827946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcfd7d-d15a-429c-a487-7649124ba85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:29.829766 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcfd7d-d15a-429c-a487-7649124ba85f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:29.841105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1144/2299] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:14:29.845342 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8082f1-2ced-4fad-ada6-3551f7971ef7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:29.857524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8082f1-2ced-4fad-ada6-3551f7971ef7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:29.862570 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ef6b2-a402-484b-975c-76da516f301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:29.864274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ef6b2-a402-484b-975c-76da516f301c admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:29.864555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ef6b2-a402-484b-975c-76da516f301c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:29.864826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ef6b2-a402-484b-975c-76da516f301c admin admin] PATH_INFO: `/v3/projects/dbb3be42fef14fc89a6a52794b282b76/users/2625be41eca942dc97521526d77c8631/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:29.866866 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ef6b2-a402-484b-975c-76da516f301c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb3be42fef14fc89a6a52794b282b76, user_id=2625be41eca942dc97521526d77c8631, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:29.869659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ef6b2-a402-484b-975c-76da516f301c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:29.884318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1156/2300] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:14:29 2022] PUT /identity/v3/projects/dbb3be42fef14fc89a6a52794b282b76/users/2625be41eca942dc97521526d77c8631/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:14:37.766762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979e843-b9f0-4422-86f0-a3410360af91 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:37.767250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979e843-b9f0-4422-86f0-a3410360af91 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:37.767334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979e843-b9f0-4422-86f0-a3410360af91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:37.802250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9979e843-b9f0-4422-86f0-a3410360af91 None None] MFA Rules not processed for user `2625be41eca942dc97521526d77c8631`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:14:37.803820 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9979e843-b9f0-4422-86f0-a3410360af91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:37.906658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1145/2301] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:14:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:14:37.914798 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ef6b2-a402-484b-975c-76da516f301c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:37.917553 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b66ef6b2-a402-484b-975c-76da516f301c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:38.044597 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ef6b2-a402-484b-975c-76da516f301c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:38.055925 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f88bcb-630d-4aa8-a9c7-1b60013556a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:38.057652 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88bcb-630d-4aa8-a9c7-1b60013556a1 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:38.058119 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88bcb-630d-4aa8-a9c7-1b60013556a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:38.058554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88bcb-630d-4aa8-a9c7-1b60013556a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:38.137458 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f88bcb-630d-4aa8-a9c7-1b60013556a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:38.140218 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f88bcb-630d-4aa8-a9c7-1b60013556a1 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:38.165716 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1157/2302] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:14:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:14:40.847735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6aba8-d10b-46eb-a333-c0f080d17a4b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:40.848440 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6aba8-d10b-46eb-a333-c0f080d17a4b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:40.848440 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6aba8-d10b-46eb-a333-c0f080d17a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:40.867565 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b4d6aba8-d10b-46eb-a333-c0f080d17a4b None None] MFA Rules not processed for user `692710d8062c42b5a7fabf677bce0598`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:14:40.868780 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b4d6aba8-d10b-46eb-a333-c0f080d17a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:40.877445 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1146/2303] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:14:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:14:42.549153 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f88bcb-630d-4aa8-a9c7-1b60013556a1 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:42.560511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f88bcb-630d-4aa8-a9c7-1b60013556a1 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:42.567055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f5a4d-aa92-4976-90d5-17e64954e534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:42.567865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f5a4d-aa92-4976-90d5-17e64954e534 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:42.568285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f5a4d-aa92-4976-90d5-17e64954e534 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:42.568567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f5a4d-aa92-4976-90d5-17e64954e534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:42.570392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-720f5a4d-aa92-4976-90d5-17e64954e534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:42.658406 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f5a4d-aa92-4976-90d5-17e64954e534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:42.661210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f5a4d-aa92-4976-90d5-17e64954e534 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:42.671214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1158/2304] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:14:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:14:48.089158 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6aba8-d10b-46eb-a333-c0f080d17a4b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:48.090687 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b4d6aba8-d10b-46eb-a333-c0f080d17a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:48.110114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6aba8-d10b-46eb-a333-c0f080d17a4b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:48.117512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4957f15-bc8a-4451-be60-9d58fa2d387a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:48.118382 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4957f15-bc8a-4451-be60-9d58fa2d387a service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:48.118676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4957f15-bc8a-4451-be60-9d58fa2d387a service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:48.118957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4957f15-bc8a-4451-be60-9d58fa2d387a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:48.120826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e4957f15-bc8a-4451-be60-9d58fa2d387a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:48.134068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4957f15-bc8a-4451-be60-9d58fa2d387a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:48.135700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4957f15-bc8a-4451-be60-9d58fa2d387a service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:48.146542 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1147/2305] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:14:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:14:53.103991 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f5a4d-aa92-4976-90d5-17e64954e534 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:53.105498 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-720f5a4d-aa92-4976-90d5-17e64954e534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:53.168350 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f5a4d-aa92-4976-90d5-17e64954e534 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:53.172204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00b5da-fe7d-42c1-ac36-57ca6093a235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:53.172856 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00b5da-fe7d-42c1-ac36-57ca6093a235 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:53.173163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00b5da-fe7d-42c1-ac36-57ca6093a235 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:53.173432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00b5da-fe7d-42c1-ac36-57ca6093a235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:53.175250 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8e00b5da-fe7d-42c1-ac36-57ca6093a235 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:53.237591 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00b5da-fe7d-42c1-ac36-57ca6093a235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:53.239758 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00b5da-fe7d-42c1-ac36-57ca6093a235 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:53.249315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1159/2306] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:14:57.370607 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4957f15-bc8a-4451-be60-9d58fa2d387a service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:57.372182 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e4957f15-bc8a-4451-be60-9d58fa2d387a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:57.390991 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4957f15-bc8a-4451-be60-9d58fa2d387a service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:57.406749 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4a4ea-be92-47b6-8aa1-d9e770e25840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:57.406749 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4a4ea-be92-47b6-8aa1-d9e770e25840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:57.406749 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4a4ea-be92-47b6-8aa1-d9e770e25840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:57.406749 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4a4ea-be92-47b6-8aa1-d9e770e25840 admin admin] PATH_INFO: `/v3/users/8cc69cd4250c436e8b893887604b2273` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:57.407254 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4a4ea-be92-47b6-8aa1-d9e770e25840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc69cd4250c436e8b893887604b2273)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:57.407254 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4a4ea-be92-47b6-8aa1-d9e770e25840 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:57.591269 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-93b4a4ea-be92-47b6-8aa1-d9e770e25840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc69cd4250c436e8b893887604b2273'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:57.603371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-93b4a4ea-be92-47b6-8aa1-d9e770e25840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc69cd4250c436e8b893887604b2273'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:57.604076 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-93b4a4ea-be92-47b6-8aa1-d9e770e25840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc69cd4250c436e8b893887604b2273'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:57.680162 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-93b4a4ea-be92-47b6-8aa1-d9e770e25840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc69cd4250c436e8b893887604b2273'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:57.680701 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-93b4a4ea-be92-47b6-8aa1-d9e770e25840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc69cd4250c436e8b893887604b2273'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:57.693686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1148/2307] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:14:57 2022] DELETE /identity/v3/users/8cc69cd4250c436e8b893887604b2273 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:14:57.925978 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00b5da-fe7d-42c1-ac36-57ca6093a235 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:57.936168 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00b5da-fe7d-42c1-ac36-57ca6093a235 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:57.993454 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48ac48-42a7-46ed-9dcf-98b3b6e40a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:57.994334 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48ac48-42a7-46ed-9dcf-98b3b6e40a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:57.994609 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48ac48-42a7-46ed-9dcf-98b3b6e40a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:57.994883 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48ac48-42a7-46ed-9dcf-98b3b6e40a48 admin admin] PATH_INFO: `/v3/projects/7a0d6701b5d5441eb7eaf815d273d4d9` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:57.996074 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48ac48-42a7-46ed-9dcf-98b3b6e40a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0d6701b5d5441eb7eaf815d273d4d9)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:57.998059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48ac48-42a7-46ed-9dcf-98b3b6e40a48 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:58.121544 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8a48ac48-42a7-46ed-9dcf-98b3b6e40a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0d6701b5d5441eb7eaf815d273d4d9', 'request_id': 'req-8a48ac48-42a7-46ed-9dcf-98b3b6e40a48'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:58.128603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8a48ac48-42a7-46ed-9dcf-98b3b6e40a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0d6701b5d5441eb7eaf815d273d4d9', 'request_id': 'req-8a48ac48-42a7-46ed-9dcf-98b3b6e40a48'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:58.135619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8a48ac48-42a7-46ed-9dcf-98b3b6e40a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0d6701b5d5441eb7eaf815d273d4d9', 'request_id': 'req-8a48ac48-42a7-46ed-9dcf-98b3b6e40a48'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:58.203174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8a48ac48-42a7-46ed-9dcf-98b3b6e40a48 admin admin] The token cache is being invalidate because project 7a0d6701b5d5441eb7eaf815d273d4d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:14:58.203397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8a48ac48-42a7-46ed-9dcf-98b3b6e40a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:58.203998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8a48ac48-42a7-46ed-9dcf-98b3b6e40a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:14:58.205564 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1160/2308] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:14:57 2022] DELETE /identity/v3/projects/7a0d6701b5d5441eb7eaf815d273d4d9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:14:58.211215 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b271ead-598c-4d53-9ef3-e5251fd65f23 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:58.212520 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b271ead-598c-4d53-9ef3-e5251fd65f23 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:58.212520 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b271ead-598c-4d53-9ef3-e5251fd65f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:58.230191 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6b271ead-598c-4d53-9ef3-e5251fd65f23 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:14:58.231413 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6b271ead-598c-4d53-9ef3-e5251fd65f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:58.291529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1149/2309] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:14:58.299151 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08702116-3994-43b1-a87c-bfea80de41da None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:58.299446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08702116-3994-43b1-a87c-bfea80de41da None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:58.300064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08702116-3994-43b1-a87c-bfea80de41da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:58.318733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-08702116-3994-43b1-a87c-bfea80de41da None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:14:58.319971 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-08702116-3994-43b1-a87c-bfea80de41da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:58.328149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1161/2310] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:14:58.332921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b271ead-598c-4d53-9ef3-e5251fd65f23 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:58.342503 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b271ead-598c-4d53-9ef3-e5251fd65f23 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:58.347020 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b0be9-b2ad-433d-8bd4-4eb5817e615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:58.347740 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b0be9-b2ad-433d-8bd4-4eb5817e615c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:58.348024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b0be9-b2ad-433d-8bd4-4eb5817e615c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:58.348302 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b0be9-b2ad-433d-8bd4-4eb5817e615c admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:58.349046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b0be9-b2ad-433d-8bd4-4eb5817e615c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:14:58.349349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b0be9-b2ad-433d-8bd4-4eb5817e615c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:58.350942 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b0be9-b2ad-433d-8bd4-4eb5817e615c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:58.362997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1150/2311] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:14:58.367474 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08702116-3994-43b1-a87c-bfea80de41da None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:58.376780 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08702116-3994-43b1-a87c-bfea80de41da None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:58.381950 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0376a47-a121-4c5c-9c2c-4cd55c1e8358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:58.382625 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0376a47-a121-4c5c-9c2c-4cd55c1e8358 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:58.382901 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0376a47-a121-4c5c-9c2c-4cd55c1e8358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:58.383201 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0376a47-a121-4c5c-9c2c-4cd55c1e8358 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:58.383892 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0376a47-a121-4c5c-9c2c-4cd55c1e8358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:58.385778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0376a47-a121-4c5c-9c2c-4cd55c1e8358 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:58.491547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1162/2312] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:14:58 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:14:58.495809 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b0be9-b2ad-433d-8bd4-4eb5817e615c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:58.507230 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b0be9-b2ad-433d-8bd4-4eb5817e615c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:58.562785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8fb54-7b43-4a75-961f-ae73b983ae7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:58.563477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8fb54-7b43-4a75-961f-ae73b983ae7d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:58.563759 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8fb54-7b43-4a75-961f-ae73b983ae7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:58.564028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8fb54-7b43-4a75-961f-ae73b983ae7d admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:58.564735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8fb54-7b43-4a75-961f-ae73b983ae7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:58.567644 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8fb54-7b43-4a75-961f-ae73b983ae7d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:58.672363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1151/2313] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:14:58 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:14:58.676868 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0376a47-a121-4c5c-9c2c-4cd55c1e8358 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:58.687387 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0376a47-a121-4c5c-9c2c-4cd55c1e8358 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:58.692782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b74e0-4ba3-46cc-b872-c5b7608e0d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:58.693439 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b74e0-4ba3-46cc-b872-c5b7608e0d3e admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:58.693921 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b74e0-4ba3-46cc-b872-c5b7608e0d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:58.694201 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b74e0-4ba3-46cc-b872-c5b7608e0d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:58.694935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b74e0-4ba3-46cc-b872-c5b7608e0d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:58.696605 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b74e0-4ba3-46cc-b872-c5b7608e0d3e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:58.708045 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1163/2314] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:14:58.711973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8fb54-7b43-4a75-961f-ae73b983ae7d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:58.724948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8fb54-7b43-4a75-961f-ae73b983ae7d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:58.729580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b1f3e-b7f7-4592-8a56-f3e87e269cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:58.730235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b1f3e-b7f7-4592-8a56-f3e87e269cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:58.730514 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b1f3e-b7f7-4592-8a56-f3e87e269cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:58.730784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b1f3e-b7f7-4592-8a56-f3e87e269cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:58.731552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b1f3e-b7f7-4592-8a56-f3e87e269cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:58.733122 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b1f3e-b7f7-4592-8a56-f3e87e269cdb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:58.744596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1152/2315] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:14:58.748071 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b74e0-4ba3-46cc-b872-c5b7608e0d3e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:58.758845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b74e0-4ba3-46cc-b872-c5b7608e0d3e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:58.763686 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02c81d-f699-4849-be3b-2f3fd6574a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:58.764551 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02c81d-f699-4849-be3b-2f3fd6574a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:58.764832 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02c81d-f699-4849-be3b-2f3fd6574a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:58.765099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02c81d-f699-4849-be3b-2f3fd6574a88 admin admin] PATH_INFO: `/v3/projects/48bbb07a991049e8b97cb3fe77fde855/users/621f5507ab434ad7a42231600fe80e18/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:58.779528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02c81d-f699-4849-be3b-2f3fd6574a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48bbb07a991049e8b97cb3fe77fde855, user_id=621f5507ab434ad7a42231600fe80e18, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:58.782173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02c81d-f699-4849-be3b-2f3fd6574a88 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:58.852067 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1164/2316] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:14:58 2022] PUT /identity/v3/projects/48bbb07a991049e8b97cb3fe77fde855/users/621f5507ab434ad7a42231600fe80e18/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:14:58.862153 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e84718-2749-4c4a-9901-4f6f129d8a7d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:58.862432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e84718-2749-4c4a-9901-4f6f129d8a7d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:58.862832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e84718-2749-4c4a-9901-4f6f129d8a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:58.891732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-66e84718-2749-4c4a-9901-4f6f129d8a7d None None] MFA Rules not processed for user `621f5507ab434ad7a42231600fe80e18`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:14:58.892962 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-66e84718-2749-4c4a-9901-4f6f129d8a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:58.906009 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02c81d-f699-4849-be3b-2f3fd6574a88 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:58.907725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6f02c81d-f699-4849-be3b-2f3fd6574a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:58.959313 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1153/2317] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:14:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:14:58.964390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e84718-2749-4c4a-9901-4f6f129d8a7d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:58.965965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02c81d-f699-4849-be3b-2f3fd6574a88 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:58.969669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a847-8e9f-4ac4-8f1f-f0e2cc5cc55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:58.970318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a847-8e9f-4ac4-8f1f-f0e2cc5cc55e service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:58.970602 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a847-8e9f-4ac4-8f1f-f0e2cc5cc55e service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:58.970919 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a847-8e9f-4ac4-8f1f-f0e2cc5cc55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:58.973247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9f37a847-8e9f-4ac4-8f1f-f0e2cc5cc55e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:58.984118 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37a847-8e9f-4ac4-8f1f-f0e2cc5cc55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:58.985558 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37a847-8e9f-4ac4-8f1f-f0e2cc5cc55e service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:58.994476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1165/2318] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:14:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:14:59.029607 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e84718-2749-4c4a-9901-4f6f129d8a7d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:59.034709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e2f07-6366-49a0-8815-f25a298af3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:59.035971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e2f07-6366-49a0-8815-f25a298af3de admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:59.036254 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e2f07-6366-49a0-8815-f25a298af3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:59.036562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e2f07-6366-49a0-8815-f25a298af3de admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:59.037261 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e2f07-6366-49a0-8815-f25a298af3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:59.039168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e2f07-6366-49a0-8815-f25a298af3de admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:59.137087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1154/2319] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:14:58 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:14:59.141100 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a847-8e9f-4ac4-8f1f-f0e2cc5cc55e service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:59.152313 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a847-8e9f-4ac4-8f1f-f0e2cc5cc55e service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:59.214010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be05ae8-57a7-4d17-91db-73c0a6f3c612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:59.214922 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be05ae8-57a7-4d17-91db-73c0a6f3c612 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:59.215312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be05ae8-57a7-4d17-91db-73c0a6f3c612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:59.215658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be05ae8-57a7-4d17-91db-73c0a6f3c612 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:59.216445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be05ae8-57a7-4d17-91db-73c0a6f3c612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:59.218747 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be05ae8-57a7-4d17-91db-73c0a6f3c612 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:59.293837 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1166/2320] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:14:59 2022] POST /identity/v3/users => generated 297 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:14:59.295592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e2f07-6366-49a0-8815-f25a298af3de admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:59.306155 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e2f07-6366-49a0-8815-f25a298af3de admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:59.311009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eb6b5-0b89-4e8d-adf2-a2d4be5b0449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:59.311968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb6b5-0b89-4e8d-adf2-a2d4be5b0449 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:59.312249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb6b5-0b89-4e8d-adf2-a2d4be5b0449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:59.312522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb6b5-0b89-4e8d-adf2-a2d4be5b0449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:59.313254 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11eb6b5-0b89-4e8d-adf2-a2d4be5b0449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:59.314846 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11eb6b5-0b89-4e8d-adf2-a2d4be5b0449 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:59.329932 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1155/2321] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:14:59.334820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be05ae8-57a7-4d17-91db-73c0a6f3c612 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:59.344015 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be05ae8-57a7-4d17-91db-73c0a6f3c612 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:59.350773 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e9914-4978-414a-9c79-2a3168e677c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:59.351700 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e9914-4978-414a-9c79-2a3168e677c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:59.351981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e9914-4978-414a-9c79-2a3168e677c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:59.352254 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e9914-4978-414a-9c79-2a3168e677c2 admin admin] PATH_INFO: `/v3/projects/db6248efaa2c40b89213be9fc6ba38cf/users/3416920b013541e2ac61b46fc2880161/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:59.369053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e9914-4978-414a-9c79-2a3168e677c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6248efaa2c40b89213be9fc6ba38cf, user_id=3416920b013541e2ac61b46fc2880161, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:59.371754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e9914-4978-414a-9c79-2a3168e677c2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:59.475180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1167/2322] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:14:59 2022] PUT /identity/v3/projects/db6248efaa2c40b89213be9fc6ba38cf/users/3416920b013541e2ac61b46fc2880161/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:14:59.479092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eb6b5-0b89-4e8d-adf2-a2d4be5b0449 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:59.490331 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eb6b5-0b89-4e8d-adf2-a2d4be5b0449 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:59.558194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a7dd5-2a8c-4c8e-b3f7-503ff6409f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:59.560057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a7dd5-2a8c-4c8e-b3f7-503ff6409f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:59.560603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a7dd5-2a8c-4c8e-b3f7-503ff6409f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:59.560880 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a7dd5-2a8c-4c8e-b3f7-503ff6409f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:59.564451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a7dd5-2a8c-4c8e-b3f7-503ff6409f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:59.564451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a7dd5-2a8c-4c8e-b3f7-503ff6409f68 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:59.575466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1156/2323] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:14:59.579287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e9914-4978-414a-9c79-2a3168e677c2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:59.590562 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e9914-4978-414a-9c79-2a3168e677c2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:59.595144 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f1f8d-09e7-4d5d-82bc-73352572a128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:59.596019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f1f8d-09e7-4d5d-82bc-73352572a128 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:59.596742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f1f8d-09e7-4d5d-82bc-73352572a128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:59.596742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f1f8d-09e7-4d5d-82bc-73352572a128 admin admin] PATH_INFO: `/v3/projects/db6248efaa2c40b89213be9fc6ba38cf/users/3416920b013541e2ac61b46fc2880161/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:59.599235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f1f8d-09e7-4d5d-82bc-73352572a128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6248efaa2c40b89213be9fc6ba38cf, user_id=3416920b013541e2ac61b46fc2880161, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:59.601858 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f1f8d-09e7-4d5d-82bc-73352572a128 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:59.612554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1168/2324] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:14:59 2022] PUT /identity/v3/projects/db6248efaa2c40b89213be9fc6ba38cf/users/3416920b013541e2ac61b46fc2880161/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:14:59.624770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999beb7-36fa-42d9-ab01-4d98a8f2cf79 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:59.625187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999beb7-36fa-42d9-ab01-4d98a8f2cf79 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:59.625468 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999beb7-36fa-42d9-ab01-4d98a8f2cf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:59.653187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5999beb7-36fa-42d9-ab01-4d98a8f2cf79 None None] MFA Rules not processed for user `3416920b013541e2ac61b46fc2880161`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:14:59.654000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5999beb7-36fa-42d9-ab01-4d98a8f2cf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:59.729375 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1157/2325] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:14:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:14:59.741792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f1f8d-09e7-4d5d-82bc-73352572a128 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:14:59.743563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-313f1f8d-09e7-4d5d-82bc-73352572a128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:14:59.805494 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f1f8d-09e7-4d5d-82bc-73352572a128 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:14:59.814876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6d80e-2de2-43cc-8d10-48f343b4e6c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:14:59.814876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6d80e-2de2-43cc-8d10-48f343b4e6c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:14:59.814876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6d80e-2de2-43cc-8d10-48f343b4e6c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:14:59.814876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6d80e-2de2-43cc-8d10-48f343b4e6c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:14:59.835591 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6d80e-2de2-43cc-8d10-48f343b4e6c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:14:59.837151 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6d80e-2de2-43cc-8d10-48f343b4e6c6 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:14:59.850809 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1169/2326] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:14:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:15:00.114170 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999beb7-36fa-42d9-ab01-4d98a8f2cf79 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:00.124072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999beb7-36fa-42d9-ab01-4d98a8f2cf79 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:00.127516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987663-103f-46ef-a344-77d2d6073287 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:00.132814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987663-103f-46ef-a344-77d2d6073287 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:00.132814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987663-103f-46ef-a344-77d2d6073287 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:00.132814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987663-103f-46ef-a344-77d2d6073287 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:00.189448 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4987663-103f-46ef-a344-77d2d6073287 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:00.190879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4987663-103f-46ef-a344-77d2d6073287 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:00.200175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1158/2327] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:15:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:15:02.844497 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb0298-1e84-4bca-a556-caa1571df9b8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:02.845347 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb0298-1e84-4bca-a556-caa1571df9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:02.845626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb0298-1e84-4bca-a556-caa1571df9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:02.866187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-71eb0298-1e84-4bca-a556-caa1571df9b8 None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:15:02.868352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-71eb0298-1e84-4bca-a556-caa1571df9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:02.926563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1170/2328] 10.222.0.24 () {58 vars in 967 bytes} [Tue May 17 22:15:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:15:03.093615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987663-103f-46ef-a344-77d2d6073287 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:03.095235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f4987663-103f-46ef-a344-77d2d6073287 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:03.166870 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987663-103f-46ef-a344-77d2d6073287 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:03.171948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9bd26-e138-48d5-a6e2-5c67fb88d827 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:03.172598 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9bd26-e138-48d5-a6e2-5c67fb88d827 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:03.172882 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9bd26-e138-48d5-a6e2-5c67fb88d827 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:03.173161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9bd26-e138-48d5-a6e2-5c67fb88d827 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:03.181587 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9bd26-e138-48d5-a6e2-5c67fb88d827 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:03.183203 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9bd26-e138-48d5-a6e2-5c67fb88d827 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:03.192122 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1159/2329] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:15:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 22:15:08.689119 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29861bd6-2b08-409b-9519-12910b4bb2bd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:08.690449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29861bd6-2b08-409b-9519-12910b4bb2bd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:08.691501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29861bd6-2b08-409b-9519-12910b4bb2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:08.721033 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-29861bd6-2b08-409b-9519-12910b4bb2bd None None] MFA Rules not processed for user `4bbb6a0a08464e738ef0d062dfe87182`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:15:08.742804 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-29861bd6-2b08-409b-9519-12910b4bb2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:08.793867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1171/2330] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:15:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:15:13.945576 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9bd26-e138-48d5-a6e2-5c67fb88d827 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:14.026257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9bd26-e138-48d5-a6e2-5c67fb88d827 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:14.031514 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721b88e-4d48-41bc-bd44-3e4fe1320692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:14.032505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721b88e-4d48-41bc-bd44-3e4fe1320692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:14.032792 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721b88e-4d48-41bc-bd44-3e4fe1320692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:14.033066 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721b88e-4d48-41bc-bd44-3e4fe1320692 admin admin] PATH_INFO: `/v3/users/621f5507ab434ad7a42231600fe80e18` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:14.034414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721b88e-4d48-41bc-bd44-3e4fe1320692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=621f5507ab434ad7a42231600fe80e18)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:14.037408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721b88e-4d48-41bc-bd44-3e4fe1320692 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:14.104156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29861bd6-2b08-409b-9519-12910b4bb2bd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:14.106006 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-29861bd6-2b08-409b-9519-12910b4bb2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:14.125428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29861bd6-2b08-409b-9519-12910b4bb2bd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:14.130777 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979461f-d430-4324-bb79-4d7d19b28c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:14.131682 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979461f-d430-4324-bb79-4d7d19b28c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:14.131961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979461f-d430-4324-bb79-4d7d19b28c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:14.132234 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979461f-d430-4324-bb79-4d7d19b28c48 admin admin] PATH_INFO: `/v3/users/b1ef9ab26a7442479ec952d43e392081` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:14.133534 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979461f-d430-4324-bb79-4d7d19b28c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ef9ab26a7442479ec952d43e392081)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:14.135410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979461f-d430-4324-bb79-4d7d19b28c48 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:14.377964 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b721b88e-4d48-41bc-bd44-3e4fe1320692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621f5507ab434ad7a42231600fe80e18'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:14.393129 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b721b88e-4d48-41bc-bd44-3e4fe1320692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621f5507ab434ad7a42231600fe80e18'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:14.394184 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b721b88e-4d48-41bc-bd44-3e4fe1320692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621f5507ab434ad7a42231600fe80e18'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:14.518733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a979461f-d430-4324-bb79-4d7d19b28c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ef9ab26a7442479ec952d43e392081'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:14.532157 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a979461f-d430-4324-bb79-4d7d19b28c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ef9ab26a7442479ec952d43e392081'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:14.537620 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b721b88e-4d48-41bc-bd44-3e4fe1320692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621f5507ab434ad7a42231600fe80e18'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:14.538376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b721b88e-4d48-41bc-bd44-3e4fe1320692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621f5507ab434ad7a42231600fe80e18'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:14.552148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1160/2331] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:15:13 2022] DELETE /identity/v3/users/621f5507ab434ad7a42231600fe80e18 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:15:14.556927 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c6453-cb2a-43f9-8e62-98af401497a2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:14.557223 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c6453-cb2a-43f9-8e62-98af401497a2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:14.557531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c6453-cb2a-43f9-8e62-98af401497a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:14.574834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-222c6453-cb2a-43f9-8e62-98af401497a2 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:15:14.576068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-222c6453-cb2a-43f9-8e62-98af401497a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:14.634454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1161/2332] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:15:14.644164 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c6453-cb2a-43f9-8e62-98af401497a2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:14.645588 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-222c6453-cb2a-43f9-8e62-98af401497a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:14.651447 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a979461f-d430-4324-bb79-4d7d19b28c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ef9ab26a7442479ec952d43e392081'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:14.657338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a979461f-d430-4324-bb79-4d7d19b28c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ef9ab26a7442479ec952d43e392081'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:14.657338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a979461f-d430-4324-bb79-4d7d19b28c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ef9ab26a7442479ec952d43e392081'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:14.666384 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1172/2333] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:15:14 2022] DELETE /identity/v3/users/b1ef9ab26a7442479ec952d43e392081 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:15:14.705671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c6453-cb2a-43f9-8e62-98af401497a2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:14.774159 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a819081-7ddc-4350-ab51-707bdbdbf3ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:14.774903 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a819081-7ddc-4350-ab51-707bdbdbf3ce service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:14.775222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a819081-7ddc-4350-ab51-707bdbdbf3ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:14.775504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a819081-7ddc-4350-ab51-707bdbdbf3ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:14.779004 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9a819081-7ddc-4350-ab51-707bdbdbf3ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:14.850448 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a819081-7ddc-4350-ab51-707bdbdbf3ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:14.852033 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a819081-7ddc-4350-ab51-707bdbdbf3ce service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:14.861881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1162/2334] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:15:15.011003 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979461f-d430-4324-bb79-4d7d19b28c48 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:15.012541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a979461f-d430-4324-bb79-4d7d19b28c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:15.027709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979461f-d430-4324-bb79-4d7d19b28c48 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:15.033451 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:15.035810 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:15.036342 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:15.036853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88 admin admin] PATH_INFO: `/v3/projects/f3b9176d44ed415bacfaf45f3f8472a5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:15.038302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b9176d44ed415bacfaf45f3f8472a5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:15.040957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:15.266661 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b9176d44ed415bacfaf45f3f8472a5', 'request_id': 'req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:15.274448 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b9176d44ed415bacfaf45f3f8472a5', 'request_id': 'req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:15.280753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b9176d44ed415bacfaf45f3f8472a5', 'request_id': 'req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:15.383859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88 admin admin] The token cache is being invalidate because project f3b9176d44ed415bacfaf45f3f8472a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:15:15.384252 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:15.384997 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:15.386713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1173/2335] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:15:15 2022] DELETE /identity/v3/projects/f3b9176d44ed415bacfaf45f3f8472a5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:15:15.390643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a819081-7ddc-4350-ab51-707bdbdbf3ce service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:15.401237 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a819081-7ddc-4350-ab51-707bdbdbf3ce service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:15.458648 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc6c22-88c6-47d5-89fc-686f5e3954bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:15.459496 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc6c22-88c6-47d5-89fc-686f5e3954bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:15.459890 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc6c22-88c6-47d5-89fc-686f5e3954bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:15.460171 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc6c22-88c6-47d5-89fc-686f5e3954bc admin admin] PATH_INFO: `/v3/users/3d2af87387b44de6a8a4ec914c94b5b1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:15.467421 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc6c22-88c6-47d5-89fc-686f5e3954bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d2af87387b44de6a8a4ec914c94b5b1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:15.467421 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc6c22-88c6-47d5-89fc-686f5e3954bc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:15.468792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:15.470298 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:15.484683 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7ed38-2a2c-40f5-b449-d6e015e7ab88 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:15.496424 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51600f-e897-4ef7-bfd1-48255e22bfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:15.497586 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51600f-e897-4ef7-bfd1-48255e22bfd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:15.497863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51600f-e897-4ef7-bfd1-48255e22bfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:15.498780 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51600f-e897-4ef7-bfd1-48255e22bfd2 admin admin] PATH_INFO: `/v3/projects/48bbb07a991049e8b97cb3fe77fde855` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:15.500733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51600f-e897-4ef7-bfd1-48255e22bfd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48bbb07a991049e8b97cb3fe77fde855)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:15.502729 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51600f-e897-4ef7-bfd1-48255e22bfd2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:15.699292 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-acbc6c22-88c6-47d5-89fc-686f5e3954bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d2af87387b44de6a8a4ec914c94b5b1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:15.702184 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3f51600f-e897-4ef7-bfd1-48255e22bfd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48bbb07a991049e8b97cb3fe77fde855', 'request_id': 'req-3f51600f-e897-4ef7-bfd1-48255e22bfd2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:15.710373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3f51600f-e897-4ef7-bfd1-48255e22bfd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48bbb07a991049e8b97cb3fe77fde855', 'request_id': 'req-3f51600f-e897-4ef7-bfd1-48255e22bfd2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:15.716014 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-acbc6c22-88c6-47d5-89fc-686f5e3954bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d2af87387b44de6a8a4ec914c94b5b1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:15.716808 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-acbc6c22-88c6-47d5-89fc-686f5e3954bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d2af87387b44de6a8a4ec914c94b5b1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:15.717637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3f51600f-e897-4ef7-bfd1-48255e22bfd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48bbb07a991049e8b97cb3fe77fde855', 'request_id': 'req-3f51600f-e897-4ef7-bfd1-48255e22bfd2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:15.794985 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-acbc6c22-88c6-47d5-89fc-686f5e3954bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d2af87387b44de6a8a4ec914c94b5b1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:15.795710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-acbc6c22-88c6-47d5-89fc-686f5e3954bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d2af87387b44de6a8a4ec914c94b5b1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:15.810488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1163/2336] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:15:15 2022] DELETE /identity/v3/users/3d2af87387b44de6a8a4ec914c94b5b1 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:15:15.931844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3f51600f-e897-4ef7-bfd1-48255e22bfd2 admin admin] The token cache is being invalidate because project 48bbb07a991049e8b97cb3fe77fde855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:15:15.932128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3f51600f-e897-4ef7-bfd1-48255e22bfd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:15.932740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3f51600f-e897-4ef7-bfd1-48255e22bfd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:15.934388 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1174/2337] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:15:15 2022] DELETE /identity/v3/projects/48bbb07a991049e8b97cb3fe77fde855 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:15:15.942064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc6c22-88c6-47d5-89fc-686f5e3954bc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:15.943917 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-acbc6c22-88c6-47d5-89fc-686f5e3954bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:16.022756 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc6c22-88c6-47d5-89fc-686f5e3954bc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:16.027718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aebe48-dd83-4e2e-bc78-55a6917aebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:16.028596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aebe48-dd83-4e2e-bc78-55a6917aebfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:16.028874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aebe48-dd83-4e2e-bc78-55a6917aebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:16.029147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aebe48-dd83-4e2e-bc78-55a6917aebfa admin admin] PATH_INFO: `/v3/users/3416920b013541e2ac61b46fc2880161` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:16.030403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aebe48-dd83-4e2e-bc78-55a6917aebfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3416920b013541e2ac61b46fc2880161)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:16.032532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aebe48-dd83-4e2e-bc78-55a6917aebfa admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:16.080082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51600f-e897-4ef7-bfd1-48255e22bfd2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:16.081638 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3f51600f-e897-4ef7-bfd1-48255e22bfd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:16.160460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51600f-e897-4ef7-bfd1-48255e22bfd2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:16.165228 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a2917-7fa7-44ab-ad6e-1a5dcf3e2d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:16.166082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2917-7fa7-44ab-ad6e-1a5dcf3e2d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:16.166362 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2917-7fa7-44ab-ad6e-1a5dcf3e2d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:16.166637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a2917-7fa7-44ab-ad6e-1a5dcf3e2d57 admin admin] PATH_INFO: `/v3/projects/0ba2803308604bdcb3bc3f71a44dd87b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:16.167821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a2917-7fa7-44ab-ad6e-1a5dcf3e2d57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba2803308604bdcb3bc3f71a44dd87b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:16.169717 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a2917-7fa7-44ab-ad6e-1a5dcf3e2d57 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:16.322091 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-14aebe48-dd83-4e2e-bc78-55a6917aebfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3416920b013541e2ac61b46fc2880161'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:16.335612 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-14aebe48-dd83-4e2e-bc78-55a6917aebfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3416920b013541e2ac61b46fc2880161'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:16.336339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-14aebe48-dd83-4e2e-bc78-55a6917aebfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3416920b013541e2ac61b46fc2880161'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:16.342040 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-687a2917-7fa7-44ab-ad6e-1a5dcf3e2d57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba2803308604bdcb3bc3f71a44dd87b', 'request_id': 'req-687a2917-7fa7-44ab-ad6e-1a5dcf3e2d57'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:16.348947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-687a2917-7fa7-44ab-ad6e-1a5dcf3e2d57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba2803308604bdcb3bc3f71a44dd87b', 'request_id': 'req-687a2917-7fa7-44ab-ad6e-1a5dcf3e2d57'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:16.354225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-687a2917-7fa7-44ab-ad6e-1a5dcf3e2d57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba2803308604bdcb3bc3f71a44dd87b', 'request_id': 'req-687a2917-7fa7-44ab-ad6e-1a5dcf3e2d57'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:16.416044 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-14aebe48-dd83-4e2e-bc78-55a6917aebfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3416920b013541e2ac61b46fc2880161'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:16.416676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-14aebe48-dd83-4e2e-bc78-55a6917aebfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3416920b013541e2ac61b46fc2880161'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:16.430679 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1164/2338] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:15:15 2022] DELETE /identity/v3/users/3416920b013541e2ac61b46fc2880161 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:15:16.517948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-687a2917-7fa7-44ab-ad6e-1a5dcf3e2d57 admin admin] The token cache is being invalidate because project 0ba2803308604bdcb3bc3f71a44dd87b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:15:16.517948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-687a2917-7fa7-44ab-ad6e-1a5dcf3e2d57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:16.517948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-687a2917-7fa7-44ab-ad6e-1a5dcf3e2d57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:16.517948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1175/2339] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:15:16 2022] DELETE /identity/v3/projects/0ba2803308604bdcb3bc3f71a44dd87b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:15:17.232512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aebe48-dd83-4e2e-bc78-55a6917aebfa admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:17.232512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-14aebe48-dd83-4e2e-bc78-55a6917aebfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:17.291995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aebe48-dd83-4e2e-bc78-55a6917aebfa admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:17.296550 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ed2c3-021f-4e9e-b67f-3de1ef6d8dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:17.297389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ed2c3-021f-4e9e-b67f-3de1ef6d8dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:17.297676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ed2c3-021f-4e9e-b67f-3de1ef6d8dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:17.297953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ed2c3-021f-4e9e-b67f-3de1ef6d8dc0 admin admin] PATH_INFO: `/v3/projects/db6248efaa2c40b89213be9fc6ba38cf` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:17.299147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ed2c3-021f-4e9e-b67f-3de1ef6d8dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db6248efaa2c40b89213be9fc6ba38cf)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:17.301733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ed2c3-021f-4e9e-b67f-3de1ef6d8dc0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:17.440516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fd6ed2c3-021f-4e9e-b67f-3de1ef6d8dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db6248efaa2c40b89213be9fc6ba38cf', 'request_id': 'req-fd6ed2c3-021f-4e9e-b67f-3de1ef6d8dc0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:17.554674 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fd6ed2c3-021f-4e9e-b67f-3de1ef6d8dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db6248efaa2c40b89213be9fc6ba38cf', 'request_id': 'req-fd6ed2c3-021f-4e9e-b67f-3de1ef6d8dc0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:17.560874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fd6ed2c3-021f-4e9e-b67f-3de1ef6d8dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db6248efaa2c40b89213be9fc6ba38cf', 'request_id': 'req-fd6ed2c3-021f-4e9e-b67f-3de1ef6d8dc0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:17.573837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fd6ed2c3-021f-4e9e-b67f-3de1ef6d8dc0 admin admin] The token cache is being invalidate because project db6248efaa2c40b89213be9fc6ba38cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:15:17.574125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fd6ed2c3-021f-4e9e-b67f-3de1ef6d8dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:17.574785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fd6ed2c3-021f-4e9e-b67f-3de1ef6d8dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:17.576398 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1165/2340] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:15:17 2022] DELETE /identity/v3/projects/db6248efaa2c40b89213be9fc6ba38cf => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:15:17.581572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a68414-4858-41d1-8dfb-9b41948ca85a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:17.582101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a68414-4858-41d1-8dfb-9b41948ca85a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:17.582195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a68414-4858-41d1-8dfb-9b41948ca85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:17.602245 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-20a68414-4858-41d1-8dfb-9b41948ca85a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:15:17.603577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-20a68414-4858-41d1-8dfb-9b41948ca85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:17.663037 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1176/2341] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:15:17.671196 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b1611-a6c5-4c3a-8121-50b2b06313ec None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:17.671592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b1611-a6c5-4c3a-8121-50b2b06313ec None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:17.671950 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b1611-a6c5-4c3a-8121-50b2b06313ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:17.691314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-006b1611-a6c5-4c3a-8121-50b2b06313ec None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:15:17.692471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-006b1611-a6c5-4c3a-8121-50b2b06313ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:17.700501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1166/2342] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:15:17.704823 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a68414-4858-41d1-8dfb-9b41948ca85a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:17.714390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a68414-4858-41d1-8dfb-9b41948ca85a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:17.719072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbe858-aed7-4889-9aa4-016a65f38dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:17.719758 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbe858-aed7-4889-9aa4-016a65f38dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:17.720040 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbe858-aed7-4889-9aa4-016a65f38dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:17.720315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbe858-aed7-4889-9aa4-016a65f38dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:17.721044 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbe858-aed7-4889-9aa4-016a65f38dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:15:17.721349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbe858-aed7-4889-9aa4-016a65f38dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:17.723784 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbe858-aed7-4889-9aa4-016a65f38dd0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:17.735407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1177/2343] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:15:17.740206 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b1611-a6c5-4c3a-8121-50b2b06313ec None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:17.749234 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b1611-a6c5-4c3a-8121-50b2b06313ec None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:17.753819 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dffb04-2d17-4021-bc13-b4c9bead7718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:17.754466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dffb04-2d17-4021-bc13-b4c9bead7718 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:17.754747 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dffb04-2d17-4021-bc13-b4c9bead7718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:17.755022 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dffb04-2d17-4021-bc13-b4c9bead7718 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:17.755785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dffb04-2d17-4021-bc13-b4c9bead7718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:17.757791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dffb04-2d17-4021-bc13-b4c9bead7718 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:17.877088 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1167/2344] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:15:17 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:15:17.878842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbe858-aed7-4889-9aa4-016a65f38dd0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:17.889509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbe858-aed7-4889-9aa4-016a65f38dd0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:17.951868 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8c76b-4d79-4a45-9bc8-92e43636a22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:17.952554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8c76b-4d79-4a45-9bc8-92e43636a22d admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:17.952846 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8c76b-4d79-4a45-9bc8-92e43636a22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:17.953121 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8c76b-4d79-4a45-9bc8-92e43636a22d admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:17.953808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8c76b-4d79-4a45-9bc8-92e43636a22d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:17.955797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8c76b-4d79-4a45-9bc8-92e43636a22d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:17.989529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dffb04-2d17-4021-bc13-b4c9bead7718 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:17.991416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-92dffb04-2d17-4021-bc13-b4c9bead7718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:18.068899 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dffb04-2d17-4021-bc13-b4c9bead7718 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:18.074691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70817ab4-e34f-4cbc-bd6e-ab354ef3dff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:18.075407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70817ab4-e34f-4cbc-bd6e-ab354ef3dff2 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:18.075696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70817ab4-e34f-4cbc-bd6e-ab354ef3dff2 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:18.075977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70817ab4-e34f-4cbc-bd6e-ab354ef3dff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:18.078198 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-70817ab4-e34f-4cbc-bd6e-ab354ef3dff2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:18.088033 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1178/2345] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:15:17 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:15:18.089238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8c76b-4d79-4a45-9bc8-92e43636a22d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:18.092981 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70817ab4-e34f-4cbc-bd6e-ab354ef3dff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:18.094584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70817ab4-e34f-4cbc-bd6e-ab354ef3dff2 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:18.099944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8c76b-4d79-4a45-9bc8-92e43636a22d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:18.104801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb211df-4019-4b61-b76f-d76175ddae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:18.105489 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb211df-4019-4b61-b76f-d76175ddae50 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:18.105770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb211df-4019-4b61-b76f-d76175ddae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:18.106107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb211df-4019-4b61-b76f-d76175ddae50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:18.106839 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb211df-4019-4b61-b76f-d76175ddae50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:18.107203 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1168/2346] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:15:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:15:18.118683 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb211df-4019-4b61-b76f-d76175ddae50 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:18.130693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1179/2347] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:15:18.134440 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70817ab4-e34f-4cbc-bd6e-ab354ef3dff2 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:18.146026 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70817ab4-e34f-4cbc-bd6e-ab354ef3dff2 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:18.155899 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c579f-6279-4d32-bdbb-df3d7cc58499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:18.161839 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c579f-6279-4d32-bdbb-df3d7cc58499 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:18.161839 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c579f-6279-4d32-bdbb-df3d7cc58499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:18.161839 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c579f-6279-4d32-bdbb-df3d7cc58499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:18.161839 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c579f-6279-4d32-bdbb-df3d7cc58499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:18.161839 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c579f-6279-4d32-bdbb-df3d7cc58499 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:18.173279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1169/2348] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:15:18.177721 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb211df-4019-4b61-b76f-d76175ddae50 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:18.188062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb211df-4019-4b61-b76f-d76175ddae50 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:18.193336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8875010-a698-495d-9a56-7333259132f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:18.194224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8875010-a698-495d-9a56-7333259132f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:18.194505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8875010-a698-495d-9a56-7333259132f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:18.194781 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8875010-a698-495d-9a56-7333259132f2 admin admin] PATH_INFO: `/v3/projects/8629a21cb4564a84908dc54f1f51d5eb/users/23f2a75b57bf4294bc567d9af1bb4eca/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:18.209588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8875010-a698-495d-9a56-7333259132f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8629a21cb4564a84908dc54f1f51d5eb, user_id=23f2a75b57bf4294bc567d9af1bb4eca, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:18.212342 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8875010-a698-495d-9a56-7333259132f2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:18.377956 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1180/2349] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:15:18 2022] PUT /identity/v3/projects/8629a21cb4564a84908dc54f1f51d5eb/users/23f2a75b57bf4294bc567d9af1bb4eca/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:15:18.389114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379168fb-bd78-477b-be76-1ee99230b61d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:18.389413 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379168fb-bd78-477b-be76-1ee99230b61d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:18.389695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379168fb-bd78-477b-be76-1ee99230b61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:18.418175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-379168fb-bd78-477b-be76-1ee99230b61d None None] MFA Rules not processed for user `23f2a75b57bf4294bc567d9af1bb4eca`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:15:18.419732 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-379168fb-bd78-477b-be76-1ee99230b61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:18.486305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1170/2350] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:15:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:15:18.491303 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8875010-a698-495d-9a56-7333259132f2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:18.555209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8875010-a698-495d-9a56-7333259132f2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:18.560121 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089883a-8b82-4532-88c1-9b37df2ce25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:18.560812 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089883a-8b82-4532-88c1-9b37df2ce25b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:18.561089 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089883a-8b82-4532-88c1-9b37df2ce25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:18.561396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089883a-8b82-4532-88c1-9b37df2ce25b admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:18.562360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089883a-8b82-4532-88c1-9b37df2ce25b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:18.564374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089883a-8b82-4532-88c1-9b37df2ce25b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:18.668669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1181/2351] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:15:18 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:15:18.672720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379168fb-bd78-477b-be76-1ee99230b61d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:18.684555 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379168fb-bd78-477b-be76-1ee99230b61d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:18.739957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9aae4-ec46-432f-b15b-40e6d2caa606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:18.740547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9aae4-ec46-432f-b15b-40e6d2caa606 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:18.740827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9aae4-ec46-432f-b15b-40e6d2caa606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:18.741101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9aae4-ec46-432f-b15b-40e6d2caa606 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:18.741788 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9aae4-ec46-432f-b15b-40e6d2caa606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:18.743706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9aae4-ec46-432f-b15b-40e6d2caa606 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:18.821172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1171/2352] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:15:18 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:15:18.825031 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089883a-8b82-4532-88c1-9b37df2ce25b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:18.836036 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089883a-8b82-4532-88c1-9b37df2ce25b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:18.840610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9f89e-c994-427e-9a0c-3d24f53bd310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:18.841252 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9f89e-c994-427e-9a0c-3d24f53bd310 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:18.841519 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9f89e-c994-427e-9a0c-3d24f53bd310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:18.841794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9f89e-c994-427e-9a0c-3d24f53bd310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:18.842547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9f89e-c994-427e-9a0c-3d24f53bd310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:18.844177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9f89e-c994-427e-9a0c-3d24f53bd310 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:18.855211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1182/2353] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:15:18.859245 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9aae4-ec46-432f-b15b-40e6d2caa606 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:18.869224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9aae4-ec46-432f-b15b-40e6d2caa606 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:18.873976 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d71f84-cb2e-480a-aef2-d346006defd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:18.874833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d71f84-cb2e-480a-aef2-d346006defd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:18.875124 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d71f84-cb2e-480a-aef2-d346006defd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:18.875412 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d71f84-cb2e-480a-aef2-d346006defd9 admin admin] PATH_INFO: `/v3/projects/f0d81e81fbc14e3296dcb5ee3b1b28c2/users/4dd8c27275864a77a38cb37f9817864c/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:18.890480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d71f84-cb2e-480a-aef2-d346006defd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d81e81fbc14e3296dcb5ee3b1b28c2, user_id=4dd8c27275864a77a38cb37f9817864c, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:18.893349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d71f84-cb2e-480a-aef2-d346006defd9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:19.101371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1172/2354] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:15:18 2022] PUT /identity/v3/projects/f0d81e81fbc14e3296dcb5ee3b1b28c2/users/4dd8c27275864a77a38cb37f9817864c/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:15:19.105424 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9f89e-c994-427e-9a0c-3d24f53bd310 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:19.115278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9f89e-c994-427e-9a0c-3d24f53bd310 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:19.170059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9abcd-f3df-4e8e-88f8-b072bbd4bcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:19.170737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9abcd-f3df-4e8e-88f8-b072bbd4bcbf admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:19.171026 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9abcd-f3df-4e8e-88f8-b072bbd4bcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:19.171374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9abcd-f3df-4e8e-88f8-b072bbd4bcbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:19.172290 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9abcd-f3df-4e8e-88f8-b072bbd4bcbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:19.173933 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9abcd-f3df-4e8e-88f8-b072bbd4bcbf admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:19.187003 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1183/2355] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:15:19.188328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d71f84-cb2e-480a-aef2-d346006defd9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:19.201769 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d71f84-cb2e-480a-aef2-d346006defd9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:19.206904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c346be-7d42-4357-bf53-3bc91ce3fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:19.208090 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c346be-7d42-4357-bf53-3bc91ce3fdea admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:19.208375 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c346be-7d42-4357-bf53-3bc91ce3fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:19.208649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c346be-7d42-4357-bf53-3bc91ce3fdea admin admin] PATH_INFO: `/v3/projects/f0d81e81fbc14e3296dcb5ee3b1b28c2/users/4dd8c27275864a77a38cb37f9817864c/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:19.210637 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c346be-7d42-4357-bf53-3bc91ce3fdea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d81e81fbc14e3296dcb5ee3b1b28c2, user_id=4dd8c27275864a77a38cb37f9817864c, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:19.213289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c346be-7d42-4357-bf53-3bc91ce3fdea admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:19.224222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1173/2356] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:15:19 2022] PUT /identity/v3/projects/f0d81e81fbc14e3296dcb5ee3b1b28c2/users/4dd8c27275864a77a38cb37f9817864c/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:15:19.235547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e25339-79ca-4eb9-95a3-0e1741730b31 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:19.235863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e25339-79ca-4eb9-95a3-0e1741730b31 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:19.236140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e25339-79ca-4eb9-95a3-0e1741730b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:19.263073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b2e25339-79ca-4eb9-95a3-0e1741730b31 None None] MFA Rules not processed for user `4dd8c27275864a77a38cb37f9817864c`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:15:19.264315 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b2e25339-79ca-4eb9-95a3-0e1741730b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:19.330342 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1184/2357] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:15:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:15:19.341562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c346be-7d42-4357-bf53-3bc91ce3fdea admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:19.343246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-88c346be-7d42-4357-bf53-3bc91ce3fdea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:19.398380 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c346be-7d42-4357-bf53-3bc91ce3fdea admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:19.401881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8360d52-6f0a-40a6-bd60-1b2d60fb8621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:19.402509 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8360d52-6f0a-40a6-bd60-1b2d60fb8621 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:19.402788 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8360d52-6f0a-40a6-bd60-1b2d60fb8621 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:19.403061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8360d52-6f0a-40a6-bd60-1b2d60fb8621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:19.457639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8360d52-6f0a-40a6-bd60-1b2d60fb8621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:19.459060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8360d52-6f0a-40a6-bd60-1b2d60fb8621 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:19.468231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1174/2358] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:15:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:15:20.997234 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e25339-79ca-4eb9-95a3-0e1741730b31 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:20.999557 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b2e25339-79ca-4eb9-95a3-0e1741730b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:21.057581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e25339-79ca-4eb9-95a3-0e1741730b31 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:21.061172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c09f8-5927-49b0-a19a-8a4323f7ff7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:21.062077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c09f8-5927-49b0-a19a-8a4323f7ff7b service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:21.062372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c09f8-5927-49b0-a19a-8a4323f7ff7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:21.062633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c09f8-5927-49b0-a19a-8a4323f7ff7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:21.064397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8b6c09f8-5927-49b0-a19a-8a4323f7ff7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:21.126167 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c09f8-5927-49b0-a19a-8a4323f7ff7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:21.127637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c09f8-5927-49b0-a19a-8a4323f7ff7b service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:21.139017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1185/2359] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:15:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:15:26.530613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8360d52-6f0a-40a6-bd60-1b2d60fb8621 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:26.532095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f8360d52-6f0a-40a6-bd60-1b2d60fb8621 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:26.543268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8360d52-6f0a-40a6-bd60-1b2d60fb8621 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:26.547036 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe3a2b-cec1-46d2-b46e-26b529241d91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:26.547729 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe3a2b-cec1-46d2-b46e-26b529241d91 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:26.548011 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe3a2b-cec1-46d2-b46e-26b529241d91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:26.548286 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe3a2b-cec1-46d2-b46e-26b529241d91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:26.557912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe3a2b-cec1-46d2-b46e-26b529241d91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:26.559391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe3a2b-cec1-46d2-b46e-26b529241d91 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:26.570210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1175/2360] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:15:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:15:49.217283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d01ccf-e45c-4e4f-915f-126e6add19ff None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:49.217896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d01ccf-e45c-4e4f-915f-126e6add19ff None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:49.217896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d01ccf-e45c-4e4f-915f-126e6add19ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:49.238316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b9d01ccf-e45c-4e4f-915f-126e6add19ff None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:15:49.239609 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b9d01ccf-e45c-4e4f-915f-126e6add19ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:49.301183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1186/2361] 10.222.0.24 () {58 vars in 1009 bytes} [Tue May 17 22:15:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:15:49.316491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe3a2b-cec1-46d2-b46e-26b529241d91 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:49.318115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-aafe3a2b-cec1-46d2-b46e-26b529241d91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:49.389999 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe3a2b-cec1-46d2-b46e-26b529241d91 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:49.395614 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c8c1f-85b7-4bab-b6af-01ab2e40b4ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:49.396257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8c1f-85b7-4bab-b6af-01ab2e40b4ec service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:49.396540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8c1f-85b7-4bab-b6af-01ab2e40b4ec service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:49.396812 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8c1f-85b7-4bab-b6af-01ab2e40b4ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:49.405655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c8c1f-85b7-4bab-b6af-01ab2e40b4ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:49.407325 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c8c1f-85b7-4bab-b6af-01ab2e40b4ec service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:49.416462 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1176/2362] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:15:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 22:15:54.139674 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d01ccf-e45c-4e4f-915f-126e6add19ff None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:54.225742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d01ccf-e45c-4e4f-915f-126e6add19ff None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:54.230302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894f71f-f351-4a30-93b2-ae9357b1b974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:54.231206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894f71f-f351-4a30-93b2-ae9357b1b974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:54.231491 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894f71f-f351-4a30-93b2-ae9357b1b974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:54.231776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894f71f-f351-4a30-93b2-ae9357b1b974 admin admin] PATH_INFO: `/v3/users/23f2a75b57bf4294bc567d9af1bb4eca` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:54.232981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894f71f-f351-4a30-93b2-ae9357b1b974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f2a75b57bf4294bc567d9af1bb4eca)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:54.236456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894f71f-f351-4a30-93b2-ae9357b1b974 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:54.543256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3894f71f-f351-4a30-93b2-ae9357b1b974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f2a75b57bf4294bc567d9af1bb4eca'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:54.559238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3894f71f-f351-4a30-93b2-ae9357b1b974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f2a75b57bf4294bc567d9af1bb4eca'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:54.686334 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3894f71f-f351-4a30-93b2-ae9357b1b974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f2a75b57bf4294bc567d9af1bb4eca'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:54.687289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3894f71f-f351-4a30-93b2-ae9357b1b974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f2a75b57bf4294bc567d9af1bb4eca'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:54.688357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3894f71f-f351-4a30-93b2-ae9357b1b974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f2a75b57bf4294bc567d9af1bb4eca'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:54.710348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1187/2363] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:15:54 2022] DELETE /identity/v3/users/23f2a75b57bf4294bc567d9af1bb4eca => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:15:54.712490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737b7b5-d055-4426-a920-1242586029b3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:54.713356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737b7b5-d055-4426-a920-1242586029b3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:54.713792 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737b7b5-d055-4426-a920-1242586029b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:54.734481 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a737b7b5-d055-4426-a920-1242586029b3 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:15:54.736221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a737b7b5-d055-4426-a920-1242586029b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:54.810214 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1177/2364] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:15:54.822599 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894f71f-f351-4a30-93b2-ae9357b1b974 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:54.824211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3894f71f-f351-4a30-93b2-ae9357b1b974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:54.891698 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894f71f-f351-4a30-93b2-ae9357b1b974 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:54.896685 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be438e-99d8-4467-bbad-36bd8d4c7875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:54.897327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be438e-99d8-4467-bbad-36bd8d4c7875 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:54.897612 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be438e-99d8-4467-bbad-36bd8d4c7875 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:54.897889 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be438e-99d8-4467-bbad-36bd8d4c7875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:54.908510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be438e-99d8-4467-bbad-36bd8d4c7875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:54.911092 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be438e-99d8-4467-bbad-36bd8d4c7875 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:54.922454 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1188/2365] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:15:55.439803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737b7b5-d055-4426-a920-1242586029b3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:55.441891 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a737b7b5-d055-4426-a920-1242586029b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:55.458023 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737b7b5-d055-4426-a920-1242586029b3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:55.463520 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:55.464469 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:55.464682 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:55.464976 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5 admin admin] PATH_INFO: `/v3/projects/8629a21cb4564a84908dc54f1f51d5eb` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:55.466275 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8629a21cb4564a84908dc54f1f51d5eb)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:55.468283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:55.622527 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8629a21cb4564a84908dc54f1f51d5eb', 'request_id': 'req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:56.174866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8629a21cb4564a84908dc54f1f51d5eb', 'request_id': 'req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:56.181166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8629a21cb4564a84908dc54f1f51d5eb', 'request_id': 'req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:56.194665 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5 admin admin] The token cache is being invalidate because project 8629a21cb4564a84908dc54f1f51d5eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:15:56.194954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:56.195642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:56.197563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1178/2366] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:15:55 2022] DELETE /identity/v3/projects/8629a21cb4564a84908dc54f1f51d5eb => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:15:56.201654 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be438e-99d8-4467-bbad-36bd8d4c7875 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:56.212005 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be438e-99d8-4467-bbad-36bd8d4c7875 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:56.271554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551736a4-b210-44cf-ae7c-34120ac3d4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:56.272309 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551736a4-b210-44cf-ae7c-34120ac3d4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:56.272577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551736a4-b210-44cf-ae7c-34120ac3d4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:56.272855 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551736a4-b210-44cf-ae7c-34120ac3d4e7 admin admin] PATH_INFO: `/v3/users/4dd8c27275864a77a38cb37f9817864c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:56.274053 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551736a4-b210-44cf-ae7c-34120ac3d4e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd8c27275864a77a38cb37f9817864c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:56.276094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551736a4-b210-44cf-ae7c-34120ac3d4e7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:56.472512 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-551736a4-b210-44cf-ae7c-34120ac3d4e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd8c27275864a77a38cb37f9817864c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:56.489469 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-551736a4-b210-44cf-ae7c-34120ac3d4e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd8c27275864a77a38cb37f9817864c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:56.565821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-551736a4-b210-44cf-ae7c-34120ac3d4e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd8c27275864a77a38cb37f9817864c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:56.567072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-551736a4-b210-44cf-ae7c-34120ac3d4e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd8c27275864a77a38cb37f9817864c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:56.567744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-551736a4-b210-44cf-ae7c-34120ac3d4e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd8c27275864a77a38cb37f9817864c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:56.584797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1189/2367] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:15:56 2022] DELETE /identity/v3/users/4dd8c27275864a77a38cb37f9817864c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:15:57.072812 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:57.074721 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:57.092680 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0542d6-9b9e-472c-a3ce-0f77452c93e5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:57.194054 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214832d2-e929-4317-a42c-d2b97f193668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:57.195667 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214832d2-e929-4317-a42c-d2b97f193668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:57.196066 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214832d2-e929-4317-a42c-d2b97f193668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:57.196446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214832d2-e929-4317-a42c-d2b97f193668 admin admin] PATH_INFO: `/v3/projects/f0d81e81fbc14e3296dcb5ee3b1b28c2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:57.197799 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214832d2-e929-4317-a42c-d2b97f193668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0d81e81fbc14e3296dcb5ee3b1b28c2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:57.199872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214832d2-e929-4317-a42c-d2b97f193668 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:57.323652 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-214832d2-e929-4317-a42c-d2b97f193668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0d81e81fbc14e3296dcb5ee3b1b28c2', 'request_id': 'req-214832d2-e929-4317-a42c-d2b97f193668'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:57.411350 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-214832d2-e929-4317-a42c-d2b97f193668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0d81e81fbc14e3296dcb5ee3b1b28c2', 'request_id': 'req-214832d2-e929-4317-a42c-d2b97f193668'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:57.419513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-214832d2-e929-4317-a42c-d2b97f193668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0d81e81fbc14e3296dcb5ee3b1b28c2', 'request_id': 'req-214832d2-e929-4317-a42c-d2b97f193668'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:57.438513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-214832d2-e929-4317-a42c-d2b97f193668 admin admin] The token cache is being invalidate because project f0d81e81fbc14e3296dcb5ee3b1b28c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:15:57.439861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-214832d2-e929-4317-a42c-d2b97f193668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:57.441026 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-214832d2-e929-4317-a42c-d2b97f193668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:15:57.443135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1179/2368] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:15:57 2022] DELETE /identity/v3/projects/f0d81e81fbc14e3296dcb5ee3b1b28c2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:15:57.447909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c167c-07a4-450e-9eb6-a28eb9fb5ca4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:57.448424 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c167c-07a4-450e-9eb6-a28eb9fb5ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:57.448517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c167c-07a4-450e-9eb6-a28eb9fb5ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:57.497168 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-df9c167c-07a4-450e-9eb6-a28eb9fb5ca4 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:15:57.498751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-df9c167c-07a4-450e-9eb6-a28eb9fb5ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:57.568828 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1190/2369] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:15:57.576491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1899bf-19e4-40b5-98eb-de98d66ac0b1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:57.577322 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1899bf-19e4-40b5-98eb-de98d66ac0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:57.577605 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1899bf-19e4-40b5-98eb-de98d66ac0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:57.598455 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4e1899bf-19e4-40b5-98eb-de98d66ac0b1 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:15:57.599719 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4e1899bf-19e4-40b5-98eb-de98d66ac0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:57.613678 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1180/2370] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:15:57.617987 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c167c-07a4-450e-9eb6-a28eb9fb5ca4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:57.636477 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c167c-07a4-450e-9eb6-a28eb9fb5ca4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:57.644306 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9996b2-b4c2-4425-800e-9bfae76f2ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:57.644306 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9996b2-b4c2-4425-800e-9bfae76f2ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:57.644306 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9996b2-b4c2-4425-800e-9bfae76f2ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:57.644306 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9996b2-b4c2-4425-800e-9bfae76f2ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:57.645496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9996b2-b4c2-4425-800e-9bfae76f2ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:15:57.646040 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9996b2-b4c2-4425-800e-9bfae76f2ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:57.647910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9996b2-b4c2-4425-800e-9bfae76f2ca6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:57.666023 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1191/2371] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:15:57.670918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1899bf-19e4-40b5-98eb-de98d66ac0b1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:57.688311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1899bf-19e4-40b5-98eb-de98d66ac0b1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:57.697985 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bebceb-3e06-4901-aeb0-74bcdf264b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:57.722414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bebceb-3e06-4901-aeb0-74bcdf264b00 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:57.722414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bebceb-3e06-4901-aeb0-74bcdf264b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:57.722414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bebceb-3e06-4901-aeb0-74bcdf264b00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:57.722414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bebceb-3e06-4901-aeb0-74bcdf264b00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:57.722414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bebceb-3e06-4901-aeb0-74bcdf264b00 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:57.875061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1181/2372] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:15:57 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:15:57.880001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9996b2-b4c2-4425-800e-9bfae76f2ca6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:57.890858 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9996b2-b4c2-4425-800e-9bfae76f2ca6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:58.017890 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45e2b7-7bdb-4885-aa37-9fe8601fc70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:58.018873 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45e2b7-7bdb-4885-aa37-9fe8601fc70d admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:58.019305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45e2b7-7bdb-4885-aa37-9fe8601fc70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:58.019659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45e2b7-7bdb-4885-aa37-9fe8601fc70d admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:58.020467 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45e2b7-7bdb-4885-aa37-9fe8601fc70d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:58.022463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45e2b7-7bdb-4885-aa37-9fe8601fc70d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:58.106556 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bebceb-3e06-4901-aeb0-74bcdf264b00 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:58.116494 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1192/2373] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:15:57 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:15:58.119005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bebceb-3e06-4901-aeb0-74bcdf264b00 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:58.124915 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd632417-be1a-4957-a22a-4e549e15c8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:58.126407 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd632417-be1a-4957-a22a-4e549e15c8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:58.126765 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd632417-be1a-4957-a22a-4e549e15c8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:58.127158 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd632417-be1a-4957-a22a-4e549e15c8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:58.128529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd632417-be1a-4957-a22a-4e549e15c8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:58.130971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd632417-be1a-4957-a22a-4e549e15c8e2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:58.153408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1182/2374] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:15:58.157102 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45e2b7-7bdb-4885-aa37-9fe8601fc70d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:58.168993 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45e2b7-7bdb-4885-aa37-9fe8601fc70d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:58.174126 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa41f3-4b08-4248-b5d2-25272989420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:58.175631 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa41f3-4b08-4248-b5d2-25272989420c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:58.176007 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa41f3-4b08-4248-b5d2-25272989420c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:58.176324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa41f3-4b08-4248-b5d2-25272989420c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:58.177128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa41f3-4b08-4248-b5d2-25272989420c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:58.178800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa41f3-4b08-4248-b5d2-25272989420c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:58.195211 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd632417-be1a-4957-a22a-4e549e15c8e2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:58.208378 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1193/2375] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:15:58.212862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd632417-be1a-4957-a22a-4e549e15c8e2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:58.221077 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a95c8-8dc5-428a-8076-ca928eeec26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:58.224305 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a95c8-8dc5-428a-8076-ca928eeec26e admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:58.227649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a95c8-8dc5-428a-8076-ca928eeec26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:58.239699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a95c8-8dc5-428a-8076-ca928eeec26e admin admin] PATH_INFO: `/v3/projects/bf9436dbcb1c4e5d888078a0476a4d35/users/c6e81476c96b4f01a238e6b499416746/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:58.279746 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a95c8-8dc5-428a-8076-ca928eeec26e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9436dbcb1c4e5d888078a0476a4d35, user_id=c6e81476c96b4f01a238e6b499416746, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:58.282712 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a95c8-8dc5-428a-8076-ca928eeec26e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:58.449918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1183/2376] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:15:58 2022] PUT /identity/v3/projects/bf9436dbcb1c4e5d888078a0476a4d35/users/c6e81476c96b4f01a238e6b499416746/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:15:58.462384 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad06e4-d3e7-465b-95b5-f8c7c63a1dab None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:58.462976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad06e4-d3e7-465b-95b5-f8c7c63a1dab None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:58.462976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad06e4-d3e7-465b-95b5-f8c7c63a1dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:58.537733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-fbad06e4-d3e7-465b-95b5-f8c7c63a1dab None None] MFA Rules not processed for user `c6e81476c96b4f01a238e6b499416746`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:15:58.539006 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fbad06e4-d3e7-465b-95b5-f8c7c63a1dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:58.671250 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1194/2377] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:15:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:15:58.673574 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a95c8-8dc5-428a-8076-ca928eeec26e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:58.758142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a95c8-8dc5-428a-8076-ca928eeec26e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:58.771492 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca844e-35cf-4a96-b654-6e69e74cf946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:58.772596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca844e-35cf-4a96-b654-6e69e74cf946 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:58.774050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca844e-35cf-4a96-b654-6e69e74cf946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:58.774565 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca844e-35cf-4a96-b654-6e69e74cf946 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:58.776891 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca844e-35cf-4a96-b654-6e69e74cf946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:58.780498 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca844e-35cf-4a96-b654-6e69e74cf946 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:58.897664 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1184/2378] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:15:58 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:15:58.901494 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad06e4-d3e7-465b-95b5-f8c7c63a1dab None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:58.918285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad06e4-d3e7-465b-95b5-f8c7c63a1dab None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:59.020905 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788dca3-8114-4e00-af5d-ce1a26dbf6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:59.027291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788dca3-8114-4e00-af5d-ce1a26dbf6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:59.027291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788dca3-8114-4e00-af5d-ce1a26dbf6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:59.027291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788dca3-8114-4e00-af5d-ce1a26dbf6f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:59.027603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788dca3-8114-4e00-af5d-ce1a26dbf6f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:59.029412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788dca3-8114-4e00-af5d-ce1a26dbf6f6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:59.150620 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1195/2379] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:15:58 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:15:59.153533 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca844e-35cf-4a96-b654-6e69e74cf946 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:59.166426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca844e-35cf-4a96-b654-6e69e74cf946 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:59.173253 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9e008-77cb-47de-ae40-a94ee5387fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:59.174143 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9e008-77cb-47de-ae40-a94ee5387fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:59.174624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9e008-77cb-47de-ae40-a94ee5387fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:59.175073 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9e008-77cb-47de-ae40-a94ee5387fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:59.176108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9e008-77cb-47de-ae40-a94ee5387fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:59.177986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9e008-77cb-47de-ae40-a94ee5387fe8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:59.196812 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1185/2380] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:15:59.197830 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788dca3-8114-4e00-af5d-ce1a26dbf6f6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:59.222621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788dca3-8114-4e00-af5d-ce1a26dbf6f6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:59.227948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78803b25-0a6e-475a-9940-55d61c9a6f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:59.228566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78803b25-0a6e-475a-9940-55d61c9a6f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:59.228985 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78803b25-0a6e-475a-9940-55d61c9a6f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:59.229377 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78803b25-0a6e-475a-9940-55d61c9a6f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:59.230500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78803b25-0a6e-475a-9940-55d61c9a6f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:59.233468 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78803b25-0a6e-475a-9940-55d61c9a6f57 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:59.254705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1196/2381] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:15:59.258974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9e008-77cb-47de-ae40-a94ee5387fe8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:59.273507 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9e008-77cb-47de-ae40-a94ee5387fe8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:59.281318 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78934db3-134a-48c5-baeb-3e8603382326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:59.282559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78934db3-134a-48c5-baeb-3e8603382326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:59.282910 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78934db3-134a-48c5-baeb-3e8603382326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:59.283444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78934db3-134a-48c5-baeb-3e8603382326 admin admin] PATH_INFO: `/v3/projects/c559de5cc892411eb9d9b9092e172834/users/ed0a0322c3794ef8b232059110e8a94c/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:59.302273 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78934db3-134a-48c5-baeb-3e8603382326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c559de5cc892411eb9d9b9092e172834, user_id=ed0a0322c3794ef8b232059110e8a94c, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:59.304496 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78934db3-134a-48c5-baeb-3e8603382326 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:15:59.398074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1186/2382] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:15:59 2022] PUT /identity/v3/projects/c559de5cc892411eb9d9b9092e172834/users/ed0a0322c3794ef8b232059110e8a94c/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:15:59.403694 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a11ef0-2f46-41e3-84c6-e2caef8711a2 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:59.403992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a11ef0-2f46-41e3-84c6-e2caef8711a2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:59.404278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a11ef0-2f46-41e3-84c6-e2caef8711a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:59.439928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a1a11ef0-2f46-41e3-84c6-e2caef8711a2 None None] MFA Rules not processed for user `ed0a0322c3794ef8b232059110e8a94c`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:15:59.447349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a1a11ef0-2f46-41e3-84c6-e2caef8711a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:15:59.535167 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1197/2383] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:15:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:15:59.538361 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78934db3-134a-48c5-baeb-3e8603382326 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:15:59.702939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78934db3-134a-48c5-baeb-3e8603382326 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:15:59.702939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39e37b-9791-43d5-8dc5-e478364a4dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:15:59.702939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39e37b-9791-43d5-8dc5-e478364a4dec admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:15:59.702939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39e37b-9791-43d5-8dc5-e478364a4dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:15:59.704267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39e37b-9791-43d5-8dc5-e478364a4dec admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:15:59.704267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39e37b-9791-43d5-8dc5-e478364a4dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:15:59.704267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39e37b-9791-43d5-8dc5-e478364a4dec admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:00.012696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1187/2384] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:15:59 2022] POST /identity/v3/projects => generated 379 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:00.017837 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a11ef0-2f46-41e3-84c6-e2caef8711a2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:00.028118 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a11ef0-2f46-41e3-84c6-e2caef8711a2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:00.099830 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e5038-3d77-4512-adf3-c2b6489d951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:00.100533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e5038-3d77-4512-adf3-c2b6489d951c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:00.100814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e5038-3d77-4512-adf3-c2b6489d951c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:00.101090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e5038-3d77-4512-adf3-c2b6489d951c admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:00.101801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e5038-3d77-4512-adf3-c2b6489d951c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:00.104087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e5038-3d77-4512-adf3-c2b6489d951c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:00.244028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1198/2385] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:00 2022] POST /identity/v3/users => generated 296 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:00.248083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39e37b-9791-43d5-8dc5-e478364a4dec admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:00.258902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39e37b-9791-43d5-8dc5-e478364a4dec admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:00.263658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267333f-f4bc-4896-988d-62cc945fd518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:00.264322 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267333f-f4bc-4896-988d-62cc945fd518 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:00.264604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267333f-f4bc-4896-988d-62cc945fd518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:00.275165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267333f-f4bc-4896-988d-62cc945fd518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:00.276090 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267333f-f4bc-4896-988d-62cc945fd518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:00.277719 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267333f-f4bc-4896-988d-62cc945fd518 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:00.296434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1188/2386] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:00.305071 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e5038-3d77-4512-adf3-c2b6489d951c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:00.312366 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e5038-3d77-4512-adf3-c2b6489d951c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:00.317383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a31d4-f3f4-4d9d-9134-c4258c57e86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:00.318268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a31d4-f3f4-4d9d-9134-c4258c57e86c admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:00.319154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a31d4-f3f4-4d9d-9134-c4258c57e86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:00.319154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a31d4-f3f4-4d9d-9134-c4258c57e86c admin admin] PATH_INFO: `/v3/projects/db7b93ccdb7941d9b3370e349efe5c85/users/344de6cadee24da4a0dc71d3f334af0f/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:00.337176 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a31d4-f3f4-4d9d-9134-c4258c57e86c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7b93ccdb7941d9b3370e349efe5c85, user_id=344de6cadee24da4a0dc71d3f334af0f, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:00.341416 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a31d4-f3f4-4d9d-9134-c4258c57e86c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:00.418231 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1199/2387] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:00 2022] PUT /identity/v3/projects/db7b93ccdb7941d9b3370e349efe5c85/users/344de6cadee24da4a0dc71d3f334af0f/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:00.428590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267333f-f4bc-4896-988d-62cc945fd518 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:00.442658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267333f-f4bc-4896-988d-62cc945fd518 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:00.526167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c0f88-f036-473c-9440-7fe5e01163c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:00.528035 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c0f88-f036-473c-9440-7fe5e01163c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:00.528500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c0f88-f036-473c-9440-7fe5e01163c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:00.528937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c0f88-f036-473c-9440-7fe5e01163c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:00.530222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c0f88-f036-473c-9440-7fe5e01163c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:00.532030 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c0f88-f036-473c-9440-7fe5e01163c1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:00.547154 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1189/2388] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:00.553392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a31d4-f3f4-4d9d-9134-c4258c57e86c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:00.564492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a31d4-f3f4-4d9d-9134-c4258c57e86c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:00.580262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db424b-27d1-452d-aaff-fd68e7fa4344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:00.582118 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db424b-27d1-452d-aaff-fd68e7fa4344 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:00.582753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db424b-27d1-452d-aaff-fd68e7fa4344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:00.583251 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db424b-27d1-452d-aaff-fd68e7fa4344 admin admin] PATH_INFO: `/v3/projects/db7b93ccdb7941d9b3370e349efe5c85/users/344de6cadee24da4a0dc71d3f334af0f/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:00.585471 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db424b-27d1-452d-aaff-fd68e7fa4344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7b93ccdb7941d9b3370e349efe5c85, user_id=344de6cadee24da4a0dc71d3f334af0f, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:00.588263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db424b-27d1-452d-aaff-fd68e7fa4344 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:00.604805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1200/2389] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:00 2022] PUT /identity/v3/projects/db7b93ccdb7941d9b3370e349efe5c85/users/344de6cadee24da4a0dc71d3f334af0f/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:00.618381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6faa5-bb6d-4acc-b0b0-f677a05a9779 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:00.618952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6faa5-bb6d-4acc-b0b0-f677a05a9779 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:00.619421 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6faa5-bb6d-4acc-b0b0-f677a05a9779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:00.653996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-64e6faa5-bb6d-4acc-b0b0-f677a05a9779 None None] MFA Rules not processed for user `344de6cadee24da4a0dc71d3f334af0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:00.656777 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-64e6faa5-bb6d-4acc-b0b0-f677a05a9779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:00.763678 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1190/2390] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:00.766816 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db424b-27d1-452d-aaff-fd68e7fa4344 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:00.771204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-37db424b-27d1-452d-aaff-fd68e7fa4344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:00.859519 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db424b-27d1-452d-aaff-fd68e7fa4344 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:00.868214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7e68c-5218-454b-93d5-37c2f06fa9bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:00.872194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7e68c-5218-454b-93d5-37c2f06fa9bf service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:00.872194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7e68c-5218-454b-93d5-37c2f06fa9bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:00.872194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7e68c-5218-454b-93d5-37c2f06fa9bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:00.881108 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7e68c-5218-454b-93d5-37c2f06fa9bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:00.882565 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7e68c-5218-454b-93d5-37c2f06fa9bf service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:00.893778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1201/2391] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:01.033064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6faa5-bb6d-4acc-b0b0-f677a05a9779 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:01.035299 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-64e6faa5-bb6d-4acc-b0b0-f677a05a9779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:01.051270 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6faa5-bb6d-4acc-b0b0-f677a05a9779 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:01.055240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b65089-02fb-4e4a-917e-f6efca03c5ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:01.055884 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b65089-02fb-4e4a-917e-f6efca03c5ae service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:01.056164 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b65089-02fb-4e4a-917e-f6efca03c5ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:01.056438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b65089-02fb-4e4a-917e-f6efca03c5ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:01.115210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b65089-02fb-4e4a-917e-f6efca03c5ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:01.116931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b65089-02fb-4e4a-917e-f6efca03c5ae service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:01.125791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1191/2392] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:05.046899 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7e68c-5218-454b-93d5-37c2f06fa9bf service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:05.048354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-00d7e68c-5218-454b-93d5-37c2f06fa9bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:05.107434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7e68c-5218-454b-93d5-37c2f06fa9bf service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:05.111128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398704b-92f0-4845-ad6f-fa2b02d8f5c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:05.111954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398704b-92f0-4845-ad6f-fa2b02d8f5c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:05.112784 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398704b-92f0-4845-ad6f-fa2b02d8f5c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:05.113040 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398704b-92f0-4845-ad6f-fa2b02d8f5c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:05.114793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a398704b-92f0-4845-ad6f-fa2b02d8f5c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:05.178553 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398704b-92f0-4845-ad6f-fa2b02d8f5c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:05.180061 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398704b-92f0-4845-ad6f-fa2b02d8f5c0 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:05.190161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1202/2393] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:05.554186 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b65089-02fb-4e4a-917e-f6efca03c5ae service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:05.565924 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b65089-02fb-4e4a-917e-f6efca03c5ae service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:05.570755 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d0c93-dc4c-4c78-9b95-055f6c0276ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:05.571686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d0c93-dc4c-4c78-9b95-055f6c0276ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:05.571974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d0c93-dc4c-4c78-9b95-055f6c0276ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:05.572250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d0c93-dc4c-4c78-9b95-055f6c0276ff admin admin] PATH_INFO: `/v3/users/c6e81476c96b4f01a238e6b499416746` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:05.573509 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d0c93-dc4c-4c78-9b95-055f6c0276ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e81476c96b4f01a238e6b499416746)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:05.575521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d0c93-dc4c-4c78-9b95-055f6c0276ff admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:05.768183 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d6d0c93-dc4c-4c78-9b95-055f6c0276ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e81476c96b4f01a238e6b499416746'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:05.779646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d6d0c93-dc4c-4c78-9b95-055f6c0276ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e81476c96b4f01a238e6b499416746'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:05.780391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d6d0c93-dc4c-4c78-9b95-055f6c0276ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e81476c96b4f01a238e6b499416746'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:05.873316 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d6d0c93-dc4c-4c78-9b95-055f6c0276ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e81476c96b4f01a238e6b499416746'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:05.873941 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d6d0c93-dc4c-4c78-9b95-055f6c0276ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e81476c96b4f01a238e6b499416746'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:05.887810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1192/2394] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:05 2022] DELETE /identity/v3/users/c6e81476c96b4f01a238e6b499416746 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:05.892651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7510773-50f4-42f3-bedb-d95eba91b858 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:05.895093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7510773-50f4-42f3-bedb-d95eba91b858 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:05.905972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7510773-50f4-42f3-bedb-d95eba91b858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:05.918492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e7510773-50f4-42f3-bedb-d95eba91b858 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:05.920166 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e7510773-50f4-42f3-bedb-d95eba91b858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:05.994810 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1203/2395] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:06.005500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d0c93-dc4c-4c78-9b95-055f6c0276ff admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:06.007173 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1d6d0c93-dc4c-4c78-9b95-055f6c0276ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:06.074011 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d0c93-dc4c-4c78-9b95-055f6c0276ff admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:06.077997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4122ef-b271-4c1b-a666-aa387ee1d271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:06.078650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4122ef-b271-4c1b-a666-aa387ee1d271 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:06.078938 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4122ef-b271-4c1b-a666-aa387ee1d271 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:06.079250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4122ef-b271-4c1b-a666-aa387ee1d271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:06.088957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4122ef-b271-4c1b-a666-aa387ee1d271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:06.091178 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4122ef-b271-4c1b-a666-aa387ee1d271 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:06.102034 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1193/2396] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:16:06.746889 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7510773-50f4-42f3-bedb-d95eba91b858 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:06.752077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e7510773-50f4-42f3-bedb-d95eba91b858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:06.761993 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7510773-50f4-42f3-bedb-d95eba91b858 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:06.766477 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f620d32-2bb0-4c0c-8710-417a241193d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:06.767356 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f620d32-2bb0-4c0c-8710-417a241193d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:06.767633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f620d32-2bb0-4c0c-8710-417a241193d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:06.767925 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f620d32-2bb0-4c0c-8710-417a241193d6 admin admin] PATH_INFO: `/v3/projects/bf9436dbcb1c4e5d888078a0476a4d35` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:06.770228 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f620d32-2bb0-4c0c-8710-417a241193d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf9436dbcb1c4e5d888078a0476a4d35)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:06.772177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f620d32-2bb0-4c0c-8710-417a241193d6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:06.909685 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5f620d32-2bb0-4c0c-8710-417a241193d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf9436dbcb1c4e5d888078a0476a4d35', 'request_id': 'req-5f620d32-2bb0-4c0c-8710-417a241193d6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:06.916282 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5f620d32-2bb0-4c0c-8710-417a241193d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf9436dbcb1c4e5d888078a0476a4d35', 'request_id': 'req-5f620d32-2bb0-4c0c-8710-417a241193d6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:06.928107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5f620d32-2bb0-4c0c-8710-417a241193d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf9436dbcb1c4e5d888078a0476a4d35', 'request_id': 'req-5f620d32-2bb0-4c0c-8710-417a241193d6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:06.994109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5f620d32-2bb0-4c0c-8710-417a241193d6 admin admin] The token cache is being invalidate because project bf9436dbcb1c4e5d888078a0476a4d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:06.994518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5f620d32-2bb0-4c0c-8710-417a241193d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:06.995182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5f620d32-2bb0-4c0c-8710-417a241193d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:06.997026 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1204/2397] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:06 2022] DELETE /identity/v3/projects/bf9436dbcb1c4e5d888078a0476a4d35 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:07.013180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4122ef-b271-4c1b-a666-aa387ee1d271 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:07.013180 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4122ef-b271-4c1b-a666-aa387ee1d271 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:07.089629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7af01-8a52-4c59-8e97-a9b3c30579a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:07.090593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7af01-8a52-4c59-8e97-a9b3c30579a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:07.090953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7af01-8a52-4c59-8e97-a9b3c30579a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:07.091333 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7af01-8a52-4c59-8e97-a9b3c30579a7 admin admin] PATH_INFO: `/v3/users/ed0a0322c3794ef8b232059110e8a94c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:07.092797 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7af01-8a52-4c59-8e97-a9b3c30579a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed0a0322c3794ef8b232059110e8a94c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:07.094902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7af01-8a52-4c59-8e97-a9b3c30579a7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:07.278208 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a2c7af01-8a52-4c59-8e97-a9b3c30579a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed0a0322c3794ef8b232059110e8a94c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:07.291711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a2c7af01-8a52-4c59-8e97-a9b3c30579a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed0a0322c3794ef8b232059110e8a94c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:07.301059 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a2c7af01-8a52-4c59-8e97-a9b3c30579a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed0a0322c3794ef8b232059110e8a94c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:07.381061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a2c7af01-8a52-4c59-8e97-a9b3c30579a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed0a0322c3794ef8b232059110e8a94c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:07.381638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a2c7af01-8a52-4c59-8e97-a9b3c30579a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed0a0322c3794ef8b232059110e8a94c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:07.399470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1194/2398] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:07 2022] DELETE /identity/v3/users/ed0a0322c3794ef8b232059110e8a94c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:08.028224 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f620d32-2bb0-4c0c-8710-417a241193d6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:08.036199 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5f620d32-2bb0-4c0c-8710-417a241193d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:08.064361 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f620d32-2bb0-4c0c-8710-417a241193d6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:08.132611 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8169d1-9bf6-49ff-853d-7c9554358133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:08.137976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8169d1-9bf6-49ff-853d-7c9554358133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:08.137976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8169d1-9bf6-49ff-853d-7c9554358133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:08.137976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8169d1-9bf6-49ff-853d-7c9554358133 admin admin] PATH_INFO: `/v3/projects/c559de5cc892411eb9d9b9092e172834` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:08.137976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8169d1-9bf6-49ff-853d-7c9554358133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c559de5cc892411eb9d9b9092e172834)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:08.137976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8169d1-9bf6-49ff-853d-7c9554358133 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:08.261237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4a8169d1-9bf6-49ff-853d-7c9554358133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c559de5cc892411eb9d9b9092e172834', 'request_id': 'req-4a8169d1-9bf6-49ff-853d-7c9554358133'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:08.267316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4a8169d1-9bf6-49ff-853d-7c9554358133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c559de5cc892411eb9d9b9092e172834', 'request_id': 'req-4a8169d1-9bf6-49ff-853d-7c9554358133'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:08.273420 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4a8169d1-9bf6-49ff-853d-7c9554358133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c559de5cc892411eb9d9b9092e172834', 'request_id': 'req-4a8169d1-9bf6-49ff-853d-7c9554358133'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:08.386136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4a8169d1-9bf6-49ff-853d-7c9554358133 admin admin] The token cache is being invalidate because project c559de5cc892411eb9d9b9092e172834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:08.386631 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4a8169d1-9bf6-49ff-853d-7c9554358133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:08.389051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4a8169d1-9bf6-49ff-853d-7c9554358133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:08.390916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1205/2399] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:08 2022] DELETE /identity/v3/projects/c559de5cc892411eb9d9b9092e172834 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:08.395653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7af01-8a52-4c59-8e97-a9b3c30579a7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:08.397646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a2c7af01-8a52-4c59-8e97-a9b3c30579a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:08.416936 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7af01-8a52-4c59-8e97-a9b3c30579a7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:08.507298 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85f6db-145c-4187-b9c7-127c1699ebc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:08.509302 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85f6db-145c-4187-b9c7-127c1699ebc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:08.509597 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85f6db-145c-4187-b9c7-127c1699ebc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:08.511619 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85f6db-145c-4187-b9c7-127c1699ebc1 admin admin] PATH_INFO: `/v3/users/344de6cadee24da4a0dc71d3f334af0f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:08.511619 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85f6db-145c-4187-b9c7-127c1699ebc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=344de6cadee24da4a0dc71d3f334af0f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:08.513507 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85f6db-145c-4187-b9c7-127c1699ebc1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:08.704039 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5d85f6db-145c-4187-b9c7-127c1699ebc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344de6cadee24da4a0dc71d3f334af0f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:08.731653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5d85f6db-145c-4187-b9c7-127c1699ebc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344de6cadee24da4a0dc71d3f334af0f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:08.732922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5d85f6db-145c-4187-b9c7-127c1699ebc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344de6cadee24da4a0dc71d3f334af0f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:08.828215 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5d85f6db-145c-4187-b9c7-127c1699ebc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344de6cadee24da4a0dc71d3f334af0f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:08.828908 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5d85f6db-145c-4187-b9c7-127c1699ebc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344de6cadee24da4a0dc71d3f334af0f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:08.842510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1195/2400] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:08 2022] DELETE /identity/v3/users/344de6cadee24da4a0dc71d3f334af0f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:09.274566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8169d1-9bf6-49ff-853d-7c9554358133 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:09.276412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4a8169d1-9bf6-49ff-853d-7c9554358133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:09.291501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8169d1-9bf6-49ff-853d-7c9554358133 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:09.358467 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce5374-9a55-4eee-bcb7-645ddd8a9727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:09.359365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5374-9a55-4eee-bcb7-645ddd8a9727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:09.359644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5374-9a55-4eee-bcb7-645ddd8a9727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:09.360482 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5374-9a55-4eee-bcb7-645ddd8a9727 admin admin] PATH_INFO: `/v3/users/626cf3ce22fd4d019022b52e21916a2f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:09.362312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce5374-9a55-4eee-bcb7-645ddd8a9727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=626cf3ce22fd4d019022b52e21916a2f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:09.364885 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce5374-9a55-4eee-bcb7-645ddd8a9727 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:09.434584 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85f6db-145c-4187-b9c7-127c1699ebc1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:09.436746 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5d85f6db-145c-4187-b9c7-127c1699ebc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:09.450724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85f6db-145c-4187-b9c7-127c1699ebc1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:09.455677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc8dea-2f2e-459f-9518-0d9aac4ac948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:09.456959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc8dea-2f2e-459f-9518-0d9aac4ac948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:09.457393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc8dea-2f2e-459f-9518-0d9aac4ac948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:09.457790 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc8dea-2f2e-459f-9518-0d9aac4ac948 admin admin] PATH_INFO: `/v3/projects/db7b93ccdb7941d9b3370e349efe5c85` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:09.459349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc8dea-2f2e-459f-9518-0d9aac4ac948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db7b93ccdb7941d9b3370e349efe5c85)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:09.461502 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc8dea-2f2e-459f-9518-0d9aac4ac948 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:09.573401 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-49ce5374-9a55-4eee-bcb7-645ddd8a9727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '626cf3ce22fd4d019022b52e21916a2f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:09.585213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-49ce5374-9a55-4eee-bcb7-645ddd8a9727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '626cf3ce22fd4d019022b52e21916a2f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:09.611363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7ddc8dea-2f2e-459f-9518-0d9aac4ac948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7b93ccdb7941d9b3370e349efe5c85', 'request_id': 'req-7ddc8dea-2f2e-459f-9518-0d9aac4ac948'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:09.662075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-49ce5374-9a55-4eee-bcb7-645ddd8a9727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '626cf3ce22fd4d019022b52e21916a2f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:09.662890 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-49ce5374-9a55-4eee-bcb7-645ddd8a9727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '626cf3ce22fd4d019022b52e21916a2f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:09.663885 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-49ce5374-9a55-4eee-bcb7-645ddd8a9727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '626cf3ce22fd4d019022b52e21916a2f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:09.677452 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1206/2401] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:09 2022] DELETE /identity/v3/users/626cf3ce22fd4d019022b52e21916a2f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:09.776424 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7ddc8dea-2f2e-459f-9518-0d9aac4ac948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7b93ccdb7941d9b3370e349efe5c85', 'request_id': 'req-7ddc8dea-2f2e-459f-9518-0d9aac4ac948'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:09.785926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7ddc8dea-2f2e-459f-9518-0d9aac4ac948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7b93ccdb7941d9b3370e349efe5c85', 'request_id': 'req-7ddc8dea-2f2e-459f-9518-0d9aac4ac948'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:09.804425 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7ddc8dea-2f2e-459f-9518-0d9aac4ac948 admin admin] The token cache is being invalidate because project db7b93ccdb7941d9b3370e349efe5c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:09.805436 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7ddc8dea-2f2e-459f-9518-0d9aac4ac948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:09.806410 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7ddc8dea-2f2e-459f-9518-0d9aac4ac948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:09.817529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6beb84-2441-4d2a-9d4e-ca33efad64d4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:09.818083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6beb84-2441-4d2a-9d4e-ca33efad64d4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:09.818573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6beb84-2441-4d2a-9d4e-ca33efad64d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:09.824066 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1196/2402] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:09 2022] DELETE /identity/v3/projects/db7b93ccdb7941d9b3370e349efe5c85 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:09.840050 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ad6beb84-2441-4d2a-9d4e-ca33efad64d4 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:09.841630 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ad6beb84-2441-4d2a-9d4e-ca33efad64d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:09.908123 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1207/2403] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:09.917051 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffe42e-5328-417a-873e-a4d37dac2f5f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:09.921023 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffe42e-5328-417a-873e-a4d37dac2f5f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:09.921023 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffe42e-5328-417a-873e-a4d37dac2f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:09.938848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c3ffe42e-5328-417a-873e-a4d37dac2f5f None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:09.938848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c3ffe42e-5328-417a-873e-a4d37dac2f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:09.946786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1197/2404] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:09.951051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6beb84-2441-4d2a-9d4e-ca33efad64d4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:09.962782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6beb84-2441-4d2a-9d4e-ca33efad64d4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:09.968450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9456a6-f913-400c-9287-420eafb5640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:09.972719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9456a6-f913-400c-9287-420eafb5640c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:09.972719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9456a6-f913-400c-9287-420eafb5640c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:09.972719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9456a6-f913-400c-9287-420eafb5640c admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:09.972719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9456a6-f913-400c-9287-420eafb5640c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:16:09.972719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9456a6-f913-400c-9287-420eafb5640c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:09.973589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9456a6-f913-400c-9287-420eafb5640c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:10.000237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1208/2405] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:16:10.006281 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffe42e-5328-417a-873e-a4d37dac2f5f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:10.008450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9456a6-f913-400c-9287-420eafb5640c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:10.010545 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8d9456a6-f913-400c-9287-420eafb5640c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:10.031418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffe42e-5328-417a-873e-a4d37dac2f5f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:10.037641 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9456a6-f913-400c-9287-420eafb5640c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:10.044732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:10.045601 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:10.045884 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:10.046160 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a admin admin] PATH_INFO: `/v3/projects/fe9b23322633464f975b94a2144fa300` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:10.047383 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9b23322633464f975b94a2144fa300)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:10.049719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:10.064210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c0422-2e62-485b-88f2-4d0ad18a2b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:10.064915 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c0422-2e62-485b-88f2-4d0ad18a2b7a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:10.065520 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c0422-2e62-485b-88f2-4d0ad18a2b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:10.065764 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c0422-2e62-485b-88f2-4d0ad18a2b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:10.066470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c0422-2e62-485b-88f2-4d0ad18a2b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:10.069191 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c0422-2e62-485b-88f2-4d0ad18a2b7a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:10.205349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9b23322633464f975b94a2144fa300', 'request_id': 'req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:10.212539 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9b23322633464f975b94a2144fa300', 'request_id': 'req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:10.218186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9b23322633464f975b94a2144fa300', 'request_id': 'req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:10.276043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1198/2406] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:10 2022] POST /identity/v3/projects => generated 385 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:10.280403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef280fa6-112e-4376-aebd-32154e861b7c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:10.280698 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef280fa6-112e-4376-aebd-32154e861b7c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:10.281035 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef280fa6-112e-4376-aebd-32154e861b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:10.298309 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a admin admin] The token cache is being invalidate because project fe9b23322633464f975b94a2144fa300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:10.299248 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:10.300119 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:10.302325 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1209/2407] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:10 2022] DELETE /identity/v3/projects/fe9b23322633464f975b94a2144fa300 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:10.303793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:10.305736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:10.308759 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ef280fa6-112e-4376-aebd-32154e861b7c None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:10.309975 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ef280fa6-112e-4376-aebd-32154e861b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:10.380032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1199/2408] 10.222.0.24 () {58 vars in 1009 bytes} [Tue May 17 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:10.381525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e7ff2-b38f-4225-92e2-3cacd0da4096 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:10.381896 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e7ff2-b38f-4225-92e2-3cacd0da4096 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:10.382245 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e7ff2-b38f-4225-92e2-3cacd0da4096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:10.394763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcb17b-77e6-42eb-9c81-fc8a4175d90a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:10.408266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-dc1e7ff2-b38f-4225-92e2-3cacd0da4096 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:10.409548 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dc1e7ff2-b38f-4225-92e2-3cacd0da4096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:10.452256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da05f74-5241-4287-8163-18220099dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:10.452982 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da05f74-5241-4287-8163-18220099dcd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:10.453259 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da05f74-5241-4287-8163-18220099dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:10.453531 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da05f74-5241-4287-8163-18220099dcd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:10.454238 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da05f74-5241-4287-8163-18220099dcd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:10.456962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da05f74-5241-4287-8163-18220099dcd8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:10.470263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1200/2409] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:10.471158 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e7ff2-b38f-4225-92e2-3cacd0da4096 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:10.472608 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dc1e7ff2-b38f-4225-92e2-3cacd0da4096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:10.539734 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e7ff2-b38f-4225-92e2-3cacd0da4096 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:10.545099 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399874a6-f70f-439b-afb6-aa8116b8fd6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:10.545736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399874a6-f70f-439b-afb6-aa8116b8fd6a service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:10.546016 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399874a6-f70f-439b-afb6-aa8116b8fd6a service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:10.546290 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399874a6-f70f-439b-afb6-aa8116b8fd6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:10.557743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399874a6-f70f-439b-afb6-aa8116b8fd6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:10.566354 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399874a6-f70f-439b-afb6-aa8116b8fd6a service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:10.568974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1201/2410] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:16:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 22:16:10.570262 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc50a89-2cf7-4e45-b360-d98ef61a50ad None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:10.570544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc50a89-2cf7-4e45-b360-d98ef61a50ad None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:10.570865 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc50a89-2cf7-4e45-b360-d98ef61a50ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:10.589452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6bc50a89-2cf7-4e45-b360-d98ef61a50ad None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:10.590791 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6bc50a89-2cf7-4e45-b360-d98ef61a50ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:10.597867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1210/2411] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:10 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:10.599712 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1202/2412] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:10.603811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc50a89-2cf7-4e45-b360-d98ef61a50ad None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:10.603956 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da05f74-5241-4287-8163-18220099dcd8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:10.617745 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da05f74-5241-4287-8163-18220099dcd8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:10.617968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc50a89-2cf7-4e45-b360-d98ef61a50ad None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:10.623408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19797eb-d747-4887-986b-830bc12d5689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:10.623707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d39766-4951-45ce-8ef0-9b71611e1d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:10.629671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19797eb-d747-4887-986b-830bc12d5689 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:10.629802 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d39766-4951-45ce-8ef0-9b71611e1d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:10.629901 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19797eb-d747-4887-986b-830bc12d5689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:10.629989 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d39766-4951-45ce-8ef0-9b71611e1d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:10.630101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19797eb-d747-4887-986b-830bc12d5689 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:10.630181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d39766-4951-45ce-8ef0-9b71611e1d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:10.630268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19797eb-d747-4887-986b-830bc12d5689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:16:10.630346 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d39766-4951-45ce-8ef0-9b71611e1d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:10.630421 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19797eb-d747-4887-986b-830bc12d5689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:10.630504 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d39766-4951-45ce-8ef0-9b71611e1d33 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:10.630598 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19797eb-d747-4887-986b-830bc12d5689 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:10.639171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1211/2413] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:10.642296 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1203/2414] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:16:10.643137 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d39766-4951-45ce-8ef0-9b71611e1d33 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:10.645650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19797eb-d747-4887-986b-830bc12d5689 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:10.653518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d39766-4951-45ce-8ef0-9b71611e1d33 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:10.655381 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19797eb-d747-4887-986b-830bc12d5689 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:10.658488 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d78ec-f349-4d8d-bbf4-b80094d80f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:10.659286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d78ec-f349-4d8d-bbf4-b80094d80f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:10.659672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d78ec-f349-4d8d-bbf4-b80094d80f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:10.660066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d78ec-f349-4d8d-bbf4-b80094d80f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:10.660548 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682e364-2bd6-46cd-9823-102fda346c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:10.660813 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d78ec-f349-4d8d-bbf4-b80094d80f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:10.661222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682e364-2bd6-46cd-9823-102fda346c7c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:10.661472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682e364-2bd6-46cd-9823-102fda346c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:10.661751 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682e364-2bd6-46cd-9823-102fda346c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:10.662498 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682e364-2bd6-46cd-9823-102fda346c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:10.662610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d78ec-f349-4d8d-bbf4-b80094d80f31 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:10.664476 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682e364-2bd6-46cd-9823-102fda346c7c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:10.677390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1212/2415] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:10.679261 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d78ec-f349-4d8d-bbf4-b80094d80f31 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:10.689097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d78ec-f349-4d8d-bbf4-b80094d80f31 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:10.694765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95192ab3-e9a8-4d8f-90f6-d52dc9276ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:10.695710 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95192ab3-e9a8-4d8f-90f6-d52dc9276ace admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:10.695996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95192ab3-e9a8-4d8f-90f6-d52dc9276ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:10.698476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95192ab3-e9a8-4d8f-90f6-d52dc9276ace admin admin] PATH_INFO: `/v3/projects/769ee45285c34f0da6863dd41c884401/users/a47c0cc2e78d445ba9fd93d2edab34b4/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:10.711417 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95192ab3-e9a8-4d8f-90f6-d52dc9276ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=769ee45285c34f0da6863dd41c884401, user_id=a47c0cc2e78d445ba9fd93d2edab34b4, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:10.714082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95192ab3-e9a8-4d8f-90f6-d52dc9276ace admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:10.749336 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1204/2416] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:10 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:10.754390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682e364-2bd6-46cd-9823-102fda346c7c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:10.805003 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1213/2417] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:10 2022] PUT /identity/v3/projects/769ee45285c34f0da6863dd41c884401/users/a47c0cc2e78d445ba9fd93d2edab34b4/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:10.817842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702da8a-96c9-4657-a2ef-e2caf7a2c4ef None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:10.817842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702da8a-96c9-4657-a2ef-e2caf7a2c4ef None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:10.818202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702da8a-96c9-4657-a2ef-e2caf7a2c4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:10.855736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682e364-2bd6-46cd-9823-102fda346c7c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:10.864692 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7702da8a-96c9-4657-a2ef-e2caf7a2c4ef None None] MFA Rules not processed for user `a47c0cc2e78d445ba9fd93d2edab34b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:10.866500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7702da8a-96c9-4657-a2ef-e2caf7a2c4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:10.960250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b63f54-72ce-49e1-84eb-510fb3f4d5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:10.961440 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63f54-72ce-49e1-84eb-510fb3f4d5bc admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:10.961730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63f54-72ce-49e1-84eb-510fb3f4d5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:10.962007 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63f54-72ce-49e1-84eb-510fb3f4d5bc admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:10.963947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b63f54-72ce-49e1-84eb-510fb3f4d5bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:10.967043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b63f54-72ce-49e1-84eb-510fb3f4d5bc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:10.993004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1214/2418] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:10.997393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702da8a-96c9-4657-a2ef-e2caf7a2c4ef None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:11.011210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702da8a-96c9-4657-a2ef-e2caf7a2c4ef None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:11.016096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef1c7d-4c23-4926-a017-881b70314532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:11.016768 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef1c7d-4c23-4926-a017-881b70314532 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:11.017123 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef1c7d-4c23-4926-a017-881b70314532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:11.017324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef1c7d-4c23-4926-a017-881b70314532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:11.018190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef1c7d-4c23-4926-a017-881b70314532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:11.020382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef1c7d-4c23-4926-a017-881b70314532 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:11.080033 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1205/2419] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:10 2022] POST /identity/v3/users => generated 293 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:11.084888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b63f54-72ce-49e1-84eb-510fb3f4d5bc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:11.108049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b63f54-72ce-49e1-84eb-510fb3f4d5bc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:11.117062 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba55c7-9149-473d-8286-a5458d0029ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:11.117802 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba55c7-9149-473d-8286-a5458d0029ac admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:11.118087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba55c7-9149-473d-8286-a5458d0029ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:11.118405 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba55c7-9149-473d-8286-a5458d0029ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:11.119095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba55c7-9149-473d-8286-a5458d0029ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:11.121015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba55c7-9149-473d-8286-a5458d0029ac admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:11.147186 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1206/2420] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:11.151184 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba55c7-9149-473d-8286-a5458d0029ac admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:11.154183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1215/2421] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:10 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:11.159496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef1c7d-4c23-4926-a017-881b70314532 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:11.179485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba55c7-9149-473d-8286-a5458d0029ac admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:11.290904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9db845-888e-4350-9d5a-a0fa9e5abfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:11.291637 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9db845-888e-4350-9d5a-a0fa9e5abfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:11.291958 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9db845-888e-4350-9d5a-a0fa9e5abfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:11.292231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9db845-888e-4350-9d5a-a0fa9e5abfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:11.293064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9db845-888e-4350-9d5a-a0fa9e5abfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:11.294102 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef1c7d-4c23-4926-a017-881b70314532 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:11.296490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9db845-888e-4350-9d5a-a0fa9e5abfd2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:11.307875 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d6aaf-24e5-414e-bee2-ca72c9b92e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:11.309159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d6aaf-24e5-414e-bee2-ca72c9b92e80 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:11.309159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d6aaf-24e5-414e-bee2-ca72c9b92e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:11.309372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d6aaf-24e5-414e-bee2-ca72c9b92e80 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:11.310086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d6aaf-24e5-414e-bee2-ca72c9b92e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:11.316074 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d6aaf-24e5-414e-bee2-ca72c9b92e80 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:11.356148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1207/2422] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:11.360444 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9db845-888e-4350-9d5a-a0fa9e5abfd2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:11.388291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9db845-888e-4350-9d5a-a0fa9e5abfd2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:11.406722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac5946-c31b-4944-a2de-568038c56104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:11.407559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac5946-c31b-4944-a2de-568038c56104 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:11.407820 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac5946-c31b-4944-a2de-568038c56104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:11.408093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac5946-c31b-4944-a2de-568038c56104 admin admin] PATH_INFO: `/v3/projects/f632878ceb5d4bec9437bfbdca61a132/users/417a1ab4ba984b2d927a9ff299bf7280/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:11.423934 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1216/2423] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:11 2022] POST /identity/v3/users => generated 299 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:11.427822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d6aaf-24e5-414e-bee2-ca72c9b92e80 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:11.439024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac5946-c31b-4944-a2de-568038c56104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f632878ceb5d4bec9437bfbdca61a132, user_id=417a1ab4ba984b2d927a9ff299bf7280, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:11.442764 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac5946-c31b-4944-a2de-568038c56104 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:11.442980 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d6aaf-24e5-414e-bee2-ca72c9b92e80 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:11.449274 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c714-6669-4c7d-8ce4-6acf293e0ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:11.450781 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c714-6669-4c7d-8ce4-6acf293e0ebe admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:11.451233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c714-6669-4c7d-8ce4-6acf293e0ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:11.451996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c714-6669-4c7d-8ce4-6acf293e0ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:11.452925 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4c714-6669-4c7d-8ce4-6acf293e0ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:11.456958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4c714-6669-4c7d-8ce4-6acf293e0ebe admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:11.477575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1217/2424] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:11.480143 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c714-6669-4c7d-8ce4-6acf293e0ebe admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:11.499662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c714-6669-4c7d-8ce4-6acf293e0ebe admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:11.508172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267ee07-24f6-4500-9b4b-5f2d0d7b9f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:11.509266 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267ee07-24f6-4500-9b4b-5f2d0d7b9f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:11.509647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267ee07-24f6-4500-9b4b-5f2d0d7b9f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:11.509951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267ee07-24f6-4500-9b4b-5f2d0d7b9f5b admin admin] PATH_INFO: `/v3/projects/628fbbaaec544e5a8acbcdc6cf58075e/users/0db9b51c07374a719a0d07e6382898a4/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:11.528990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267ee07-24f6-4500-9b4b-5f2d0d7b9f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=628fbbaaec544e5a8acbcdc6cf58075e, user_id=0db9b51c07374a719a0d07e6382898a4, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:11.532456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267ee07-24f6-4500-9b4b-5f2d0d7b9f5b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:11.543370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1208/2425] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:11 2022] PUT /identity/v3/projects/f632878ceb5d4bec9437bfbdca61a132/users/417a1ab4ba984b2d927a9ff299bf7280/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:11.544989 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e55d9-9c93-4f29-a5c8-439f1138cb03 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:11.545288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e55d9-9c93-4f29-a5c8-439f1138cb03 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:11.545571 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e55d9-9c93-4f29-a5c8-439f1138cb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:11.581768 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-497e55d9-9c93-4f29-a5c8-439f1138cb03 None None] MFA Rules not processed for user `417a1ab4ba984b2d927a9ff299bf7280`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:11.583683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-497e55d9-9c93-4f29-a5c8-439f1138cb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:11.594344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1218/2426] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:11 2022] PUT /identity/v3/projects/628fbbaaec544e5a8acbcdc6cf58075e/users/0db9b51c07374a719a0d07e6382898a4/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:11.599387 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267ee07-24f6-4500-9b4b-5f2d0d7b9f5b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:11.705450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267ee07-24f6-4500-9b4b-5f2d0d7b9f5b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:11.719708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1209/2427] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:11.728449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031c463-bb79-4255-a0a1-b887534b1b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:11.729411 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031c463-bb79-4255-a0a1-b887534b1b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:11.729896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031c463-bb79-4255-a0a1-b887534b1b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:11.730336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031c463-bb79-4255-a0a1-b887534b1b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:11.731305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031c463-bb79-4255-a0a1-b887534b1b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:11.741520 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e55d9-9c93-4f29-a5c8-439f1138cb03 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:11.741520 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-497e55d9-9c93-4f29-a5c8-439f1138cb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:11.741811 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031c463-bb79-4255-a0a1-b887534b1b65 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:11.754741 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1219/2428] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:11.758717 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031c463-bb79-4255-a0a1-b887534b1b65 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:11.770086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031c463-bb79-4255-a0a1-b887534b1b65 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:11.775420 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f7032-3a9c-4078-b93c-1ba87fdc093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:11.776289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f7032-3a9c-4078-b93c-1ba87fdc093d admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:11.776774 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f7032-3a9c-4078-b93c-1ba87fdc093d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:11.777201 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f7032-3a9c-4078-b93c-1ba87fdc093d admin admin] PATH_INFO: `/v3/projects/628fbbaaec544e5a8acbcdc6cf58075e/users/0db9b51c07374a719a0d07e6382898a4/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:11.779806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f7032-3a9c-4078-b93c-1ba87fdc093d admin admin] RBAC: Authorizing `identity:create_grant(project_id=628fbbaaec544e5a8acbcdc6cf58075e, user_id=0db9b51c07374a719a0d07e6382898a4, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:11.782188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f7032-3a9c-4078-b93c-1ba87fdc093d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:11.795832 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1220/2429] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:11 2022] PUT /identity/v3/projects/628fbbaaec544e5a8acbcdc6cf58075e/users/0db9b51c07374a719a0d07e6382898a4/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:11.808054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370e74c-d5e8-49c3-89c6-8b9eefb44f3e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:11.808445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370e74c-d5e8-49c3-89c6-8b9eefb44f3e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:11.808853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370e74c-d5e8-49c3-89c6-8b9eefb44f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:11.849766 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e55d9-9c93-4f29-a5c8-439f1138cb03 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:11.883563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4370e74c-d5e8-49c3-89c6-8b9eefb44f3e None None] MFA Rules not processed for user `0db9b51c07374a719a0d07e6382898a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:11.885453 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4370e74c-d5e8-49c3-89c6-8b9eefb44f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:11.936677 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbffda-78ff-47cf-9cd2-55e4a645f016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:11.937871 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbffda-78ff-47cf-9cd2-55e4a645f016 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:11.939207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbffda-78ff-47cf-9cd2-55e4a645f016 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:11.939207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbffda-78ff-47cf-9cd2-55e4a645f016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:12.011668 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1221/2430] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:12.033318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370e74c-d5e8-49c3-89c6-8b9eefb44f3e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:12.036760 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4370e74c-d5e8-49c3-89c6-8b9eefb44f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:12.051030 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbffda-78ff-47cf-9cd2-55e4a645f016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:12.054980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbffda-78ff-47cf-9cd2-55e4a645f016 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:12.069416 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1210/2431] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:12.140742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370e74c-d5e8-49c3-89c6-8b9eefb44f3e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:12.146116 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa2e1c-a34b-4766-8cd0-55a9038df714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:12.147030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa2e1c-a34b-4766-8cd0-55a9038df714 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:12.147515 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa2e1c-a34b-4766-8cd0-55a9038df714 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:12.147932 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa2e1c-a34b-4766-8cd0-55a9038df714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:12.188577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa2e1c-a34b-4766-8cd0-55a9038df714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:12.190113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa2e1c-a34b-4766-8cd0-55a9038df714 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:12.208102 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1222/2432] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:16:13.556537 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbffda-78ff-47cf-9cd2-55e4a645f016 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:13.629979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbffda-78ff-47cf-9cd2-55e4a645f016 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:13.639884 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a66f2-0fc9-461e-89c7-f21821adec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:13.640772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a66f2-0fc9-461e-89c7-f21821adec72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:13.641052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a66f2-0fc9-461e-89c7-f21821adec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:13.641324 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a66f2-0fc9-461e-89c7-f21821adec72 admin admin] PATH_INFO: `/v3/users/a47c0cc2e78d445ba9fd93d2edab34b4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:13.642601 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a66f2-0fc9-461e-89c7-f21821adec72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47c0cc2e78d445ba9fd93d2edab34b4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:13.645140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a66f2-0fc9-461e-89c7-f21821adec72 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:13.856252 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-070a66f2-0fc9-461e-89c7-f21821adec72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47c0cc2e78d445ba9fd93d2edab34b4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:13.876535 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-070a66f2-0fc9-461e-89c7-f21821adec72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47c0cc2e78d445ba9fd93d2edab34b4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:13.877936 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-070a66f2-0fc9-461e-89c7-f21821adec72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47c0cc2e78d445ba9fd93d2edab34b4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:13.942648 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-070a66f2-0fc9-461e-89c7-f21821adec72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47c0cc2e78d445ba9fd93d2edab34b4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:13.943594 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-070a66f2-0fc9-461e-89c7-f21821adec72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47c0cc2e78d445ba9fd93d2edab34b4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:13.962895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1211/2433] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:13 2022] DELETE /identity/v3/users/a47c0cc2e78d445ba9fd93d2edab34b4 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:13.968215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a7a64-2673-4040-9700-b7ea01892eba None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:13.968684 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a7a64-2673-4040-9700-b7ea01892eba None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:13.968803 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a7a64-2673-4040-9700-b7ea01892eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:13.986683 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-de5a7a64-2673-4040-9700-b7ea01892eba None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:13.988279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-de5a7a64-2673-4040-9700-b7ea01892eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:14.111620 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1223/2434] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:14.122420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a66f2-0fc9-461e-89c7-f21821adec72 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:14.123882 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-070a66f2-0fc9-461e-89c7-f21821adec72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:14.190525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a66f2-0fc9-461e-89c7-f21821adec72 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:14.194240 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1124f-4446-49f7-8dea-ee59e5fd0d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:14.194893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1124f-4446-49f7-8dea-ee59e5fd0d50 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:14.195202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1124f-4446-49f7-8dea-ee59e5fd0d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:14.195479 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1124f-4446-49f7-8dea-ee59e5fd0d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:14.213109 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1124f-4446-49f7-8dea-ee59e5fd0d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:14.214566 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1124f-4446-49f7-8dea-ee59e5fd0d50 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:14.226024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1212/2435] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:14.732707 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a7a64-2673-4040-9700-b7ea01892eba None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:14.734083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-de5a7a64-2673-4040-9700-b7ea01892eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:14.763308 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a7a64-2673-4040-9700-b7ea01892eba None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:14.769301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29075f61-604c-4a5d-831f-dc4ce70dae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:14.770183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29075f61-604c-4a5d-831f-dc4ce70dae70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:14.770463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29075f61-604c-4a5d-831f-dc4ce70dae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:14.770730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29075f61-604c-4a5d-831f-dc4ce70dae70 admin admin] PATH_INFO: `/v3/projects/769ee45285c34f0da6863dd41c884401` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:14.771993 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29075f61-604c-4a5d-831f-dc4ce70dae70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=769ee45285c34f0da6863dd41c884401)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:14.774095 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29075f61-604c-4a5d-831f-dc4ce70dae70 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:14.954998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-29075f61-604c-4a5d-831f-dc4ce70dae70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769ee45285c34f0da6863dd41c884401', 'request_id': 'req-29075f61-604c-4a5d-831f-dc4ce70dae70'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:14.963667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-29075f61-604c-4a5d-831f-dc4ce70dae70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769ee45285c34f0da6863dd41c884401', 'request_id': 'req-29075f61-604c-4a5d-831f-dc4ce70dae70'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:14.981785 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-29075f61-604c-4a5d-831f-dc4ce70dae70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769ee45285c34f0da6863dd41c884401', 'request_id': 'req-29075f61-604c-4a5d-831f-dc4ce70dae70'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:15.107815 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-29075f61-604c-4a5d-831f-dc4ce70dae70 admin admin] The token cache is being invalidate because project 769ee45285c34f0da6863dd41c884401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:15.108101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-29075f61-604c-4a5d-831f-dc4ce70dae70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:15.108741 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-29075f61-604c-4a5d-831f-dc4ce70dae70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:15.110299 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1224/2436] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:14 2022] DELETE /identity/v3/projects/769ee45285c34f0da6863dd41c884401 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:15.114205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1124f-4446-49f7-8dea-ee59e5fd0d50 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:15.124404 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1124f-4446-49f7-8dea-ee59e5fd0d50 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:15.184778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2942c0-5111-4122-b8e6-9b2e6b8a1017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:15.185666 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2942c0-5111-4122-b8e6-9b2e6b8a1017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:15.185953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2942c0-5111-4122-b8e6-9b2e6b8a1017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:15.186458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2942c0-5111-4122-b8e6-9b2e6b8a1017 admin admin] PATH_INFO: `/v3/users/0db9b51c07374a719a0d07e6382898a4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:15.188105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2942c0-5111-4122-b8e6-9b2e6b8a1017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db9b51c07374a719a0d07e6382898a4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:15.190134 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2942c0-5111-4122-b8e6-9b2e6b8a1017 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:15.371915 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9d2942c0-5111-4122-b8e6-9b2e6b8a1017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db9b51c07374a719a0d07e6382898a4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:15.386540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9d2942c0-5111-4122-b8e6-9b2e6b8a1017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db9b51c07374a719a0d07e6382898a4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:15.387310 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9d2942c0-5111-4122-b8e6-9b2e6b8a1017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db9b51c07374a719a0d07e6382898a4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:15.456982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9d2942c0-5111-4122-b8e6-9b2e6b8a1017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db9b51c07374a719a0d07e6382898a4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:15.457741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9d2942c0-5111-4122-b8e6-9b2e6b8a1017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db9b51c07374a719a0d07e6382898a4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:15.470771 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1213/2437] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:15 2022] DELETE /identity/v3/users/0db9b51c07374a719a0d07e6382898a4 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:15.891935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29075f61-604c-4a5d-831f-dc4ce70dae70 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:15.894461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-29075f61-604c-4a5d-831f-dc4ce70dae70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:15.911594 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29075f61-604c-4a5d-831f-dc4ce70dae70 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:15.989340 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896910e-5327-4376-861c-a07ea699ce84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:15.990405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896910e-5327-4376-861c-a07ea699ce84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:15.990521 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896910e-5327-4376-861c-a07ea699ce84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:15.990848 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896910e-5327-4376-861c-a07ea699ce84 admin admin] PATH_INFO: `/v3/projects/628fbbaaec544e5a8acbcdc6cf58075e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:15.992061 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896910e-5327-4376-861c-a07ea699ce84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=628fbbaaec544e5a8acbcdc6cf58075e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:15.994021 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896910e-5327-4376-861c-a07ea699ce84 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:16.123702 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b896910e-5327-4376-861c-a07ea699ce84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '628fbbaaec544e5a8acbcdc6cf58075e', 'request_id': 'req-b896910e-5327-4376-861c-a07ea699ce84'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:16.131233 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b896910e-5327-4376-861c-a07ea699ce84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '628fbbaaec544e5a8acbcdc6cf58075e', 'request_id': 'req-b896910e-5327-4376-861c-a07ea699ce84'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:16.136952 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b896910e-5327-4376-861c-a07ea699ce84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '628fbbaaec544e5a8acbcdc6cf58075e', 'request_id': 'req-b896910e-5327-4376-861c-a07ea699ce84'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:16.239452 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b896910e-5327-4376-861c-a07ea699ce84 admin admin] The token cache is being invalidate because project 628fbbaaec544e5a8acbcdc6cf58075e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:16.239756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b896910e-5327-4376-861c-a07ea699ce84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:16.240395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b896910e-5327-4376-861c-a07ea699ce84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:16.241984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1225/2438] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:15 2022] DELETE /identity/v3/projects/628fbbaaec544e5a8acbcdc6cf58075e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:16.247218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86209e0-d94f-497c-8920-6a3e4f607865 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:16.247712 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86209e0-d94f-497c-8920-6a3e4f607865 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:16.247712 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86209e0-d94f-497c-8920-6a3e4f607865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:16.266927 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f86209e0-d94f-497c-8920-6a3e4f607865 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:16.268494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f86209e0-d94f-497c-8920-6a3e4f607865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:16.339575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b1d19-f100-4806-894d-e81a24bb3732 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:16.339863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b1d19-f100-4806-894d-e81a24bb3732 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:16.340142 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b1d19-f100-4806-894d-e81a24bb3732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:16.340247 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1214/2439] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:16.359996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1c8b1d19-f100-4806-894d-e81a24bb3732 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:16.361254 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1c8b1d19-f100-4806-894d-e81a24bb3732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:16.370130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1226/2440] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:16.374698 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86209e0-d94f-497c-8920-6a3e4f607865 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:16.386662 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86209e0-d94f-497c-8920-6a3e4f607865 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:16.391553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f14e4d-7e96-4dc4-a5de-d946f57c48b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:16.392277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f14e4d-7e96-4dc4-a5de-d946f57c48b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:16.392615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f14e4d-7e96-4dc4-a5de-d946f57c48b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:16.393121 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f14e4d-7e96-4dc4-a5de-d946f57c48b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:16.393869 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f14e4d-7e96-4dc4-a5de-d946f57c48b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:16:16.394208 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f14e4d-7e96-4dc4-a5de-d946f57c48b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:16.395842 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f14e4d-7e96-4dc4-a5de-d946f57c48b5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:16.408136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1215/2441] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:16:16.413289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b1d19-f100-4806-894d-e81a24bb3732 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:16.422737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b1d19-f100-4806-894d-e81a24bb3732 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:16.428423 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38ed0c-4ca5-4206-9dbe-21a25e72df72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:16.429189 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38ed0c-4ca5-4206-9dbe-21a25e72df72 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:16.429545 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38ed0c-4ca5-4206-9dbe-21a25e72df72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:16.429892 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38ed0c-4ca5-4206-9dbe-21a25e72df72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:16.430652 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38ed0c-4ca5-4206-9dbe-21a25e72df72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:16.433025 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38ed0c-4ca5-4206-9dbe-21a25e72df72 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:16.520205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1227/2442] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:16 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:16.524127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f14e4d-7e96-4dc4-a5de-d946f57c48b5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:16.535348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f14e4d-7e96-4dc4-a5de-d946f57c48b5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:16.594679 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68b1ba-47c3-4924-9c57-7b9cad2e1ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:16.595685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68b1ba-47c3-4924-9c57-7b9cad2e1ffb admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:16.596846 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68b1ba-47c3-4924-9c57-7b9cad2e1ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:16.597287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68b1ba-47c3-4924-9c57-7b9cad2e1ffb admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:16.598150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68b1ba-47c3-4924-9c57-7b9cad2e1ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:16.600270 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68b1ba-47c3-4924-9c57-7b9cad2e1ffb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:16.706836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1216/2443] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:16 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:16.710894 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38ed0c-4ca5-4206-9dbe-21a25e72df72 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:16.721950 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38ed0c-4ca5-4206-9dbe-21a25e72df72 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:16.726492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0610a9-ece7-471e-9fe9-670ddfda5c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:16.727285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0610a9-ece7-471e-9fe9-670ddfda5c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:16.727555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0610a9-ece7-471e-9fe9-670ddfda5c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:16.727829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0610a9-ece7-471e-9fe9-670ddfda5c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:16.728554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0610a9-ece7-471e-9fe9-670ddfda5c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:16.730140 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0610a9-ece7-471e-9fe9-670ddfda5c60 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:16.741899 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1228/2444] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:16.745709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68b1ba-47c3-4924-9c57-7b9cad2e1ffb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:16.756159 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68b1ba-47c3-4924-9c57-7b9cad2e1ffb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:16.761073 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35df2a-bdea-455d-9d66-a2d81380252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:16.761741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35df2a-bdea-455d-9d66-a2d81380252c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:16.762024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35df2a-bdea-455d-9d66-a2d81380252c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:16.762302 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35df2a-bdea-455d-9d66-a2d81380252c admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:16.763065 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35df2a-bdea-455d-9d66-a2d81380252c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:16.764691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35df2a-bdea-455d-9d66-a2d81380252c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:16.776054 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1217/2445] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:16.780219 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0610a9-ece7-471e-9fe9-670ddfda5c60 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:16.791343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0610a9-ece7-471e-9fe9-670ddfda5c60 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:16.796183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2633db3-a7d2-49ff-9ea2-a4fc3702479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:16.797079 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2633db3-a7d2-49ff-9ea2-a4fc3702479e admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:16.797473 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2633db3-a7d2-49ff-9ea2-a4fc3702479e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:16.797764 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2633db3-a7d2-49ff-9ea2-a4fc3702479e admin admin] PATH_INFO: `/v3/projects/fc4367c9415a4d2ab922bfb6241181c8/users/3e1a88abc42f4979a0d5e14e4decfe1a/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:16.818432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2633db3-a7d2-49ff-9ea2-a4fc3702479e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4367c9415a4d2ab922bfb6241181c8, user_id=3e1a88abc42f4979a0d5e14e4decfe1a, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:16.821115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2633db3-a7d2-49ff-9ea2-a4fc3702479e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:16.902188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1229/2446] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:16 2022] PUT /identity/v3/projects/fc4367c9415a4d2ab922bfb6241181c8/users/3e1a88abc42f4979a0d5e14e4decfe1a/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:16.912577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27872940-e5d9-4ee6-8b81-3904ef0187f8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:16.912927 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27872940-e5d9-4ee6-8b81-3904ef0187f8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:16.913183 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27872940-e5d9-4ee6-8b81-3904ef0187f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:16.942138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-27872940-e5d9-4ee6-8b81-3904ef0187f8 None None] MFA Rules not processed for user `3e1a88abc42f4979a0d5e14e4decfe1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:16.944640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-27872940-e5d9-4ee6-8b81-3904ef0187f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:17.014634 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1218/2447] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:17.027180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2633db3-a7d2-49ff-9ea2-a4fc3702479e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:17.029774 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a2633db3-a7d2-49ff-9ea2-a4fc3702479e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:17.088699 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2633db3-a7d2-49ff-9ea2-a4fc3702479e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:17.092452 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91123ebd-ef74-4a6e-9722-dc04d39e6df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:17.093090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91123ebd-ef74-4a6e-9722-dc04d39e6df5 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:17.093370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91123ebd-ef74-4a6e-9722-dc04d39e6df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:17.093641 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91123ebd-ef74-4a6e-9722-dc04d39e6df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:17.106754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91123ebd-ef74-4a6e-9722-dc04d39e6df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:17.108552 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91123ebd-ef74-4a6e-9722-dc04d39e6df5 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:17.119499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1230/2448] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:21.421559 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27872940-e5d9-4ee6-8b81-3904ef0187f8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:21.487997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27872940-e5d9-4ee6-8b81-3904ef0187f8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:21.493169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5a215-5bc1-4300-a4d7-7eb44dc45aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:21.494054 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5a215-5bc1-4300-a4d7-7eb44dc45aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:21.494439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5a215-5bc1-4300-a4d7-7eb44dc45aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:21.494759 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5a215-5bc1-4300-a4d7-7eb44dc45aab admin admin] PATH_INFO: `/v3/users/3e1a88abc42f4979a0d5e14e4decfe1a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:21.495860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5a215-5bc1-4300-a4d7-7eb44dc45aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1a88abc42f4979a0d5e14e4decfe1a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:21.497720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5a215-5bc1-4300-a4d7-7eb44dc45aab admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:21.624103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91123ebd-ef74-4a6e-9722-dc04d39e6df5 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:21.624589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-91123ebd-ef74-4a6e-9722-dc04d39e6df5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:21.638886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91123ebd-ef74-4a6e-9722-dc04d39e6df5 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:21.644127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb368b-c1d3-478b-bcd6-e4e90ef164e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:21.645037 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb368b-c1d3-478b-bcd6-e4e90ef164e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:21.645322 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb368b-c1d3-478b-bcd6-e4e90ef164e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:21.645593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb368b-c1d3-478b-bcd6-e4e90ef164e3 admin admin] PATH_INFO: `/v3/users/417a1ab4ba984b2d927a9ff299bf7280` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:21.646765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb368b-c1d3-478b-bcd6-e4e90ef164e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=417a1ab4ba984b2d927a9ff299bf7280)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:21.648706 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb368b-c1d3-478b-bcd6-e4e90ef164e3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:21.719548 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4cf5a215-5bc1-4300-a4d7-7eb44dc45aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1a88abc42f4979a0d5e14e4decfe1a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:21.731469 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4cf5a215-5bc1-4300-a4d7-7eb44dc45aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1a88abc42f4979a0d5e14e4decfe1a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:21.732159 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4cf5a215-5bc1-4300-a4d7-7eb44dc45aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1a88abc42f4979a0d5e14e4decfe1a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:21.809995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4cf5a215-5bc1-4300-a4d7-7eb44dc45aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1a88abc42f4979a0d5e14e4decfe1a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:21.810665 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4cf5a215-5bc1-4300-a4d7-7eb44dc45aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1a88abc42f4979a0d5e14e4decfe1a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:21.824397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-59bb368b-c1d3-478b-bcd6-e4e90ef164e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '417a1ab4ba984b2d927a9ff299bf7280'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:21.824892 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1219/2449] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:21 2022] DELETE /identity/v3/users/3e1a88abc42f4979a0d5e14e4decfe1a => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:21.829321 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367e44c-eac4-434f-b5b4-4741e3fde752 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:21.829618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367e44c-eac4-434f-b5b4-4741e3fde752 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:21.829902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367e44c-eac4-434f-b5b4-4741e3fde752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:21.836343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-59bb368b-c1d3-478b-bcd6-e4e90ef164e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '417a1ab4ba984b2d927a9ff299bf7280'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:21.848335 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e367e44c-eac4-434f-b5b4-4741e3fde752 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:21.849529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e367e44c-eac4-434f-b5b4-4741e3fde752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:21.912096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1220/2450] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:21.913872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-59bb368b-c1d3-478b-bcd6-e4e90ef164e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '417a1ab4ba984b2d927a9ff299bf7280'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:21.914484 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-59bb368b-c1d3-478b-bcd6-e4e90ef164e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '417a1ab4ba984b2d927a9ff299bf7280'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:21.915149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-59bb368b-c1d3-478b-bcd6-e4e90ef164e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '417a1ab4ba984b2d927a9ff299bf7280'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:21.922729 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367e44c-eac4-434f-b5b4-4741e3fde752 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:21.924157 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e367e44c-eac4-434f-b5b4-4741e3fde752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:21.929825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1231/2451] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:21 2022] DELETE /identity/v3/users/417a1ab4ba984b2d927a9ff299bf7280 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:21.933860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034f4e5-b97f-46b6-8238-558d92f2b726 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:21.934374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034f4e5-b97f-46b6-8238-558d92f2b726 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:21.934977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034f4e5-b97f-46b6-8238-558d92f2b726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:21.958486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8034f4e5-b97f-46b6-8238-558d92f2b726 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:21.959890 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8034f4e5-b97f-46b6-8238-558d92f2b726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:21.994849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367e44c-eac4-434f-b5b4-4741e3fde752 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:22.056361 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5a0f4-b32f-45d6-8470-8af1c9fe15e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:22.057041 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5a0f4-b32f-45d6-8470-8af1c9fe15e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:22.057475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5a0f4-b32f-45d6-8470-8af1c9fe15e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:22.057773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5a0f4-b32f-45d6-8470-8af1c9fe15e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:22.060206 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3bb5a0f4-b32f-45d6-8470-8af1c9fe15e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:22.061157 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1232/2452] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:22.062780 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034f4e5-b97f-46b6-8238-558d92f2b726 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:22.064492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8034f4e5-b97f-46b6-8238-558d92f2b726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:22.075889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5a0f4-b32f-45d6-8470-8af1c9fe15e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:22.077333 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5a0f4-b32f-45d6-8470-8af1c9fe15e2 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:22.080689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034f4e5-b97f-46b6-8238-558d92f2b726 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:22.084967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3577c-e06c-47a9-992d-2dd187d3e78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:22.085822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3577c-e06c-47a9-992d-2dd187d3e78c service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:22.086254 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3577c-e06c-47a9-992d-2dd187d3e78c service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:22.086775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3577c-e06c-47a9-992d-2dd187d3e78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:22.088268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1221/2453] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:16:22.101878 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3577c-e06c-47a9-992d-2dd187d3e78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:22.104043 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3577c-e06c-47a9-992d-2dd187d3e78c service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:22.126747 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1233/2454] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:22.663382 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5a0f4-b32f-45d6-8470-8af1c9fe15e2 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:22.664987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3bb5a0f4-b32f-45d6-8470-8af1c9fe15e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:22.683385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5a0f4-b32f-45d6-8470-8af1c9fe15e2 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:22.692484 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3577c-e06c-47a9-992d-2dd187d3e78c service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:22.694024 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6fa3577c-e06c-47a9-992d-2dd187d3e78c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:22.696624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d02877-373c-4f98-abb6-098f60399c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:22.697591 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d02877-373c-4f98-abb6-098f60399c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:22.698205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d02877-373c-4f98-abb6-098f60399c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:22.698205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d02877-373c-4f98-abb6-098f60399c14 admin admin] PATH_INFO: `/v3/projects/fc4367c9415a4d2ab922bfb6241181c8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:22.700468 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d02877-373c-4f98-abb6-098f60399c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4367c9415a4d2ab922bfb6241181c8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:22.705027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d02877-373c-4f98-abb6-098f60399c14 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:22.713146 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3577c-e06c-47a9-992d-2dd187d3e78c service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:22.718141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4836f3-ad94-42be-9461-4e86f818eee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:22.719004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4836f3-ad94-42be-9461-4e86f818eee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:22.719318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4836f3-ad94-42be-9461-4e86f818eee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:22.719593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4836f3-ad94-42be-9461-4e86f818eee8 admin admin] PATH_INFO: `/v3/projects/f632878ceb5d4bec9437bfbdca61a132` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:22.721719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4836f3-ad94-42be-9461-4e86f818eee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f632878ceb5d4bec9437bfbdca61a132)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:22.724312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4836f3-ad94-42be-9461-4e86f818eee8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:22.871344 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-be4836f3-ad94-42be-9461-4e86f818eee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f632878ceb5d4bec9437bfbdca61a132', 'request_id': 'req-be4836f3-ad94-42be-9461-4e86f818eee8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:22.879609 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-be4836f3-ad94-42be-9461-4e86f818eee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f632878ceb5d4bec9437bfbdca61a132', 'request_id': 'req-be4836f3-ad94-42be-9461-4e86f818eee8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:22.885328 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-be4836f3-ad94-42be-9461-4e86f818eee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f632878ceb5d4bec9437bfbdca61a132', 'request_id': 'req-be4836f3-ad94-42be-9461-4e86f818eee8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:22.917743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-11d02877-373c-4f98-abb6-098f60399c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4367c9415a4d2ab922bfb6241181c8', 'request_id': 'req-11d02877-373c-4f98-abb6-098f60399c14'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:22.976753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-be4836f3-ad94-42be-9461-4e86f818eee8 admin admin] The token cache is being invalidate because project f632878ceb5d4bec9437bfbdca61a132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:22.977012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-be4836f3-ad94-42be-9461-4e86f818eee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:22.977737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-be4836f3-ad94-42be-9461-4e86f818eee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:22.980795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1234/2455] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:22 2022] DELETE /identity/v3/projects/f632878ceb5d4bec9437bfbdca61a132 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:22.984309 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9b28b-5481-4894-a2d9-e42e4469adf9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:22.984618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9b28b-5481-4894-a2d9-e42e4469adf9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:22.984901 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9b28b-5481-4894-a2d9-e42e4469adf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.007386 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a3d9b28b-5481-4894-a2d9-e42e4469adf9 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:23.008384 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a3d9b28b-5481-4894-a2d9-e42e4469adf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:23.077027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1235/2456] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:23.086036 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad22a5-96ee-41eb-be8b-40cd17f858ce None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.086594 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-11d02877-373c-4f98-abb6-098f60399c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4367c9415a4d2ab922bfb6241181c8', 'request_id': 'req-11d02877-373c-4f98-abb6-098f60399c14'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:23.086748 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad22a5-96ee-41eb-be8b-40cd17f858ce None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.087072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad22a5-96ee-41eb-be8b-40cd17f858ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.093028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-11d02877-373c-4f98-abb6-098f60399c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4367c9415a4d2ab922bfb6241181c8', 'request_id': 'req-11d02877-373c-4f98-abb6-098f60399c14'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:23.105083 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-11d02877-373c-4f98-abb6-098f60399c14 admin admin] The token cache is being invalidate because project fc4367c9415a4d2ab922bfb6241181c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:23.105362 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-11d02877-373c-4f98-abb6-098f60399c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:23.106049 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-11d02877-373c-4f98-abb6-098f60399c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:23.107741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1222/2457] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:22 2022] DELETE /identity/v3/projects/fc4367c9415a4d2ab922bfb6241181c8 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:23.110093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f7ad22a5-96ee-41eb-be8b-40cd17f858ce None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:23.111346 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f7ad22a5-96ee-41eb-be8b-40cd17f858ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:23.114817 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d44a9b-cc2b-43ef-9e1d-43d701c68554 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.115149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d44a9b-cc2b-43ef-9e1d-43d701c68554 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.115446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d44a9b-cc2b-43ef-9e1d-43d701c68554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.120112 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1236/2458] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:23.124339 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad22a5-96ee-41eb-be8b-40cd17f858ce None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:23.134230 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad22a5-96ee-41eb-be8b-40cd17f858ce None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:23.134410 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f6d44a9b-cc2b-43ef-9e1d-43d701c68554 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:23.135836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f6d44a9b-cc2b-43ef-9e1d-43d701c68554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:23.138973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118c7f9-f9e0-4d52-b5d8-537b4f72807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:23.139670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118c7f9-f9e0-4d52-b5d8-537b4f72807e admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.139946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118c7f9-f9e0-4d52-b5d8-537b4f72807e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.140218 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118c7f9-f9e0-4d52-b5d8-537b4f72807e admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.140935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118c7f9-f9e0-4d52-b5d8-537b4f72807e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:16:23.141239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118c7f9-f9e0-4d52-b5d8-537b4f72807e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:23.142820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118c7f9-f9e0-4d52-b5d8-537b4f72807e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:23.145028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1223/2459] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:23.154126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74ffe9-4c6d-4380-ad8a-09e2eeb5940c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.155218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74ffe9-4c6d-4380-ad8a-09e2eeb5940c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.155218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74ffe9-4c6d-4380-ad8a-09e2eeb5940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.159891 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1237/2460] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:16:23.161158 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118c7f9-f9e0-4d52-b5d8-537b4f72807e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:23.173637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118c7f9-f9e0-4d52-b5d8-537b4f72807e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:23.174918 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3c74ffe9-4c6d-4380-ad8a-09e2eeb5940c None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:23.176151 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3c74ffe9-4c6d-4380-ad8a-09e2eeb5940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:23.178335 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b62487-4c1a-4f16-a11e-b1c86a0d4431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:23.178960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b62487-4c1a-4f16-a11e-b1c86a0d4431 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.185647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b62487-4c1a-4f16-a11e-b1c86a0d4431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.185647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b62487-4c1a-4f16-a11e-b1c86a0d4431 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.185647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b62487-4c1a-4f16-a11e-b1c86a0d4431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:23.185647 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b62487-4c1a-4f16-a11e-b1c86a0d4431 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:23.186541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1224/2461] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:23.190193 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74ffe9-4c6d-4380-ad8a-09e2eeb5940c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:23.199970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74ffe9-4c6d-4380-ad8a-09e2eeb5940c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:23.204845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7653445-d53a-49a7-b294-825714b3f817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:23.205516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7653445-d53a-49a7-b294-825714b3f817 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.205805 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7653445-d53a-49a7-b294-825714b3f817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.206082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7653445-d53a-49a7-b294-825714b3f817 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.207745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7653445-d53a-49a7-b294-825714b3f817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:16:23.208061 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7653445-d53a-49a7-b294-825714b3f817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:23.209739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7653445-d53a-49a7-b294-825714b3f817 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:23.222481 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1225/2462] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:16:23.226828 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7653445-d53a-49a7-b294-825714b3f817 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:23.236789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7653445-d53a-49a7-b294-825714b3f817 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:23.242131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba33a1-42dd-471e-a7eb-e5029b3f63ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:23.242795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba33a1-42dd-471e-a7eb-e5029b3f63ab admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.243080 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba33a1-42dd-471e-a7eb-e5029b3f63ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.243391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba33a1-42dd-471e-a7eb-e5029b3f63ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.244087 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba33a1-42dd-471e-a7eb-e5029b3f63ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:23.245982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba33a1-42dd-471e-a7eb-e5029b3f63ab admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:23.294773 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1238/2463] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:23 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:23.296047 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b62487-4c1a-4f16-a11e-b1c86a0d4431 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:23.355008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1226/2464] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:23 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:23.360698 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b62487-4c1a-4f16-a11e-b1c86a0d4431 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:23.363651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba33a1-42dd-471e-a7eb-e5029b3f63ab admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:23.418812 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efd8b7-5637-449a-9cb6-66362058df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:23.419426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efd8b7-5637-449a-9cb6-66362058df36 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.419706 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efd8b7-5637-449a-9cb6-66362058df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.419976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efd8b7-5637-449a-9cb6-66362058df36 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.420661 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efd8b7-5637-449a-9cb6-66362058df36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:23.422563 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efd8b7-5637-449a-9cb6-66362058df36 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:23.425685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba33a1-42dd-471e-a7eb-e5029b3f63ab admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:23.430423 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07eb730-e635-450e-9ea0-ceb84ac2879b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:23.431095 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eb730-e635-450e-9ea0-ceb84ac2879b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.431404 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eb730-e635-450e-9ea0-ceb84ac2879b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.431684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eb730-e635-450e-9ea0-ceb84ac2879b admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.432375 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07eb730-e635-450e-9ea0-ceb84ac2879b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:23.434324 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07eb730-e635-450e-9ea0-ceb84ac2879b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:23.528816 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1239/2465] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:23 2022] POST /identity/v3/users => generated 284 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:23.532686 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efd8b7-5637-449a-9cb6-66362058df36 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:23.545292 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1227/2466] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:23 2022] POST /identity/v3/users => generated 282 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:23.545484 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efd8b7-5637-449a-9cb6-66362058df36 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:23.546380 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07eb730-e635-450e-9ea0-ceb84ac2879b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:23.548066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712573b-0095-442b-adbe-879d881c91f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:23.548742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712573b-0095-442b-adbe-879d881c91f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.549019 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712573b-0095-442b-adbe-879d881c91f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.549295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712573b-0095-442b-adbe-879d881c91f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.550538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712573b-0095-442b-adbe-879d881c91f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:23.552123 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712573b-0095-442b-adbe-879d881c91f6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:23.556639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07eb730-e635-450e-9ea0-ceb84ac2879b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:23.561303 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7db330-26f6-4ce1-81c3-4006cc6be049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:23.561947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7db330-26f6-4ce1-81c3-4006cc6be049 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.562060 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1240/2467] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:23.565321 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7db330-26f6-4ce1-81c3-4006cc6be049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.565670 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7db330-26f6-4ce1-81c3-4006cc6be049 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.566807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712573b-0095-442b-adbe-879d881c91f6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:23.566939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7db330-26f6-4ce1-81c3-4006cc6be049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:23.568580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7db330-26f6-4ce1-81c3-4006cc6be049 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:23.576443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712573b-0095-442b-adbe-879d881c91f6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:23.578683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1228/2468] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:23.582803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7db330-26f6-4ce1-81c3-4006cc6be049 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:23.583966 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef0ba9-fd6f-4179-aec3-b3d0ee05b671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:23.584619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef0ba9-fd6f-4179-aec3-b3d0ee05b671 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.584897 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef0ba9-fd6f-4179-aec3-b3d0ee05b671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.585170 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef0ba9-fd6f-4179-aec3-b3d0ee05b671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.585890 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef0ba9-fd6f-4179-aec3-b3d0ee05b671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:23.587509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef0ba9-fd6f-4179-aec3-b3d0ee05b671 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:23.592147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7db330-26f6-4ce1-81c3-4006cc6be049 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:23.596745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a869e34-93c4-44d8-8a61-318911edf4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:23.597999 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1241/2469] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:23.600973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a869e34-93c4-44d8-8a61-318911edf4cd admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.601282 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a869e34-93c4-44d8-8a61-318911edf4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.601564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a869e34-93c4-44d8-8a61-318911edf4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.601756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef0ba9-fd6f-4179-aec3-b3d0ee05b671 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:23.602291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a869e34-93c4-44d8-8a61-318911edf4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:23.603896 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a869e34-93c4-44d8-8a61-318911edf4cd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:23.610912 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef0ba9-fd6f-4179-aec3-b3d0ee05b671 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:23.618468 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1229/2470] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:23.618635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bebd79-f9cf-4a3b-ac91-989d54f0d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:23.618635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bebd79-f9cf-4a3b-ac91-989d54f0d338 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.618635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bebd79-f9cf-4a3b-ac91-989d54f0d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.618635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bebd79-f9cf-4a3b-ac91-989d54f0d338 admin admin] PATH_INFO: `/v3/projects/2d877a071bce41cbb7fc8336ba3de286/users/f5879ca7cf9a410a837dbb54dbd7c034/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.619512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a869e34-93c4-44d8-8a61-318911edf4cd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:23.629110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a869e34-93c4-44d8-8a61-318911edf4cd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:23.632645 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bebd79-f9cf-4a3b-ac91-989d54f0d338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d877a071bce41cbb7fc8336ba3de286, user_id=f5879ca7cf9a410a837dbb54dbd7c034, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:23.634131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a55c8-e994-4314-8e84-27fa8652f570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:23.634996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a55c8-e994-4314-8e84-27fa8652f570 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.635315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a55c8-e994-4314-8e84-27fa8652f570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.635446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bebd79-f9cf-4a3b-ac91-989d54f0d338 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:23.635592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a55c8-e994-4314-8e84-27fa8652f570 admin admin] PATH_INFO: `/v3/projects/4faf17e96a0c4d69ac410971d2fbe97c/users/96c173585d784a4dae36fe8fabcca0e4/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.651024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a55c8-e994-4314-8e84-27fa8652f570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4faf17e96a0c4d69ac410971d2fbe97c, user_id=96c173585d784a4dae36fe8fabcca0e4, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:23.653762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a55c8-e994-4314-8e84-27fa8652f570 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:23.740464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1230/2471] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:23 2022] PUT /identity/v3/projects/4faf17e96a0c4d69ac410971d2fbe97c/users/96c173585d784a4dae36fe8fabcca0e4/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:23.741265 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1242/2472] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:23 2022] PUT /identity/v3/projects/2d877a071bce41cbb7fc8336ba3de286/users/f5879ca7cf9a410a837dbb54dbd7c034/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:23.750712 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44669106-13df-4d31-b337-6a64f6debe03 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.750993 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862482b-a922-4490-bb63-d8509b2b9ac7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.751148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44669106-13df-4d31-b337-6a64f6debe03 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.751310 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44669106-13df-4d31-b337-6a64f6debe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.751467 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862482b-a922-4490-bb63-d8509b2b9ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.751648 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862482b-a922-4490-bb63-d8509b2b9ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.778145 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-44669106-13df-4d31-b337-6a64f6debe03 None None] MFA Rules not processed for user `96c173585d784a4dae36fe8fabcca0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:23.778388 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2862482b-a922-4490-bb63-d8509b2b9ac7 None None] MFA Rules not processed for user `f5879ca7cf9a410a837dbb54dbd7c034`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:23.779393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-44669106-13df-4d31-b337-6a64f6debe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:23.779552 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2862482b-a922-4490-bb63-d8509b2b9ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:23.840793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1243/2473] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:23.844919 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1231/2474] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:23 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:23.854388 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862482b-a922-4490-bb63-d8509b2b9ac7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:23.855747 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2862482b-a922-4490-bb63-d8509b2b9ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:23.856600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44669106-13df-4d31-b337-6a64f6debe03 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:23.857948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-44669106-13df-4d31-b337-6a64f6debe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:23.914472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862482b-a922-4490-bb63-d8509b2b9ac7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:23.915762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44669106-13df-4d31-b337-6a64f6debe03 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:23.918096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20ae33-b07c-4522-a332-fe525970c35d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:23.918740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20ae33-b07c-4522-a332-fe525970c35d service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.919023 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20ae33-b07c-4522-a332-fe525970c35d service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.919330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfcf96-b9a6-4185-8f6f-f5efae4bde94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:23.919502 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20ae33-b07c-4522-a332-fe525970c35d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.919968 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfcf96-b9a6-4185-8f6f-f5efae4bde94 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:23.920251 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfcf96-b9a6-4185-8f6f-f5efae4bde94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:23.920526 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfcf96-b9a6-4185-8f6f-f5efae4bde94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:23.928445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20ae33-b07c-4522-a332-fe525970c35d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:23.929503 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfcf96-b9a6-4185-8f6f-f5efae4bde94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:23.930021 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20ae33-b07c-4522-a332-fe525970c35d service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:23.930948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfcf96-b9a6-4185-8f6f-f5efae4bde94 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:23.939312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1244/2475] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:23 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:23.941149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1232/2476] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:23 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:16:26.674391 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8209bd4-671d-4a97-868e-dbeab93d91c9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:26.674954 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8209bd4-671d-4a97-868e-dbeab93d91c9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:26.675757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8209bd4-671d-4a97-868e-dbeab93d91c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:26.693839 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d8209bd4-671d-4a97-868e-dbeab93d91c9 None None] MFA Rules not processed for user `f6f7d26d4d434ad5a3abc45f8f05e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:26.695029 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d8209bd4-671d-4a97-868e-dbeab93d91c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:26.780955 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1245/2477] 10.222.0.24 () {58 vars in 967 bytes} [Tue May 17 22:16:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:26.795548 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfcf96-b9a6-4185-8f6f-f5efae4bde94 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:26.797673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c3cfcf96-b9a6-4185-8f6f-f5efae4bde94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:26.879974 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfcf96-b9a6-4185-8f6f-f5efae4bde94 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:26.884924 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523f12c-a16d-41eb-a2fc-5d3c56cb80dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957c3decfb19445d80836f767fa23bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:26.885598 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523f12c-a16d-41eb-a2fc-5d3c56cb80dc service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:26.885875 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523f12c-a16d-41eb-a2fc-5d3c56cb80dc service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:26.886149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523f12c-a16d-41eb-a2fc-5d3c56cb80dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:26.900620 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523f12c-a16d-41eb-a2fc-5d3c56cb80dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:26.903000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523f12c-a16d-41eb-a2fc-5d3c56cb80dc service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:26.915399 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1233/2478] 10.222.0.24 () {60 vars in 1384 bytes} [Tue May 17 22:16:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 22:16:34.324029 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8209bd4-671d-4a97-868e-dbeab93d91c9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:34.385623 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8209bd4-671d-4a97-868e-dbeab93d91c9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:34.390200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95c3b8-f3b7-466b-ba6c-5dc93481f534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:34.391042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95c3b8-f3b7-466b-ba6c-5dc93481f534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:34.394386 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95c3b8-f3b7-466b-ba6c-5dc93481f534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:34.394386 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95c3b8-f3b7-466b-ba6c-5dc93481f534 admin admin] PATH_INFO: `/v3/users/f5879ca7cf9a410a837dbb54dbd7c034` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:34.394386 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95c3b8-f3b7-466b-ba6c-5dc93481f534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5879ca7cf9a410a837dbb54dbd7c034)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:34.395445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95c3b8-f3b7-466b-ba6c-5dc93481f534 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:34.535229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5d95c3b8-f3b7-466b-ba6c-5dc93481f534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5879ca7cf9a410a837dbb54dbd7c034'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:34.546558 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5d95c3b8-f3b7-466b-ba6c-5dc93481f534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5879ca7cf9a410a837dbb54dbd7c034'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:34.621524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5d95c3b8-f3b7-466b-ba6c-5dc93481f534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5879ca7cf9a410a837dbb54dbd7c034'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:34.622126 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5d95c3b8-f3b7-466b-ba6c-5dc93481f534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5879ca7cf9a410a837dbb54dbd7c034'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:34.622731 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5d95c3b8-f3b7-466b-ba6c-5dc93481f534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5879ca7cf9a410a837dbb54dbd7c034'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:34.635829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1246/2479] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:34 2022] DELETE /identity/v3/users/f5879ca7cf9a410a837dbb54dbd7c034 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:34.640271 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea652eb5-f7f7-4e47-adbd-88d69d98373e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:34.640731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea652eb5-f7f7-4e47-adbd-88d69d98373e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:34.640840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea652eb5-f7f7-4e47-adbd-88d69d98373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:34.657396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ea652eb5-f7f7-4e47-adbd-88d69d98373e None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:34.658576 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ea652eb5-f7f7-4e47-adbd-88d69d98373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:34.716123 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1234/2480] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:34.725909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95c3b8-f3b7-466b-ba6c-5dc93481f534 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:34.727328 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5d95c3b8-f3b7-466b-ba6c-5dc93481f534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:34.782280 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95c3b8-f3b7-466b-ba6c-5dc93481f534 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:34.786254 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7a162-95bd-41cb-b561-8fab2b7db0ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:34.786905 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7a162-95bd-41cb-b561-8fab2b7db0ed service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:34.787210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7a162-95bd-41cb-b561-8fab2b7db0ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:34.787486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7a162-95bd-41cb-b561-8fab2b7db0ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:34.796337 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7a162-95bd-41cb-b561-8fab2b7db0ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:34.797804 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7a162-95bd-41cb-b561-8fab2b7db0ed service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:34.807784 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1247/2481] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:35.355021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea652eb5-f7f7-4e47-adbd-88d69d98373e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:35.356759 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ea652eb5-f7f7-4e47-adbd-88d69d98373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:35.368830 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea652eb5-f7f7-4e47-adbd-88d69d98373e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:35.373459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dd2f0-8bcb-4ae7-9241-98dc8eb8a92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:35.374382 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dd2f0-8bcb-4ae7-9241-98dc8eb8a92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:35.374610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dd2f0-8bcb-4ae7-9241-98dc8eb8a92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:35.374888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dd2f0-8bcb-4ae7-9241-98dc8eb8a92b admin admin] PATH_INFO: `/v3/projects/2d877a071bce41cbb7fc8336ba3de286` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:35.376121 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dd2f0-8bcb-4ae7-9241-98dc8eb8a92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d877a071bce41cbb7fc8336ba3de286)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:35.378114 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dd2f0-8bcb-4ae7-9241-98dc8eb8a92b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:35.494425 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d30dd2f0-8bcb-4ae7-9241-98dc8eb8a92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d877a071bce41cbb7fc8336ba3de286', 'request_id': 'req-d30dd2f0-8bcb-4ae7-9241-98dc8eb8a92b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:35.573777 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d30dd2f0-8bcb-4ae7-9241-98dc8eb8a92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d877a071bce41cbb7fc8336ba3de286', 'request_id': 'req-d30dd2f0-8bcb-4ae7-9241-98dc8eb8a92b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:35.579216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d30dd2f0-8bcb-4ae7-9241-98dc8eb8a92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d877a071bce41cbb7fc8336ba3de286', 'request_id': 'req-d30dd2f0-8bcb-4ae7-9241-98dc8eb8a92b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:35.590458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d30dd2f0-8bcb-4ae7-9241-98dc8eb8a92b admin admin] The token cache is being invalidate because project 2d877a071bce41cbb7fc8336ba3de286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:35.590739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d30dd2f0-8bcb-4ae7-9241-98dc8eb8a92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:35.591385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d30dd2f0-8bcb-4ae7-9241-98dc8eb8a92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:35.592958 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1235/2482] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:35 2022] DELETE /identity/v3/projects/2d877a071bce41cbb7fc8336ba3de286 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:35.597911 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017c662-79c8-4634-b8e3-2c576172fceb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:35.598403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017c662-79c8-4634-b8e3-2c576172fceb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:35.598502 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017c662-79c8-4634-b8e3-2c576172fceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:35.616096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0017c662-79c8-4634-b8e3-2c576172fceb None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:35.617371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0017c662-79c8-4634-b8e3-2c576172fceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:35.674418 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1248/2483] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:35.683158 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603ac0a-638a-4fea-85b8-93a7aaccd768 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:35.683650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603ac0a-638a-4fea-85b8-93a7aaccd768 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:35.683745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603ac0a-638a-4fea-85b8-93a7aaccd768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:35.702186 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f603ac0a-638a-4fea-85b8-93a7aaccd768 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:35.703390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f603ac0a-638a-4fea-85b8-93a7aaccd768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:35.711718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1236/2484] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:35.715779 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017c662-79c8-4634-b8e3-2c576172fceb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:35.725165 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017c662-79c8-4634-b8e3-2c576172fceb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:35.729892 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ada5e6-9019-44f4-9e1f-8045293f4f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:35.730538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ada5e6-9019-44f4-9e1f-8045293f4f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:35.730820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ada5e6-9019-44f4-9e1f-8045293f4f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:35.731096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ada5e6-9019-44f4-9e1f-8045293f4f45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:35.731847 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ada5e6-9019-44f4-9e1f-8045293f4f45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:16:35.732154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ada5e6-9019-44f4-9e1f-8045293f4f45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:35.733745 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ada5e6-9019-44f4-9e1f-8045293f4f45 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:35.744917 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1249/2485] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:16:35.749020 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603ac0a-638a-4fea-85b8-93a7aaccd768 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:35.758639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603ac0a-638a-4fea-85b8-93a7aaccd768 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:35.763249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a712c-9f18-4fc3-906b-4da551ca1328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:35.763883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a712c-9f18-4fc3-906b-4da551ca1328 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:35.764161 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a712c-9f18-4fc3-906b-4da551ca1328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:35.764429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a712c-9f18-4fc3-906b-4da551ca1328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:35.765118 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a712c-9f18-4fc3-906b-4da551ca1328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:35.766971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a712c-9f18-4fc3-906b-4da551ca1328 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:35.890467 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1237/2486] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:35 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:35.894776 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ada5e6-9019-44f4-9e1f-8045293f4f45 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:35.904893 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ada5e6-9019-44f4-9e1f-8045293f4f45 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:35.961051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e650b-966b-482c-aef9-3e392df4aca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:35.961748 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e650b-966b-482c-aef9-3e392df4aca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:35.962030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e650b-966b-482c-aef9-3e392df4aca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:35.962302 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e650b-966b-482c-aef9-3e392df4aca6 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:35.962990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e650b-966b-482c-aef9-3e392df4aca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:35.964950 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e650b-966b-482c-aef9-3e392df4aca6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:36.049508 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1250/2487] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:35 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:36.053714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a712c-9f18-4fc3-906b-4da551ca1328 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:36.064660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a712c-9f18-4fc3-906b-4da551ca1328 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:36.069294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f44f-b0ea-44bb-be2c-41213acc102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:36.069954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f44f-b0ea-44bb-be2c-41213acc102c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:36.070235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f44f-b0ea-44bb-be2c-41213acc102c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:36.070512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f44f-b0ea-44bb-be2c-41213acc102c admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:36.071982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2f44f-b0ea-44bb-be2c-41213acc102c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:36.073539 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2f44f-b0ea-44bb-be2c-41213acc102c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:36.083980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1238/2488] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:36.088314 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e650b-966b-482c-aef9-3e392df4aca6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:36.098183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e650b-966b-482c-aef9-3e392df4aca6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:36.103157 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9642b0-d42d-420c-9b17-c942263ad3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:36.103931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9642b0-d42d-420c-9b17-c942263ad3bb admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:36.104263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9642b0-d42d-420c-9b17-c942263ad3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:36.104684 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9642b0-d42d-420c-9b17-c942263ad3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:36.105395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9642b0-d42d-420c-9b17-c942263ad3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:36.107036 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9642b0-d42d-420c-9b17-c942263ad3bb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:36.117340 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1251/2489] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:36.121977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f44f-b0ea-44bb-be2c-41213acc102c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:36.132078 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f44f-b0ea-44bb-be2c-41213acc102c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:36.137489 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ccde5-4958-49d3-8491-9881f2430f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:36.138445 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ccde5-4958-49d3-8491-9881f2430f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:36.138795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ccde5-4958-49d3-8491-9881f2430f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:36.139163 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ccde5-4958-49d3-8491-9881f2430f12 admin admin] PATH_INFO: `/v3/projects/35930c06615847488b788ba3c75ff80f/users/6099c17550a74c9d8883af8a75d6767b/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:36.153429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ccde5-4958-49d3-8491-9881f2430f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35930c06615847488b788ba3c75ff80f, user_id=6099c17550a74c9d8883af8a75d6767b, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:36.156028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ccde5-4958-49d3-8491-9881f2430f12 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:36.243500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1239/2490] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:36 2022] PUT /identity/v3/projects/35930c06615847488b788ba3c75ff80f/users/6099c17550a74c9d8883af8a75d6767b/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:36.254084 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc9b9f-fc11-4dbb-8616-d831923bde64 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:36.254379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc9b9f-fc11-4dbb-8616-d831923bde64 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:36.254656 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc9b9f-fc11-4dbb-8616-d831923bde64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:36.280350 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-01cc9b9f-fc11-4dbb-8616-d831923bde64 None None] MFA Rules not processed for user `6099c17550a74c9d8883af8a75d6767b`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:36.281549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-01cc9b9f-fc11-4dbb-8616-d831923bde64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:36.345825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1252/2491] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:36.357799 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ccde5-4958-49d3-8491-9881f2430f12 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:36.359578 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-115ccde5-4958-49d3-8491-9881f2430f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:36.432217 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ccde5-4958-49d3-8491-9881f2430f12 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:36.438190 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db7de2-767b-41e8-840d-718e023af818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:36.438896 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db7de2-767b-41e8-840d-718e023af818 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:36.439213 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db7de2-767b-41e8-840d-718e023af818 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:36.439493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db7de2-767b-41e8-840d-718e023af818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:36.447328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db7de2-767b-41e8-840d-718e023af818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:36.448900 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db7de2-767b-41e8-840d-718e023af818 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:36.457540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1240/2492] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:36.664161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc9b9f-fc11-4dbb-8616-d831923bde64 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:36.725189 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc9b9f-fc11-4dbb-8616-d831923bde64 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:36.730410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9176c9-ee73-4150-8c41-45b734d1cfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:36.731288 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9176c9-ee73-4150-8c41-45b734d1cfdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:36.731562 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9176c9-ee73-4150-8c41-45b734d1cfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:36.731825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9176c9-ee73-4150-8c41-45b734d1cfdc admin admin] PATH_INFO: `/v3/users/6099c17550a74c9d8883af8a75d6767b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:36.733032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9176c9-ee73-4150-8c41-45b734d1cfdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6099c17550a74c9d8883af8a75d6767b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:36.735007 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9176c9-ee73-4150-8c41-45b734d1cfdc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:37.010419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6f9176c9-ee73-4150-8c41-45b734d1cfdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6099c17550a74c9d8883af8a75d6767b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:37.021531 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6f9176c9-ee73-4150-8c41-45b734d1cfdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6099c17550a74c9d8883af8a75d6767b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:37.106698 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6f9176c9-ee73-4150-8c41-45b734d1cfdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6099c17550a74c9d8883af8a75d6767b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:37.107359 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6f9176c9-ee73-4150-8c41-45b734d1cfdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6099c17550a74c9d8883af8a75d6767b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:37.107980 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6f9176c9-ee73-4150-8c41-45b734d1cfdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6099c17550a74c9d8883af8a75d6767b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:37.120862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1253/2493] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:36 2022] DELETE /identity/v3/users/6099c17550a74c9d8883af8a75d6767b => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:37.125408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f39fab-04d2-4013-8856-42e414b4ce84 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:37.125906 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f39fab-04d2-4013-8856-42e414b4ce84 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:37.126021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f39fab-04d2-4013-8856-42e414b4ce84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:37.143078 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-15f39fab-04d2-4013-8856-42e414b4ce84 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:37.144275 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-15f39fab-04d2-4013-8856-42e414b4ce84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:37.208667 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1241/2494] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:37.218949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9176c9-ee73-4150-8c41-45b734d1cfdc admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:37.220358 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6f9176c9-ee73-4150-8c41-45b734d1cfdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:37.281252 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9176c9-ee73-4150-8c41-45b734d1cfdc admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:37.284967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b3b49-818a-4d6e-b8f8-2d7e01a4b6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:37.285696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b3b49-818a-4d6e-b8f8-2d7e01a4b6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:37.285981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b3b49-818a-4d6e-b8f8-2d7e01a4b6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:37.286255 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b3b49-818a-4d6e-b8f8-2d7e01a4b6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:37.295737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b3b49-818a-4d6e-b8f8-2d7e01a4b6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:37.297168 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b3b49-818a-4d6e-b8f8-2d7e01a4b6b9 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:37.307189 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1254/2495] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:37.653050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f39fab-04d2-4013-8856-42e414b4ce84 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:37.653795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-15f39fab-04d2-4013-8856-42e414b4ce84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:37.667750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f39fab-04d2-4013-8856-42e414b4ce84 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:37.671706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae46e8b-237e-4720-9460-a2160d7c6c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:37.672360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae46e8b-237e-4720-9460-a2160d7c6c7f service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:37.672651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae46e8b-237e-4720-9460-a2160d7c6c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:37.672931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae46e8b-237e-4720-9460-a2160d7c6c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:37.674715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5ae46e8b-237e-4720-9460-a2160d7c6c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:37.688077 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae46e8b-237e-4720-9460-a2160d7c6c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:37.689516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae46e8b-237e-4720-9460-a2160d7c6c7f service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:37.700198 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1242/2496] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:37.790098 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b3b49-818a-4d6e-b8f8-2d7e01a4b6b9 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:37.791654 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-de5b3b49-818a-4d6e-b8f8-2d7e01a4b6b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:37.804345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b3b49-818a-4d6e-b8f8-2d7e01a4b6b9 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:37.810026 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa911c-4685-4a25-a3da-1d5194d2698f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:37.810892 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa911c-4685-4a25-a3da-1d5194d2698f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:37.811210 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa911c-4685-4a25-a3da-1d5194d2698f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:37.811487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa911c-4685-4a25-a3da-1d5194d2698f admin admin] PATH_INFO: `/v3/projects/35930c06615847488b788ba3c75ff80f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:37.813218 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa911c-4685-4a25-a3da-1d5194d2698f admin admin] RBAC: Authorizing `identity:delete_project(project_id=35930c06615847488b788ba3c75ff80f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:37.815295 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa911c-4685-4a25-a3da-1d5194d2698f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:37.927074 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-acaa911c-4685-4a25-a3da-1d5194d2698f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35930c06615847488b788ba3c75ff80f', 'request_id': 'req-acaa911c-4685-4a25-a3da-1d5194d2698f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:37.935099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-acaa911c-4685-4a25-a3da-1d5194d2698f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35930c06615847488b788ba3c75ff80f', 'request_id': 'req-acaa911c-4685-4a25-a3da-1d5194d2698f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:37.941616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-acaa911c-4685-4a25-a3da-1d5194d2698f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35930c06615847488b788ba3c75ff80f', 'request_id': 'req-acaa911c-4685-4a25-a3da-1d5194d2698f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:38.044906 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-acaa911c-4685-4a25-a3da-1d5194d2698f admin admin] The token cache is being invalidate because project 35930c06615847488b788ba3c75ff80f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:38.045201 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-acaa911c-4685-4a25-a3da-1d5194d2698f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:38.048242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-acaa911c-4685-4a25-a3da-1d5194d2698f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:38.048242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1255/2497] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:37 2022] DELETE /identity/v3/projects/35930c06615847488b788ba3c75ff80f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:38.052552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01497e-1c0c-42c8-8117-02f836b03a69 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:38.052874 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01497e-1c0c-42c8-8117-02f836b03a69 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:38.053150 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01497e-1c0c-42c8-8117-02f836b03a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:38.072473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8b01497e-1c0c-42c8-8117-02f836b03a69 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:38.073672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8b01497e-1c0c-42c8-8117-02f836b03a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:38.143805 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1243/2498] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:38.152348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d4af6-2aa5-4a83-9535-e161900a037c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:38.152915 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d4af6-2aa5-4a83-9535-e161900a037c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:38.153332 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d4af6-2aa5-4a83-9535-e161900a037c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:38.176182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5f0d4af6-2aa5-4a83-9535-e161900a037c None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:38.176659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5f0d4af6-2aa5-4a83-9535-e161900a037c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:38.184775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1256/2499] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:38.189242 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01497e-1c0c-42c8-8117-02f836b03a69 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:38.198996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01497e-1c0c-42c8-8117-02f836b03a69 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:38.203763 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e5c29-1936-4938-a79d-4bb9c799337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:38.208553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e5c29-1936-4938-a79d-4bb9c799337c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:38.208553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e5c29-1936-4938-a79d-4bb9c799337c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:38.208553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e5c29-1936-4938-a79d-4bb9c799337c admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:38.208553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e5c29-1936-4938-a79d-4bb9c799337c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:16:38.208553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e5c29-1936-4938-a79d-4bb9c799337c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:38.208553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e5c29-1936-4938-a79d-4bb9c799337c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:38.229405 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1244/2500] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:16:38.230968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d4af6-2aa5-4a83-9535-e161900a037c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:38.240284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d4af6-2aa5-4a83-9535-e161900a037c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:38.245820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e59d29-a85a-49fc-908d-ae703615fa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:38.246695 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e59d29-a85a-49fc-908d-ae703615fa4f admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:38.246940 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e59d29-a85a-49fc-908d-ae703615fa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:38.247263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e59d29-a85a-49fc-908d-ae703615fa4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:38.248032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e59d29-a85a-49fc-908d-ae703615fa4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:38.250104 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e59d29-a85a-49fc-908d-ae703615fa4f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:38.410148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1257/2501] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:38 2022] POST /identity/v3/projects => generated 369 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:38.411294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e5c29-1936-4938-a79d-4bb9c799337c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:38.422169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e5c29-1936-4938-a79d-4bb9c799337c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:38.481560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124403f5-c783-4c95-9096-9ca641e6db0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:38.482238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124403f5-c783-4c95-9096-9ca641e6db0e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:38.482590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124403f5-c783-4c95-9096-9ca641e6db0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:38.482835 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124403f5-c783-4c95-9096-9ca641e6db0e admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:38.483575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124403f5-c783-4c95-9096-9ca641e6db0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:38.485477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124403f5-c783-4c95-9096-9ca641e6db0e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:38.608977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1245/2502] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:38 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:38.613186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e59d29-a85a-49fc-908d-ae703615fa4f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:38.623958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e59d29-a85a-49fc-908d-ae703615fa4f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:38.628583 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0f0e1-bb2a-47f3-be05-a0fd144574bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:38.629416 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0f0e1-bb2a-47f3-be05-a0fd144574bd admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:38.629701 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0f0e1-bb2a-47f3-be05-a0fd144574bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:38.629980 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0f0e1-bb2a-47f3-be05-a0fd144574bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:38.630831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0f0e1-bb2a-47f3-be05-a0fd144574bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:38.632480 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0f0e1-bb2a-47f3-be05-a0fd144574bd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:38.644443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1258/2503] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:38.649772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124403f5-c783-4c95-9096-9ca641e6db0e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:38.661394 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124403f5-c783-4c95-9096-9ca641e6db0e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:38.666919 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a55433-7c3c-46c6-9f00-dccde63da52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:38.667628 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a55433-7c3c-46c6-9f00-dccde63da52f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:38.667915 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a55433-7c3c-46c6-9f00-dccde63da52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:38.668194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a55433-7c3c-46c6-9f00-dccde63da52f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:38.668923 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a55433-7c3c-46c6-9f00-dccde63da52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:38.670520 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a55433-7c3c-46c6-9f00-dccde63da52f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:38.680959 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1246/2504] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:38.685505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0f0e1-bb2a-47f3-be05-a0fd144574bd admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:38.695572 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0f0e1-bb2a-47f3-be05-a0fd144574bd admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:38.701369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615808e-8f6c-44c4-a4af-7baf08d1d368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:38.702229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615808e-8f6c-44c4-a4af-7baf08d1d368 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:38.706569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615808e-8f6c-44c4-a4af-7baf08d1d368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:38.706569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615808e-8f6c-44c4-a4af-7baf08d1d368 admin admin] PATH_INFO: `/v3/projects/f4c50c1e517c4f91971bf6d97eb8add5/users/a7db85ebac094271ac4b0a97e5f8946b/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:38.718028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615808e-8f6c-44c4-a4af-7baf08d1d368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c50c1e517c4f91971bf6d97eb8add5, user_id=a7db85ebac094271ac4b0a97e5f8946b, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:38.720751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615808e-8f6c-44c4-a4af-7baf08d1d368 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:38.819417 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1259/2505] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:38 2022] PUT /identity/v3/projects/f4c50c1e517c4f91971bf6d97eb8add5/users/a7db85ebac094271ac4b0a97e5f8946b/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:38.832166 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e98bf-d8d9-43ec-85aa-b65c0aa3f7f7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:38.832460 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e98bf-d8d9-43ec-85aa-b65c0aa3f7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:38.832792 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e98bf-d8d9-43ec-85aa-b65c0aa3f7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:38.865762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-349e98bf-d8d9-43ec-85aa-b65c0aa3f7f7 None None] MFA Rules not processed for user `a7db85ebac094271ac4b0a97e5f8946b`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:38.867393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-349e98bf-d8d9-43ec-85aa-b65c0aa3f7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:38.953177 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1247/2506] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:38.957206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615808e-8f6c-44c4-a4af-7baf08d1d368 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:39.022088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615808e-8f6c-44c4-a4af-7baf08d1d368 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:39.027021 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611acef6-0f09-484e-9e8c-9053988b5a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:39.027708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611acef6-0f09-484e-9e8c-9053988b5a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:39.027988 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611acef6-0f09-484e-9e8c-9053988b5a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:39.028756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611acef6-0f09-484e-9e8c-9053988b5a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:39.028940 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611acef6-0f09-484e-9e8c-9053988b5a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:39.030843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611acef6-0f09-484e-9e8c-9053988b5a83 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:39.114164 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1260/2507] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:38 2022] POST /identity/v3/projects => generated 369 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:39.119009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e98bf-d8d9-43ec-85aa-b65c0aa3f7f7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:39.129909 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e98bf-d8d9-43ec-85aa-b65c0aa3f7f7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:39.185194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735f20c-c52c-4486-9fa2-995a72f1fac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:39.186094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735f20c-c52c-4486-9fa2-995a72f1fac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:39.186209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735f20c-c52c-4486-9fa2-995a72f1fac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:39.186471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735f20c-c52c-4486-9fa2-995a72f1fac6 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:39.187205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735f20c-c52c-4486-9fa2-995a72f1fac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:39.189383 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735f20c-c52c-4486-9fa2-995a72f1fac6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:39.287711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1248/2508] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:39 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:39.288904 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611acef6-0f09-484e-9e8c-9053988b5a83 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:39.301110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611acef6-0f09-484e-9e8c-9053988b5a83 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:39.307190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c52a2-ed88-4e74-8af8-0e503a564450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:39.308320 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c52a2-ed88-4e74-8af8-0e503a564450 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:39.309957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c52a2-ed88-4e74-8af8-0e503a564450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:39.309957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c52a2-ed88-4e74-8af8-0e503a564450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:39.310511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c52a2-ed88-4e74-8af8-0e503a564450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:39.312230 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c52a2-ed88-4e74-8af8-0e503a564450 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:39.327234 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1261/2509] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:39.330562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735f20c-c52c-4486-9fa2-995a72f1fac6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:39.344819 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735f20c-c52c-4486-9fa2-995a72f1fac6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:39.352620 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8f7b0-9de9-4124-a689-d9e5221c7832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:39.352898 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8f7b0-9de9-4124-a689-d9e5221c7832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:39.353183 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8f7b0-9de9-4124-a689-d9e5221c7832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:39.353569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8f7b0-9de9-4124-a689-d9e5221c7832 admin admin] PATH_INFO: `/v3/projects/e7760a3e114e4bb48c73a84701834c4b/users/5e675d5947b74046b86b504896544fdc/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:39.373071 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8f7b0-9de9-4124-a689-d9e5221c7832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7760a3e114e4bb48c73a84701834c4b, user_id=5e675d5947b74046b86b504896544fdc, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:39.377314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8f7b0-9de9-4124-a689-d9e5221c7832 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:39.450702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1249/2510] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:39 2022] PUT /identity/v3/projects/e7760a3e114e4bb48c73a84701834c4b/users/5e675d5947b74046b86b504896544fdc/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:39.455094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c52a2-ed88-4e74-8af8-0e503a564450 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:39.465371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c52a2-ed88-4e74-8af8-0e503a564450 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:39.524177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514c05c-fcef-40f9-b52d-5c6dff19dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:39.524963 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514c05c-fcef-40f9-b52d-5c6dff19dbbc admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:39.525242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514c05c-fcef-40f9-b52d-5c6dff19dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:39.525511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514c05c-fcef-40f9-b52d-5c6dff19dbbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:39.526232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514c05c-fcef-40f9-b52d-5c6dff19dbbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:39.527894 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514c05c-fcef-40f9-b52d-5c6dff19dbbc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:39.537970 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1262/2511] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:39.542679 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8f7b0-9de9-4124-a689-d9e5221c7832 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:39.552766 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8f7b0-9de9-4124-a689-d9e5221c7832 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:39.558395 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f92278-9deb-466b-9782-00bdce745896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:39.559318 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f92278-9deb-466b-9782-00bdce745896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:39.559624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f92278-9deb-466b-9782-00bdce745896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:39.560075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f92278-9deb-466b-9782-00bdce745896 admin admin] PATH_INFO: `/v3/projects/e7760a3e114e4bb48c73a84701834c4b/users/5e675d5947b74046b86b504896544fdc/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:39.562300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f92278-9deb-466b-9782-00bdce745896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7760a3e114e4bb48c73a84701834c4b, user_id=5e675d5947b74046b86b504896544fdc, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:39.565618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f92278-9deb-466b-9782-00bdce745896 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:39.580391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1250/2512] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:39 2022] PUT /identity/v3/projects/e7760a3e114e4bb48c73a84701834c4b/users/5e675d5947b74046b86b504896544fdc/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:39.591732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efa411-c15e-47d8-87fe-85b686489659 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:39.592030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efa411-c15e-47d8-87fe-85b686489659 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:39.592352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efa411-c15e-47d8-87fe-85b686489659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:39.634031 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-34efa411-c15e-47d8-87fe-85b686489659 None None] MFA Rules not processed for user `5e675d5947b74046b86b504896544fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:39.634031 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-34efa411-c15e-47d8-87fe-85b686489659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:39.727579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1263/2513] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:39.735871 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f92278-9deb-466b-9782-00bdce745896 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:39.737593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-29f92278-9deb-466b-9782-00bdce745896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:39.805762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f92278-9deb-466b-9782-00bdce745896 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:39.809602 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2583a41-da48-4c34-90e9-1201e61cba4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:39.810248 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2583a41-da48-4c34-90e9-1201e61cba4f service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:39.810534 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2583a41-da48-4c34-90e9-1201e61cba4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:39.810811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2583a41-da48-4c34-90e9-1201e61cba4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:39.820576 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2583a41-da48-4c34-90e9-1201e61cba4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:39.822254 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2583a41-da48-4c34-90e9-1201e61cba4f service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:39.832753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1251/2514] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:39 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:39.947270 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efa411-c15e-47d8-87fe-85b686489659 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:39.948681 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-34efa411-c15e-47d8-87fe-85b686489659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:39.965865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efa411-c15e-47d8-87fe-85b686489659 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:39.970399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57c395-7f40-4c24-a8cd-2c19eb1e87e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:39.971088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57c395-7f40-4c24-a8cd-2c19eb1e87e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:39.971397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57c395-7f40-4c24-a8cd-2c19eb1e87e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:39.971671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57c395-7f40-4c24-a8cd-2c19eb1e87e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:40.033317 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57c395-7f40-4c24-a8cd-2c19eb1e87e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:40.034779 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57c395-7f40-4c24-a8cd-2c19eb1e87e7 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:40.043860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1264/2515] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:41.570210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2583a41-da48-4c34-90e9-1201e61cba4f service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:41.572206 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a2583a41-da48-4c34-90e9-1201e61cba4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:41.637450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2583a41-da48-4c34-90e9-1201e61cba4f service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:41.641994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719ed1a-3a11-4d13-958e-f1054115edf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:41.642845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719ed1a-3a11-4d13-958e-f1054115edf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:41.643136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719ed1a-3a11-4d13-958e-f1054115edf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:41.643413 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719ed1a-3a11-4d13-958e-f1054115edf5 admin admin] PATH_INFO: `/v3/users/4bbb6a0a08464e738ef0d062dfe87182` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:41.644575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719ed1a-3a11-4d13-958e-f1054115edf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bbb6a0a08464e738ef0d062dfe87182)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:41.646456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719ed1a-3a11-4d13-958e-f1054115edf5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:41.861304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2719ed1a-3a11-4d13-958e-f1054115edf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bbb6a0a08464e738ef0d062dfe87182'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:41.864296 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2719ed1a-3a11-4d13-958e-f1054115edf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bbb6a0a08464e738ef0d062dfe87182'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:41.865000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2719ed1a-3a11-4d13-958e-f1054115edf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bbb6a0a08464e738ef0d062dfe87182'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:41.945581 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2719ed1a-3a11-4d13-958e-f1054115edf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bbb6a0a08464e738ef0d062dfe87182'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:41.946743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2719ed1a-3a11-4d13-958e-f1054115edf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bbb6a0a08464e738ef0d062dfe87182'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:41.965074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1252/2516] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:41 2022] DELETE /identity/v3/users/4bbb6a0a08464e738ef0d062dfe87182 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:42.240110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57c395-7f40-4c24-a8cd-2c19eb1e87e7 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:42.253825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57c395-7f40-4c24-a8cd-2c19eb1e87e7 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:42.323425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc33859-d9ec-468d-9180-4874bd9609dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:42.324227 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc33859-d9ec-468d-9180-4874bd9609dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:42.324506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc33859-d9ec-468d-9180-4874bd9609dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:42.324809 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc33859-d9ec-468d-9180-4874bd9609dd admin admin] PATH_INFO: `/v3/projects/ea0809b61be446a69359b69b50b61710` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:42.326008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc33859-d9ec-468d-9180-4874bd9609dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea0809b61be446a69359b69b50b61710)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:42.328197 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc33859-d9ec-468d-9180-4874bd9609dd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:42.469974 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9fc33859-d9ec-468d-9180-4874bd9609dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea0809b61be446a69359b69b50b61710', 'request_id': 'req-9fc33859-d9ec-468d-9180-4874bd9609dd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:42.476503 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9fc33859-d9ec-468d-9180-4874bd9609dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea0809b61be446a69359b69b50b61710', 'request_id': 'req-9fc33859-d9ec-468d-9180-4874bd9609dd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:42.482004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9fc33859-d9ec-468d-9180-4874bd9609dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea0809b61be446a69359b69b50b61710', 'request_id': 'req-9fc33859-d9ec-468d-9180-4874bd9609dd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:42.576050 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9fc33859-d9ec-468d-9180-4874bd9609dd admin admin] The token cache is being invalidate because project ea0809b61be446a69359b69b50b61710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:42.576291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9fc33859-d9ec-468d-9180-4874bd9609dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:42.576894 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9fc33859-d9ec-468d-9180-4874bd9609dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:42.578443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1265/2517] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:42 2022] DELETE /identity/v3/projects/ea0809b61be446a69359b69b50b61710 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:42.583511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fccc0-6a76-4164-b0ef-0f33a2eec7e1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:42.584025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fccc0-6a76-4164-b0ef-0f33a2eec7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:42.584122 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fccc0-6a76-4164-b0ef-0f33a2eec7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:42.601420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2c2fccc0-6a76-4164-b0ef-0f33a2eec7e1 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:42.603187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2c2fccc0-6a76-4164-b0ef-0f33a2eec7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:42.662608 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1253/2518] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:42.671439 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5867f6-6bea-492c-9d8f-dc44be61cdb3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:42.671930 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5867f6-6bea-492c-9d8f-dc44be61cdb3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:42.672279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5867f6-6bea-492c-9d8f-dc44be61cdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:42.692166 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-fb5867f6-6bea-492c-9d8f-dc44be61cdb3 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:42.693353 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fb5867f6-6bea-492c-9d8f-dc44be61cdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:42.701931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1266/2519] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:42.706579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fccc0-6a76-4164-b0ef-0f33a2eec7e1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:42.716230 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fccc0-6a76-4164-b0ef-0f33a2eec7e1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:42.722540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611ed9d-7066-43ee-bd7f-a2e7e94fe26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:42.723267 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611ed9d-7066-43ee-bd7f-a2e7e94fe26a admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:42.723552 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611ed9d-7066-43ee-bd7f-a2e7e94fe26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:42.729291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611ed9d-7066-43ee-bd7f-a2e7e94fe26a admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:42.729291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611ed9d-7066-43ee-bd7f-a2e7e94fe26a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:16:42.729291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611ed9d-7066-43ee-bd7f-a2e7e94fe26a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:42.729291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611ed9d-7066-43ee-bd7f-a2e7e94fe26a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:42.737966 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1254/2520] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:16:42.742249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5867f6-6bea-492c-9d8f-dc44be61cdb3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:42.752518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5867f6-6bea-492c-9d8f-dc44be61cdb3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:42.757297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67de49-73a6-4107-887c-e95b67edff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:42.759541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67de49-73a6-4107-887c-e95b67edff0f admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:42.759825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67de49-73a6-4107-887c-e95b67edff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:42.760102 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67de49-73a6-4107-887c-e95b67edff0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:42.760792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67de49-73a6-4107-887c-e95b67edff0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:42.762765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67de49-73a6-4107-887c-e95b67edff0f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:42.868316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1267/2521] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:42 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:42.873175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611ed9d-7066-43ee-bd7f-a2e7e94fe26a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:42.883090 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611ed9d-7066-43ee-bd7f-a2e7e94fe26a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:42.949403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9974f1c-f117-47c0-ab31-0d14bc9ed978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:42.950093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9974f1c-f117-47c0-ab31-0d14bc9ed978 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:42.950376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9974f1c-f117-47c0-ab31-0d14bc9ed978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:42.950653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9974f1c-f117-47c0-ab31-0d14bc9ed978 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:42.951449 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9974f1c-f117-47c0-ab31-0d14bc9ed978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:42.953344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9974f1c-f117-47c0-ab31-0d14bc9ed978 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:43.077828 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1255/2522] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:42 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:43.079081 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67de49-73a6-4107-887c-e95b67edff0f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:43.089732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67de49-73a6-4107-887c-e95b67edff0f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:43.094141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528b0c5-4137-4e78-8e65-1c845a0ba5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:43.094793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528b0c5-4137-4e78-8e65-1c845a0ba5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:43.095077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528b0c5-4137-4e78-8e65-1c845a0ba5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:43.095388 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528b0c5-4137-4e78-8e65-1c845a0ba5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:43.096111 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528b0c5-4137-4e78-8e65-1c845a0ba5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:43.097705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528b0c5-4137-4e78-8e65-1c845a0ba5a9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:43.111492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1268/2523] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:43.112795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9974f1c-f117-47c0-ab31-0d14bc9ed978 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:43.123408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9974f1c-f117-47c0-ab31-0d14bc9ed978 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:43.128314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d33bd5-8ad4-478d-b60a-ae3099f8d1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:43.129060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d33bd5-8ad4-478d-b60a-ae3099f8d1bb admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:43.129378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d33bd5-8ad4-478d-b60a-ae3099f8d1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:43.129656 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d33bd5-8ad4-478d-b60a-ae3099f8d1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:43.130631 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d33bd5-8ad4-478d-b60a-ae3099f8d1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:43.132656 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d33bd5-8ad4-478d-b60a-ae3099f8d1bb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:43.143495 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1256/2524] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:43.147401 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528b0c5-4137-4e78-8e65-1c845a0ba5a9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:43.159410 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528b0c5-4137-4e78-8e65-1c845a0ba5a9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:43.167218 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2357d-81bc-4eef-bd15-5549888ff000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:43.168379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2357d-81bc-4eef-bd15-5549888ff000 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:43.168663 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2357d-81bc-4eef-bd15-5549888ff000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:43.168947 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2357d-81bc-4eef-bd15-5549888ff000 admin admin] PATH_INFO: `/v3/projects/7acac021c1774a54864a26b47d2633a9/users/ff8ea94d789941afad2c6553212ff791/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:43.184643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2357d-81bc-4eef-bd15-5549888ff000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7acac021c1774a54864a26b47d2633a9, user_id=ff8ea94d789941afad2c6553212ff791, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:43.187362 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2357d-81bc-4eef-bd15-5549888ff000 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:43.280415 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1269/2525] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:43 2022] PUT /identity/v3/projects/7acac021c1774a54864a26b47d2633a9/users/ff8ea94d789941afad2c6553212ff791/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:43.291451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b1a1a-13c3-43f4-aec3-4617fa709501 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:43.291742 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b1a1a-13c3-43f4-aec3-4617fa709501 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:43.292018 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b1a1a-13c3-43f4-aec3-4617fa709501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:43.323551 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f24b1a1a-13c3-43f4-aec3-4617fa709501 None None] MFA Rules not processed for user `ff8ea94d789941afad2c6553212ff791`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:43.324902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f24b1a1a-13c3-43f4-aec3-4617fa709501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:43.391689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1257/2526] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:43.396317 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2357d-81bc-4eef-bd15-5549888ff000 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:43.461017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2357d-81bc-4eef-bd15-5549888ff000 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:43.466767 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688e31a-ff54-41ce-8772-e6c00f1f4de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:43.467473 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688e31a-ff54-41ce-8772-e6c00f1f4de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:43.467753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688e31a-ff54-41ce-8772-e6c00f1f4de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:43.468027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688e31a-ff54-41ce-8772-e6c00f1f4de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:43.468716 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688e31a-ff54-41ce-8772-e6c00f1f4de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:43.470611 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688e31a-ff54-41ce-8772-e6c00f1f4de9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:43.559261 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1270/2527] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:43 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:43.563668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b1a1a-13c3-43f4-aec3-4617fa709501 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:43.574779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b1a1a-13c3-43f4-aec3-4617fa709501 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:43.642135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb00c1c-b87b-4798-a73b-f98ce181c5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:43.643012 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb00c1c-b87b-4798-a73b-f98ce181c5ff admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:43.643137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb00c1c-b87b-4798-a73b-f98ce181c5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:43.643388 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb00c1c-b87b-4798-a73b-f98ce181c5ff admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:43.644163 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb00c1c-b87b-4798-a73b-f98ce181c5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:43.646310 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb00c1c-b87b-4798-a73b-f98ce181c5ff admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:43.724152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1258/2528] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:43 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:43.728601 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688e31a-ff54-41ce-8772-e6c00f1f4de9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:43.738982 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688e31a-ff54-41ce-8772-e6c00f1f4de9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:43.743958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704823a0-db11-4948-8392-d720c5e7464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:43.744616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704823a0-db11-4948-8392-d720c5e7464e admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:43.744901 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704823a0-db11-4948-8392-d720c5e7464e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:43.745180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704823a0-db11-4948-8392-d720c5e7464e admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:43.746098 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704823a0-db11-4948-8392-d720c5e7464e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:43.747814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704823a0-db11-4948-8392-d720c5e7464e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:43.759583 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1271/2529] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:43.763922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb00c1c-b87b-4798-a73b-f98ce181c5ff admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:43.774577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb00c1c-b87b-4798-a73b-f98ce181c5ff admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:43.779334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7d91a-e858-45af-9b9d-9bf56e23a7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:43.780207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7d91a-e858-45af-9b9d-9bf56e23a7b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:43.780487 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7d91a-e858-45af-9b9d-9bf56e23a7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:43.780905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7d91a-e858-45af-9b9d-9bf56e23a7b7 admin admin] PATH_INFO: `/v3/projects/e129e01735564ef5b038349a8ff1edca/users/9f082855c3684c2eaf1e11990b223fd3/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:43.795492 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7d91a-e858-45af-9b9d-9bf56e23a7b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e129e01735564ef5b038349a8ff1edca, user_id=9f082855c3684c2eaf1e11990b223fd3, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:43.798173 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7d91a-e858-45af-9b9d-9bf56e23a7b7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:43.872789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1259/2530] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:43 2022] PUT /identity/v3/projects/e129e01735564ef5b038349a8ff1edca/users/9f082855c3684c2eaf1e11990b223fd3/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:43.876656 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704823a0-db11-4948-8392-d720c5e7464e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:43.887693 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704823a0-db11-4948-8392-d720c5e7464e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:43.983300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4063d-801b-4d7e-86f3-dbf93c941671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:43.983300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4063d-801b-4d7e-86f3-dbf93c941671 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:43.983300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4063d-801b-4d7e-86f3-dbf93c941671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:43.983300 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4063d-801b-4d7e-86f3-dbf93c941671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:43.983660 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4063d-801b-4d7e-86f3-dbf93c941671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:43.984000 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4063d-801b-4d7e-86f3-dbf93c941671 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:43.994652 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1272/2531] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:43.998714 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7d91a-e858-45af-9b9d-9bf56e23a7b7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:44.009712 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7d91a-e858-45af-9b9d-9bf56e23a7b7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:44.014340 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00eb21-47e8-4b34-af80-810bd5a05b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:44.015250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00eb21-47e8-4b34-af80-810bd5a05b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:44.015531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00eb21-47e8-4b34-af80-810bd5a05b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:44.015806 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00eb21-47e8-4b34-af80-810bd5a05b50 admin admin] PATH_INFO: `/v3/projects/e129e01735564ef5b038349a8ff1edca/users/9f082855c3684c2eaf1e11990b223fd3/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:44.019170 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00eb21-47e8-4b34-af80-810bd5a05b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e129e01735564ef5b038349a8ff1edca, user_id=9f082855c3684c2eaf1e11990b223fd3, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:44.020421 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00eb21-47e8-4b34-af80-810bd5a05b50 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:44.031256 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1260/2532] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:43 2022] PUT /identity/v3/projects/e129e01735564ef5b038349a8ff1edca/users/9f082855c3684c2eaf1e11990b223fd3/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:44.042446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327310b-e489-4320-ae0e-b0c0f82399c8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:44.042737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327310b-e489-4320-ae0e-b0c0f82399c8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:44.047882 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327310b-e489-4320-ae0e-b0c0f82399c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:44.071357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1327310b-e489-4320-ae0e-b0c0f82399c8 None None] MFA Rules not processed for user `9f082855c3684c2eaf1e11990b223fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:44.072824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1327310b-e489-4320-ae0e-b0c0f82399c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:44.143598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1273/2533] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:44.155438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00eb21-47e8-4b34-af80-810bd5a05b50 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:44.157153 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5b00eb21-47e8-4b34-af80-810bd5a05b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:44.216046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00eb21-47e8-4b34-af80-810bd5a05b50 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:44.220170 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216c2aa-e77d-46f1-a56d-1846b1e2be6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:44.220832 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216c2aa-e77d-46f1-a56d-1846b1e2be6a service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:44.221116 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216c2aa-e77d-46f1-a56d-1846b1e2be6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:44.221422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216c2aa-e77d-46f1-a56d-1846b1e2be6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:44.231122 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216c2aa-e77d-46f1-a56d-1846b1e2be6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:44.232610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216c2aa-e77d-46f1-a56d-1846b1e2be6a service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:44.242102 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1261/2534] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:45.063538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327310b-e489-4320-ae0e-b0c0f82399c8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:45.065180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1327310b-e489-4320-ae0e-b0c0f82399c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:45.126413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327310b-e489-4320-ae0e-b0c0f82399c8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:45.130975 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642fea2-cff3-4d8a-a2ac-314586c139ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:45.131871 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642fea2-cff3-4d8a-a2ac-314586c139ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:45.132147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642fea2-cff3-4d8a-a2ac-314586c139ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:45.132418 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642fea2-cff3-4d8a-a2ac-314586c139ba admin admin] PATH_INFO: `/v3/users/a7db85ebac094271ac4b0a97e5f8946b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:45.133640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642fea2-cff3-4d8a-a2ac-314586c139ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7db85ebac094271ac4b0a97e5f8946b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:45.135542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642fea2-cff3-4d8a-a2ac-314586c139ba admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:45.145250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216c2aa-e77d-46f1-a56d-1846b1e2be6a service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:45.159843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216c2aa-e77d-46f1-a56d-1846b1e2be6a service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:45.164588 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79467773-1ef0-49c8-8d9a-332c20aff952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:45.165655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79467773-1ef0-49c8-8d9a-332c20aff952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:45.166021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79467773-1ef0-49c8-8d9a-332c20aff952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:45.166375 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79467773-1ef0-49c8-8d9a-332c20aff952 admin admin] PATH_INFO: `/v3/users/ff8ea94d789941afad2c6553212ff791` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:45.167601 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79467773-1ef0-49c8-8d9a-332c20aff952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff8ea94d789941afad2c6553212ff791)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:45.169496 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79467773-1ef0-49c8-8d9a-332c20aff952 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:45.309179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a642fea2-cff3-4d8a-a2ac-314586c139ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7db85ebac094271ac4b0a97e5f8946b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:45.322872 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a642fea2-cff3-4d8a-a2ac-314586c139ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7db85ebac094271ac4b0a97e5f8946b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:45.365363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-79467773-1ef0-49c8-8d9a-332c20aff952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff8ea94d789941afad2c6553212ff791'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:45.377297 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-79467773-1ef0-49c8-8d9a-332c20aff952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff8ea94d789941afad2c6553212ff791'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:45.377957 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-79467773-1ef0-49c8-8d9a-332c20aff952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff8ea94d789941afad2c6553212ff791'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:45.402470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a642fea2-cff3-4d8a-a2ac-314586c139ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7db85ebac094271ac4b0a97e5f8946b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:45.403093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a642fea2-cff3-4d8a-a2ac-314586c139ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7db85ebac094271ac4b0a97e5f8946b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:45.403725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a642fea2-cff3-4d8a-a2ac-314586c139ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7db85ebac094271ac4b0a97e5f8946b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:45.417324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1274/2535] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:45 2022] DELETE /identity/v3/users/a7db85ebac094271ac4b0a97e5f8946b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:45.421775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652d0fb-9ab5-44a3-831d-c05df0a28061 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:45.422062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652d0fb-9ab5-44a3-831d-c05df0a28061 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:45.422333 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652d0fb-9ab5-44a3-831d-c05df0a28061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:45.439824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3652d0fb-9ab5-44a3-831d-c05df0a28061 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:45.440992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3652d0fb-9ab5-44a3-831d-c05df0a28061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:45.459214 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-79467773-1ef0-49c8-8d9a-332c20aff952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff8ea94d789941afad2c6553212ff791'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:45.459926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-79467773-1ef0-49c8-8d9a-332c20aff952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff8ea94d789941afad2c6553212ff791'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:45.472872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1262/2536] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:45 2022] DELETE /identity/v3/users/ff8ea94d789941afad2c6553212ff791 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:45.477850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9add0-a9de-4cf4-b73e-8fb44bb9c833 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:45.478132 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9add0-a9de-4cf4-b73e-8fb44bb9c833 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:45.478433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9add0-a9de-4cf4-b73e-8fb44bb9c833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:45.495967 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b7e9add0-a9de-4cf4-b73e-8fb44bb9c833 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:45.497195 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b7e9add0-a9de-4cf4-b73e-8fb44bb9c833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:45.497977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1275/2537] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:45.507632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652d0fb-9ab5-44a3-831d-c05df0a28061 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:45.509039 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3652d0fb-9ab5-44a3-831d-c05df0a28061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:45.557050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1263/2538] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:45.564969 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652d0fb-9ab5-44a3-831d-c05df0a28061 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:45.566857 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9add0-a9de-4cf4-b73e-8fb44bb9c833 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:45.622974 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c86761-8111-40bf-b3a8-93ae73e4f663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:45.623767 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c86761-8111-40bf-b3a8-93ae73e4f663 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:45.624118 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c86761-8111-40bf-b3a8-93ae73e4f663 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:45.624468 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c86761-8111-40bf-b3a8-93ae73e4f663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:45.627940 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9add0-a9de-4cf4-b73e-8fb44bb9c833 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:45.631660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c101e-e3a5-4c8e-9f6a-10422972af89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:45.632332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c101e-e3a5-4c8e-9f6a-10422972af89 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:45.632613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c101e-e3a5-4c8e-9f6a-10422972af89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:45.632917 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c101e-e3a5-4c8e-9f6a-10422972af89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:45.634001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c86761-8111-40bf-b3a8-93ae73e4f663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:45.635540 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c86761-8111-40bf-b3a8-93ae73e4f663 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:45.641926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c101e-e3a5-4c8e-9f6a-10422972af89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:45.643382 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c101e-e3a5-4c8e-9f6a-10422972af89 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:45.645153 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1276/2539] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:16:45.653687 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1264/2540] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:16:46.172985 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c86761-8111-40bf-b3a8-93ae73e4f663 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:46.174375 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-06c86761-8111-40bf-b3a8-93ae73e4f663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:46.188671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c86761-8111-40bf-b3a8-93ae73e4f663 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:46.193473 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496fc98-4775-42c2-b23f-a1a65638689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:46.194327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496fc98-4775-42c2-b23f-a1a65638689c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:46.194610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496fc98-4775-42c2-b23f-a1a65638689c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:46.194890 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496fc98-4775-42c2-b23f-a1a65638689c admin admin] PATH_INFO: `/v3/projects/f4c50c1e517c4f91971bf6d97eb8add5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:46.196904 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496fc98-4775-42c2-b23f-a1a65638689c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4c50c1e517c4f91971bf6d97eb8add5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:46.198916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496fc98-4775-42c2-b23f-a1a65638689c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:46.206348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c101e-e3a5-4c8e-9f6a-10422972af89 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:46.208744 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9e8c101e-e3a5-4c8e-9f6a-10422972af89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:46.222653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c101e-e3a5-4c8e-9f6a-10422972af89 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:46.227724 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ed0c7-f034-4d38-9fa8-1f4936a71a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:46.228593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ed0c7-f034-4d38-9fa8-1f4936a71a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:46.228931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ed0c7-f034-4d38-9fa8-1f4936a71a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:46.229250 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ed0c7-f034-4d38-9fa8-1f4936a71a25 admin admin] PATH_INFO: `/v3/projects/7acac021c1774a54864a26b47d2633a9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:46.230443 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ed0c7-f034-4d38-9fa8-1f4936a71a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7acac021c1774a54864a26b47d2633a9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:46.232608 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ed0c7-f034-4d38-9fa8-1f4936a71a25 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:46.305928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7496fc98-4775-42c2-b23f-a1a65638689c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4c50c1e517c4f91971bf6d97eb8add5', 'request_id': 'req-7496fc98-4775-42c2-b23f-a1a65638689c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.313874 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7496fc98-4775-42c2-b23f-a1a65638689c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4c50c1e517c4f91971bf6d97eb8add5', 'request_id': 'req-7496fc98-4775-42c2-b23f-a1a65638689c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.319232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7496fc98-4775-42c2-b23f-a1a65638689c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4c50c1e517c4f91971bf6d97eb8add5', 'request_id': 'req-7496fc98-4775-42c2-b23f-a1a65638689c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.357897 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-939ed0c7-f034-4d38-9fa8-1f4936a71a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7acac021c1774a54864a26b47d2633a9', 'request_id': 'req-939ed0c7-f034-4d38-9fa8-1f4936a71a25'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.418950 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7496fc98-4775-42c2-b23f-a1a65638689c admin admin] The token cache is being invalidate because project f4c50c1e517c4f91971bf6d97eb8add5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:46.419198 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7496fc98-4775-42c2-b23f-a1a65638689c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.419816 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7496fc98-4775-42c2-b23f-a1a65638689c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.421373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1277/2541] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:46 2022] DELETE /identity/v3/projects/f4c50c1e517c4f91971bf6d97eb8add5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:46.425132 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496fc98-4775-42c2-b23f-a1a65638689c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:46.426413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7496fc98-4775-42c2-b23f-a1a65638689c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:46.465100 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-939ed0c7-f034-4d38-9fa8-1f4936a71a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7acac021c1774a54864a26b47d2633a9', 'request_id': 'req-939ed0c7-f034-4d38-9fa8-1f4936a71a25'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.470834 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-939ed0c7-f034-4d38-9fa8-1f4936a71a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7acac021c1774a54864a26b47d2633a9', 'request_id': 'req-939ed0c7-f034-4d38-9fa8-1f4936a71a25'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.483312 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-939ed0c7-f034-4d38-9fa8-1f4936a71a25 admin admin] The token cache is being invalidate because project 7acac021c1774a54864a26b47d2633a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:46.483630 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-939ed0c7-f034-4d38-9fa8-1f4936a71a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.484244 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-939ed0c7-f034-4d38-9fa8-1f4936a71a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.486198 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1265/2542] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:46 2022] DELETE /identity/v3/projects/7acac021c1774a54864a26b47d2633a9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:46.490010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ed0c7-f034-4d38-9fa8-1f4936a71a25 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:46.491560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-939ed0c7-f034-4d38-9fa8-1f4936a71a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:46.491899 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496fc98-4775-42c2-b23f-a1a65638689c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:46.552357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa33330-7296-4274-911f-4734f90ce2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:46.553360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa33330-7296-4274-911f-4734f90ce2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:46.553642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa33330-7296-4274-911f-4734f90ce2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:46.553914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa33330-7296-4274-911f-4734f90ce2bb admin admin] PATH_INFO: `/v3/users/5e675d5947b74046b86b504896544fdc` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:46.555843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa33330-7296-4274-911f-4734f90ce2bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e675d5947b74046b86b504896544fdc)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:46.557768 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa33330-7296-4274-911f-4734f90ce2bb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:46.558969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ed0c7-f034-4d38-9fa8-1f4936a71a25 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:46.563929 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1389b-b036-4d9e-818f-21eced796b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:46.564797 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1389b-b036-4d9e-818f-21eced796b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:46.565082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1389b-b036-4d9e-818f-21eced796b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:46.565359 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1389b-b036-4d9e-818f-21eced796b58 admin admin] PATH_INFO: `/v3/users/9f082855c3684c2eaf1e11990b223fd3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:46.566560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1389b-b036-4d9e-818f-21eced796b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f082855c3684c2eaf1e11990b223fd3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:46.568490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1389b-b036-4d9e-818f-21eced796b58 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:46.723882 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-1aa33330-7296-4274-911f-4734f90ce2bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e675d5947b74046b86b504896544fdc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.736061 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-1aa33330-7296-4274-911f-4734f90ce2bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e675d5947b74046b86b504896544fdc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.776000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9ba1389b-b036-4d9e-818f-21eced796b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f082855c3684c2eaf1e11990b223fd3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.787470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9ba1389b-b036-4d9e-818f-21eced796b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f082855c3684c2eaf1e11990b223fd3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.788124 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9ba1389b-b036-4d9e-818f-21eced796b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f082855c3684c2eaf1e11990b223fd3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.820916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-1aa33330-7296-4274-911f-4734f90ce2bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e675d5947b74046b86b504896544fdc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.821633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-1aa33330-7296-4274-911f-4734f90ce2bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e675d5947b74046b86b504896544fdc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.822285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-1aa33330-7296-4274-911f-4734f90ce2bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e675d5947b74046b86b504896544fdc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.835904 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1278/2543] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:46 2022] DELETE /identity/v3/users/5e675d5947b74046b86b504896544fdc => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:46.884580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9ba1389b-b036-4d9e-818f-21eced796b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f082855c3684c2eaf1e11990b223fd3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.885221 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9ba1389b-b036-4d9e-818f-21eced796b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f082855c3684c2eaf1e11990b223fd3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:46.899674 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1266/2544] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:46 2022] DELETE /identity/v3/users/9f082855c3684c2eaf1e11990b223fd3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:47.344755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa33330-7296-4274-911f-4734f90ce2bb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:47.346177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1aa33330-7296-4274-911f-4734f90ce2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:47.396941 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1389b-b036-4d9e-818f-21eced796b58 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:47.399702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9ba1389b-b036-4d9e-818f-21eced796b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:47.440899 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa33330-7296-4274-911f-4734f90ce2bb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:47.478864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1389b-b036-4d9e-818f-21eced796b58 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:47.483561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807be52-e4ab-4e8d-8c07-29eb1dc18f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:47.484445 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807be52-e4ab-4e8d-8c07-29eb1dc18f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:47.484730 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807be52-e4ab-4e8d-8c07-29eb1dc18f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:47.485078 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807be52-e4ab-4e8d-8c07-29eb1dc18f9a admin admin] PATH_INFO: `/v3/projects/e129e01735564ef5b038349a8ff1edca` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:47.486266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807be52-e4ab-4e8d-8c07-29eb1dc18f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e129e01735564ef5b038349a8ff1edca)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:47.488452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807be52-e4ab-4e8d-8c07-29eb1dc18f9a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:47.497403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd4dda-2a0f-4ab8-ae75-95acf29dc023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:47.498287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd4dda-2a0f-4ab8-ae75-95acf29dc023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:47.498565 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd4dda-2a0f-4ab8-ae75-95acf29dc023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:47.498840 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd4dda-2a0f-4ab8-ae75-95acf29dc023 admin admin] PATH_INFO: `/v3/projects/e7760a3e114e4bb48c73a84701834c4b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:47.500052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd4dda-2a0f-4ab8-ae75-95acf29dc023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7760a3e114e4bb48c73a84701834c4b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:47.501959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd4dda-2a0f-4ab8-ae75-95acf29dc023 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:47.581104 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6807be52-e4ab-4e8d-8c07-29eb1dc18f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e129e01735564ef5b038349a8ff1edca', 'request_id': 'req-6807be52-e4ab-4e8d-8c07-29eb1dc18f9a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:47.604633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eebd4dda-2a0f-4ab8-ae75-95acf29dc023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7760a3e114e4bb48c73a84701834c4b', 'request_id': 'req-eebd4dda-2a0f-4ab8-ae75-95acf29dc023'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:47.610839 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eebd4dda-2a0f-4ab8-ae75-95acf29dc023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7760a3e114e4bb48c73a84701834c4b', 'request_id': 'req-eebd4dda-2a0f-4ab8-ae75-95acf29dc023'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:47.616459 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eebd4dda-2a0f-4ab8-ae75-95acf29dc023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7760a3e114e4bb48c73a84701834c4b', 'request_id': 'req-eebd4dda-2a0f-4ab8-ae75-95acf29dc023'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:47.638127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6807be52-e4ab-4e8d-8c07-29eb1dc18f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e129e01735564ef5b038349a8ff1edca', 'request_id': 'req-6807be52-e4ab-4e8d-8c07-29eb1dc18f9a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:47.644238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6807be52-e4ab-4e8d-8c07-29eb1dc18f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e129e01735564ef5b038349a8ff1edca', 'request_id': 'req-6807be52-e4ab-4e8d-8c07-29eb1dc18f9a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:47.658995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6807be52-e4ab-4e8d-8c07-29eb1dc18f9a admin admin] The token cache is being invalidate because project e129e01735564ef5b038349a8ff1edca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:47.659316 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6807be52-e4ab-4e8d-8c07-29eb1dc18f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:47.660015 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6807be52-e4ab-4e8d-8c07-29eb1dc18f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:47.661593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1267/2545] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:47 2022] DELETE /identity/v3/projects/e129e01735564ef5b038349a8ff1edca => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:47.667693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a8f5-29b4-4c64-a3af-ae1233c349fa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:47.668018 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a8f5-29b4-4c64-a3af-ae1233c349fa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:47.668304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a8f5-29b4-4c64-a3af-ae1233c349fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:47.688328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0185a8f5-29b4-4c64-a3af-ae1233c349fa None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:47.689778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0185a8f5-29b4-4c64-a3af-ae1233c349fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:47.716524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eebd4dda-2a0f-4ab8-ae75-95acf29dc023 admin admin] The token cache is being invalidate because project e7760a3e114e4bb48c73a84701834c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:47.716805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eebd4dda-2a0f-4ab8-ae75-95acf29dc023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:47.717407 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-eebd4dda-2a0f-4ab8-ae75-95acf29dc023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:47.718953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1279/2546] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:47 2022] DELETE /identity/v3/projects/e7760a3e114e4bb48c73a84701834c4b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:47.723651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f18304-7427-443e-a5c0-02e225ada439 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:47.723940 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f18304-7427-443e-a5c0-02e225ada439 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:47.724755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f18304-7427-443e-a5c0-02e225ada439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:47.742042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-23f18304-7427-443e-a5c0-02e225ada439 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:47.743451 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-23f18304-7427-443e-a5c0-02e225ada439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:47.753684 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1268/2547] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:47.762153 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a510c-4497-4ab1-8152-3b3dcb479235 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:47.762510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a510c-4497-4ab1-8152-3b3dcb479235 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:47.762953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a510c-4497-4ab1-8152-3b3dcb479235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:47.780768 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9b8a510c-4497-4ab1-8152-3b3dcb479235 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:47.781936 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9b8a510c-4497-4ab1-8152-3b3dcb479235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:47.789578 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1269/2548] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:47.793725 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a510c-4497-4ab1-8152-3b3dcb479235 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:47.801842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1280/2549] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:47.802332 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a510c-4497-4ab1-8152-3b3dcb479235 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:47.807501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aceb1-b9f1-4f51-b7ac-a87e27ae9c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:47.808147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aceb1-b9f1-4f51-b7ac-a87e27ae9c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:47.808425 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aceb1-b9f1-4f51-b7ac-a87e27ae9c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:47.808697 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aceb1-b9f1-4f51-b7ac-a87e27ae9c66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:47.809415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55aceb1-b9f1-4f51-b7ac-a87e27ae9c66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:16:47.809916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55aceb1-b9f1-4f51-b7ac-a87e27ae9c66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:47.811288 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5873b9-49ac-4723-b9c8-bdc7f9d6d356 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:47.811543 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55aceb1-b9f1-4f51-b7ac-a87e27ae9c66 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:47.811679 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5873b9-49ac-4723-b9c8-bdc7f9d6d356 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:47.811848 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5873b9-49ac-4723-b9c8-bdc7f9d6d356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:47.824127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1270/2550] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:16:47.828304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aceb1-b9f1-4f51-b7ac-a87e27ae9c66 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:47.830496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6e5873b9-49ac-4723-b9c8-bdc7f9d6d356 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:47.831716 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6e5873b9-49ac-4723-b9c8-bdc7f9d6d356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:47.837915 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aceb1-b9f1-4f51-b7ac-a87e27ae9c66 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:47.840196 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1281/2551] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:47.842771 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2350de-d6a1-4a1c-8a6c-45fe845a61a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:47.843521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2350de-d6a1-4a1c-8a6c-45fe845a61a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:47.843802 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2350de-d6a1-4a1c-8a6c-45fe845a61a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:47.844078 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2350de-d6a1-4a1c-8a6c-45fe845a61a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:47.844455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5873b9-49ac-4723-b9c8-bdc7f9d6d356 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:47.844760 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2350de-d6a1-4a1c-8a6c-45fe845a61a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:47.846631 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2350de-d6a1-4a1c-8a6c-45fe845a61a4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:47.853837 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5873b9-49ac-4723-b9c8-bdc7f9d6d356 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:47.858679 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4421f2-68e8-4225-9a24-f44d646de7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:47.859298 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4421f2-68e8-4225-9a24-f44d646de7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:47.859580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4421f2-68e8-4225-9a24-f44d646de7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:47.859860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4421f2-68e8-4225-9a24-f44d646de7d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:47.860577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4421f2-68e8-4225-9a24-f44d646de7d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:16:47.860880 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4421f2-68e8-4225-9a24-f44d646de7d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:47.862465 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4421f2-68e8-4225-9a24-f44d646de7d2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:47.874630 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1282/2552] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:16:47.879069 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4421f2-68e8-4225-9a24-f44d646de7d2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:47.889244 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4421f2-68e8-4225-9a24-f44d646de7d2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:47.893737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85804df9-a223-42b6-84a9-43aa5e589645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:47.894667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85804df9-a223-42b6-84a9-43aa5e589645 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:47.894667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85804df9-a223-42b6-84a9-43aa5e589645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:47.894889 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85804df9-a223-42b6-84a9-43aa5e589645 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:47.895603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85804df9-a223-42b6-84a9-43aa5e589645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:47.897475 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85804df9-a223-42b6-84a9-43aa5e589645 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:47.959003 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1271/2553] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:47 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:47.963377 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2350de-d6a1-4a1c-8a6c-45fe845a61a4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.025950 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2350de-d6a1-4a1c-8a6c-45fe845a61a4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.030618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d05006-b84c-4032-a57d-3f69435fdc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.031347 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d05006-b84c-4032-a57d-3f69435fdc35 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.031635 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d05006-b84c-4032-a57d-3f69435fdc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.031911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d05006-b84c-4032-a57d-3f69435fdc35 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.032594 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d05006-b84c-4032-a57d-3f69435fdc35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.034502 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d05006-b84c-4032-a57d-3f69435fdc35 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:48.039964 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1283/2554] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:47 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:48.044079 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85804df9-a223-42b6-84a9-43aa5e589645 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.102689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85804df9-a223-42b6-84a9-43aa5e589645 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.107316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806a2f8-294c-4343-bdf9-7d500d6c880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.107962 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806a2f8-294c-4343-bdf9-7d500d6c880c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.108237 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806a2f8-294c-4343-bdf9-7d500d6c880c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.108508 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806a2f8-294c-4343-bdf9-7d500d6c880c admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.109220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806a2f8-294c-4343-bdf9-7d500d6c880c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.111055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806a2f8-294c-4343-bdf9-7d500d6c880c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:48.147795 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1272/2555] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:47 2022] POST /identity/v3/users => generated 284 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:48.151698 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d05006-b84c-4032-a57d-3f69435fdc35 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.161286 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d05006-b84c-4032-a57d-3f69435fdc35 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.166470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a1573-e91a-42aa-9c4c-d6388828ada6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.167101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a1573-e91a-42aa-9c4c-d6388828ada6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.167411 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a1573-e91a-42aa-9c4c-d6388828ada6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.167693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a1573-e91a-42aa-9c4c-d6388828ada6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.168396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a1573-e91a-42aa-9c4c-d6388828ada6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.169964 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a1573-e91a-42aa-9c4c-d6388828ada6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:48.180842 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1273/2556] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:48.183954 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a1573-e91a-42aa-9c4c-d6388828ada6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.193582 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a1573-e91a-42aa-9c4c-d6388828ada6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.199345 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d75d9-9d7f-4ae6-a62a-d50dbdac99a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.199949 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d75d9-9d7f-4ae6-a62a-d50dbdac99a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.200389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d75d9-9d7f-4ae6-a62a-d50dbdac99a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.200561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d75d9-9d7f-4ae6-a62a-d50dbdac99a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.201300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d75d9-9d7f-4ae6-a62a-d50dbdac99a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.203094 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d75d9-9d7f-4ae6-a62a-d50dbdac99a4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:48.214088 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1274/2557] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:48.221608 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d75d9-9d7f-4ae6-a62a-d50dbdac99a4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.235800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d75d9-9d7f-4ae6-a62a-d50dbdac99a4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.241471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a974aec-5cd6-4939-8f95-094cfda4c29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.243892 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a974aec-5cd6-4939-8f95-094cfda4c29d admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.243892 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a974aec-5cd6-4939-8f95-094cfda4c29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.243892 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a974aec-5cd6-4939-8f95-094cfda4c29d admin admin] PATH_INFO: `/v3/projects/cb530d5aa74840f3a8400cafb3975e71/users/56048a636f3345a1824b6fb0d8403efc/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.253635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1284/2558] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:48 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:48.257607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806a2f8-294c-4343-bdf9-7d500d6c880c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.260561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a974aec-5cd6-4939-8f95-094cfda4c29d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb530d5aa74840f3a8400cafb3975e71, user_id=56048a636f3345a1824b6fb0d8403efc, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.263511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a974aec-5cd6-4939-8f95-094cfda4c29d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:48.281177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806a2f8-294c-4343-bdf9-7d500d6c880c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.281177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc319515-c070-4f4c-955a-f45f1f623747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.281177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc319515-c070-4f4c-955a-f45f1f623747 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.281177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc319515-c070-4f4c-955a-f45f1f623747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.281617 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc319515-c070-4f4c-955a-f45f1f623747 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.281617 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc319515-c070-4f4c-955a-f45f1f623747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.281617 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc319515-c070-4f4c-955a-f45f1f623747 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:48.285347 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1285/2559] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:48.289719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc319515-c070-4f4c-955a-f45f1f623747 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.299025 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc319515-c070-4f4c-955a-f45f1f623747 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.304513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28a182-8b05-41ae-b031-a1c47f71bf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.305971 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28a182-8b05-41ae-b031-a1c47f71bf17 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.306221 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28a182-8b05-41ae-b031-a1c47f71bf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.306520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28a182-8b05-41ae-b031-a1c47f71bf17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.307342 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28a182-8b05-41ae-b031-a1c47f71bf17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.309766 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28a182-8b05-41ae-b031-a1c47f71bf17 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:48.322075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1286/2560] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:48.326189 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28a182-8b05-41ae-b031-a1c47f71bf17 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.335842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28a182-8b05-41ae-b031-a1c47f71bf17 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.340489 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd114cd-aa45-4378-822d-fe86400f0e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.341379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd114cd-aa45-4378-822d-fe86400f0e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.341669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd114cd-aa45-4378-822d-fe86400f0e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.341946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd114cd-aa45-4378-822d-fe86400f0e8f admin admin] PATH_INFO: `/v3/projects/e462c3a499214e96a5f9737425a676fd/users/3d80368d1b0e4f4982052d6c4b2b0559/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.356689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd114cd-aa45-4378-822d-fe86400f0e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e462c3a499214e96a5f9737425a676fd, user_id=3d80368d1b0e4f4982052d6c4b2b0559, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.359424 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd114cd-aa45-4378-822d-fe86400f0e8f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:48.386109 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1275/2561] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:48 2022] PUT /identity/v3/projects/cb530d5aa74840f3a8400cafb3975e71/users/56048a636f3345a1824b6fb0d8403efc/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:48.396382 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a5361-be25-4653-b4bc-4fd9f0a39237 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.396671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a5361-be25-4653-b4bc-4fd9f0a39237 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.396951 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a5361-be25-4653-b4bc-4fd9f0a39237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.422810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8a3a5361-be25-4653-b4bc-4fd9f0a39237 None None] MFA Rules not processed for user `56048a636f3345a1824b6fb0d8403efc`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:48.424046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8a3a5361-be25-4653-b4bc-4fd9f0a39237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:48.472846 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1287/2562] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:48 2022] PUT /identity/v3/projects/e462c3a499214e96a5f9737425a676fd/users/3d80368d1b0e4f4982052d6c4b2b0559/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:48.483633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b5816-965d-4ade-a162-2b4b2559484a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.483924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b5816-965d-4ade-a162-2b4b2559484a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.484202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b5816-965d-4ade-a162-2b4b2559484a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.490746 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1276/2563] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:48.495971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a5361-be25-4653-b4bc-4fd9f0a39237 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.511392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-763b5816-965d-4ade-a162-2b4b2559484a None None] MFA Rules not processed for user `3d80368d1b0e4f4982052d6c4b2b0559`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:48.512582 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-763b5816-965d-4ade-a162-2b4b2559484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:48.559692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a5361-be25-4653-b4bc-4fd9f0a39237 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.585095 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1288/2564] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:48.590067 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b5816-965d-4ade-a162-2b4b2559484a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.615927 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9582e-e9e4-4555-b4d7-4a1b03492e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.616515 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9582e-e9e4-4555-b4d7-4a1b03492e8d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.616800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9582e-e9e4-4555-b4d7-4a1b03492e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.617079 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9582e-e9e4-4555-b4d7-4a1b03492e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.617935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9582e-e9e4-4555-b4d7-4a1b03492e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.619914 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9582e-e9e4-4555-b4d7-4a1b03492e8d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:48.651437 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b5816-965d-4ade-a162-2b4b2559484a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.655945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a09850-9157-496d-bb0f-2806d89c3ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.656593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a09850-9157-496d-bb0f-2806d89c3ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.656871 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a09850-9157-496d-bb0f-2806d89c3ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.657143 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a09850-9157-496d-bb0f-2806d89c3ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.657823 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a09850-9157-496d-bb0f-2806d89c3ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.659775 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a09850-9157-496d-bb0f-2806d89c3ebb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:48.702224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1277/2565] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:48 2022] POST /identity/v3/projects => generated 367 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:48.706216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9582e-e9e4-4555-b4d7-4a1b03492e8d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.748109 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1289/2566] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:48 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:48.752177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a09850-9157-496d-bb0f-2806d89c3ebb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.766725 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9582e-e9e4-4555-b4d7-4a1b03492e8d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.821833 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a09850-9157-496d-bb0f-2806d89c3ebb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.826461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514dda39-f243-4f84-9230-40abf49d1149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.826614 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e27cb-2ad1-45f4-b511-d876eaac74b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.827149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dda39-f243-4f84-9230-40abf49d1149 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.827296 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e27cb-2ad1-45f4-b511-d876eaac74b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.827433 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dda39-f243-4f84-9230-40abf49d1149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.827561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e27cb-2ad1-45f4-b511-d876eaac74b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.827704 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dda39-f243-4f84-9230-40abf49d1149 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.827840 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e27cb-2ad1-45f4-b511-d876eaac74b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.828379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dda39-f243-4f84-9230-40abf49d1149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.828525 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e27cb-2ad1-45f4-b511-d876eaac74b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.830278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dda39-f243-4f84-9230-40abf49d1149 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:48.830411 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e27cb-2ad1-45f4-b511-d876eaac74b9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:48.913343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1290/2567] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:48 2022] POST /identity/v3/users => generated 300 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:48.917958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514dda39-f243-4f84-9230-40abf49d1149 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.924238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1278/2568] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:48 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:48.927611 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514dda39-f243-4f84-9230-40abf49d1149 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.927967 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e27cb-2ad1-45f4-b511-d876eaac74b9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.932291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b39767-2e9a-4c66-aca9-4229b2a46b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.932943 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b39767-2e9a-4c66-aca9-4229b2a46b35 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.933225 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b39767-2e9a-4c66-aca9-4229b2a46b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.933498 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b39767-2e9a-4c66-aca9-4229b2a46b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.934222 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b39767-2e9a-4c66-aca9-4229b2a46b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.935877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b39767-2e9a-4c66-aca9-4229b2a46b35 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:48.939216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e27cb-2ad1-45f4-b511-d876eaac74b9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.944533 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af834b-da01-49cb-9813-81588b58c4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.945191 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af834b-da01-49cb-9813-81588b58c4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.946168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af834b-da01-49cb-9813-81588b58c4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.946448 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af834b-da01-49cb-9813-81588b58c4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.946856 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1291/2569] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:48.947325 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af834b-da01-49cb-9813-81588b58c4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.948943 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af834b-da01-49cb-9813-81588b58c4c7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:48.956868 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b39767-2e9a-4c66-aca9-4229b2a46b35 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.960010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1279/2570] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:48.964671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af834b-da01-49cb-9813-81588b58c4c7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:48.968163 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b39767-2e9a-4c66-aca9-4229b2a46b35 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.973072 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32e06-4d13-4e65-8cf3-bf8b0215768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.974003 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32e06-4d13-4e65-8cf3-bf8b0215768f admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.974121 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af834b-da01-49cb-9813-81588b58c4c7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:48.974287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32e06-4d13-4e65-8cf3-bf8b0215768f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.974587 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32e06-4d13-4e65-8cf3-bf8b0215768f admin admin] PATH_INFO: `/v3/projects/74844f9662594be0a169c6786452d5f5/users/9930ded4cdec4fd3a77ec5b860cb5442/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.978829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606ea02-5c68-4df4-8c8d-ef05d5d768ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:48.982576 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606ea02-5c68-4df4-8c8d-ef05d5d768ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:48.982576 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606ea02-5c68-4df4-8c8d-ef05d5d768ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:48.982576 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606ea02-5c68-4df4-8c8d-ef05d5d768ae admin admin] PATH_INFO: `/v3/projects/d431c20518f94b44b364137db53f917e/users/90c69275b0e34b638ca8c9ecb70d4da2/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:48.989663 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a32e06-4d13-4e65-8cf3-bf8b0215768f admin admin] RBAC: Authorizing `identity:create_grant(project_id=74844f9662594be0a169c6786452d5f5, user_id=9930ded4cdec4fd3a77ec5b860cb5442, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.992359 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a32e06-4d13-4e65-8cf3-bf8b0215768f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:48.996733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606ea02-5c68-4df4-8c8d-ef05d5d768ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d431c20518f94b44b364137db53f917e, user_id=90c69275b0e34b638ca8c9ecb70d4da2, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:48.999616 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606ea02-5c68-4df4-8c8d-ef05d5d768ae admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:49.100048 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1292/2571] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:48 2022] PUT /identity/v3/projects/74844f9662594be0a169c6786452d5f5/users/9930ded4cdec4fd3a77ec5b860cb5442/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:49.104064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32e06-4d13-4e65-8cf3-bf8b0215768f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:49.124627 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1280/2572] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:48 2022] PUT /identity/v3/projects/d431c20518f94b44b364137db53f917e/users/90c69275b0e34b638ca8c9ecb70d4da2/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:49.128160 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606ea02-5c68-4df4-8c8d-ef05d5d768ae admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:49.164202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32e06-4d13-4e65-8cf3-bf8b0215768f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:49.189235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606ea02-5c68-4df4-8c8d-ef05d5d768ae admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:49.193901 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab36af1-05a8-4c6a-87f0-5f0a7360c23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:49.194556 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab36af1-05a8-4c6a-87f0-5f0a7360c23c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:49.194849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab36af1-05a8-4c6a-87f0-5f0a7360c23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:49.195153 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab36af1-05a8-4c6a-87f0-5f0a7360c23c admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:49.196615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab36af1-05a8-4c6a-87f0-5f0a7360c23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:49.198199 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab36af1-05a8-4c6a-87f0-5f0a7360c23c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:49.207833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1281/2573] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:49.212672 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab36af1-05a8-4c6a-87f0-5f0a7360c23c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:49.221808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f923d-009e-4194-b082-badf39718d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:49.222265 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab36af1-05a8-4c6a-87f0-5f0a7360c23c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:49.222703 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f923d-009e-4194-b082-badf39718d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:49.223083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f923d-009e-4194-b082-badf39718d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:49.223500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f923d-009e-4194-b082-badf39718d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:49.224362 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f923d-009e-4194-b082-badf39718d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:49.226016 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f923d-009e-4194-b082-badf39718d35 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:49.226823 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107729d-e7ba-4ee5-8bb2-5c05346a393f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:49.227711 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107729d-e7ba-4ee5-8bb2-5c05346a393f admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:49.227992 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107729d-e7ba-4ee5-8bb2-5c05346a393f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:49.228268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107729d-e7ba-4ee5-8bb2-5c05346a393f admin admin] PATH_INFO: `/v3/projects/d431c20518f94b44b364137db53f917e/users/90c69275b0e34b638ca8c9ecb70d4da2/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:49.230230 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107729d-e7ba-4ee5-8bb2-5c05346a393f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d431c20518f94b44b364137db53f917e, user_id=90c69275b0e34b638ca8c9ecb70d4da2, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:49.232905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107729d-e7ba-4ee5-8bb2-5c05346a393f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:49.235976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1293/2574] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:49.239960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f923d-009e-4194-b082-badf39718d35 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:49.243742 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1282/2575] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:49 2022] PUT /identity/v3/projects/d431c20518f94b44b364137db53f917e/users/90c69275b0e34b638ca8c9ecb70d4da2/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:49.249566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f923d-009e-4194-b082-badf39718d35 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:49.254911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e94f8-d2fd-4a98-ba90-a4d747c3a9dc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:49.255245 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e94f8-d2fd-4a98-ba90-a4d747c3a9dc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:49.255522 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e94f8-d2fd-4a98-ba90-a4d747c3a9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:49.283355 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e68e94f8-d2fd-4a98-ba90-a4d747c3a9dc None None] MFA Rules not processed for user `90c69275b0e34b638ca8c9ecb70d4da2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:49.284544 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e68e94f8-d2fd-4a98-ba90-a4d747c3a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:49.307355 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0083a0-b068-43cf-94f2-ac3e4f3bfd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:49.308379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0083a0-b068-43cf-94f2-ac3e4f3bfd71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:49.308756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0083a0-b068-43cf-94f2-ac3e4f3bfd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:49.309125 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0083a0-b068-43cf-94f2-ac3e4f3bfd71 admin admin] PATH_INFO: `/v3/projects/74844f9662594be0a169c6786452d5f5/users/9930ded4cdec4fd3a77ec5b860cb5442/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:49.311286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0083a0-b068-43cf-94f2-ac3e4f3bfd71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74844f9662594be0a169c6786452d5f5, user_id=9930ded4cdec4fd3a77ec5b860cb5442, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:49.314290 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0083a0-b068-43cf-94f2-ac3e4f3bfd71 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:49.325881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1294/2576] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:49 2022] PUT /identity/v3/projects/74844f9662594be0a169c6786452d5f5/users/9930ded4cdec4fd3a77ec5b860cb5442/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:49.336020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422d76c-78f6-4380-9608-5c7a434d0016 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:49.336513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422d76c-78f6-4380-9608-5c7a434d0016 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:49.336958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422d76c-78f6-4380-9608-5c7a434d0016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:49.365310 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1283/2577] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:49.378960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4422d76c-78f6-4380-9608-5c7a434d0016 None None] MFA Rules not processed for user `9930ded4cdec4fd3a77ec5b860cb5442`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:49.379549 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e94f8-d2fd-4a98-ba90-a4d747c3a9dc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:49.380555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4422d76c-78f6-4380-9608-5c7a434d0016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:49.381448 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e68e94f8-d2fd-4a98-ba90-a4d747c3a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:49.477980 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e94f8-d2fd-4a98-ba90-a4d747c3a9dc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:49.479430 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1295/2578] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:49.479430 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422d76c-78f6-4380-9608-5c7a434d0016 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:49.479430 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4422d76c-78f6-4380-9608-5c7a434d0016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:49.504600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75cd48-7de2-4a82-8d09-e3a86f5f8a9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:49.505543 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75cd48-7de2-4a82-8d09-e3a86f5f8a9d service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:49.505902 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75cd48-7de2-4a82-8d09-e3a86f5f8a9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:49.506485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75cd48-7de2-4a82-8d09-e3a86f5f8a9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:49.538631 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422d76c-78f6-4380-9608-5c7a434d0016 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:49.542575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613c635-1ac3-491d-8fb0-72ab0314554f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:49.543260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c635-1ac3-491d-8fb0-72ab0314554f service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:49.543545 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c635-1ac3-491d-8fb0-72ab0314554f service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:49.543821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c635-1ac3-491d-8fb0-72ab0314554f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:49.554472 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613c635-1ac3-491d-8fb0-72ab0314554f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:49.556487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613c635-1ac3-491d-8fb0-72ab0314554f service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:49.567015 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1296/2579] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:16:49.578897 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75cd48-7de2-4a82-8d09-e3a86f5f8a9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:49.580685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75cd48-7de2-4a82-8d09-e3a86f5f8a9d service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:49.591148 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1284/2580] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:16:49.596181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613c635-1ac3-491d-8fb0-72ab0314554f service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:49.667587 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613c635-1ac3-491d-8fb0-72ab0314554f service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:49.672261 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91c4a9-925e-4596-ad16-c377df20d03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:49.673123 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91c4a9-925e-4596-ad16-c377df20d03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:49.673406 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91c4a9-925e-4596-ad16-c377df20d03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:49.673683 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91c4a9-925e-4596-ad16-c377df20d03d admin admin] PATH_INFO: `/v3/users/3d80368d1b0e4f4982052d6c4b2b0559` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:49.674876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91c4a9-925e-4596-ad16-c377df20d03d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d80368d1b0e4f4982052d6c4b2b0559)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:49.676934 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91c4a9-925e-4596-ad16-c377df20d03d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:49.845809 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75cd48-7de2-4a82-8d09-e3a86f5f8a9d service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:49.855065 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75cd48-7de2-4a82-8d09-e3a86f5f8a9d service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:49.859883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276d9a5-2300-46f8-957b-1e23c71e43e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:49.860562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276d9a5-2300-46f8-957b-1e23c71e43e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:49.860963 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276d9a5-2300-46f8-957b-1e23c71e43e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:49.861243 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276d9a5-2300-46f8-957b-1e23c71e43e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:49.873411 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fe91c4a9-925e-4596-ad16-c377df20d03d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d80368d1b0e4f4982052d6c4b2b0559'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:49.884661 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fe91c4a9-925e-4596-ad16-c377df20d03d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d80368d1b0e4f4982052d6c4b2b0559'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:49.919692 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276d9a5-2300-46f8-957b-1e23c71e43e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:49.921172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276d9a5-2300-46f8-957b-1e23c71e43e4 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:49.932063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1285/2581] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:16:49.952618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fe91c4a9-925e-4596-ad16-c377df20d03d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d80368d1b0e4f4982052d6c4b2b0559'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:49.953279 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fe91c4a9-925e-4596-ad16-c377df20d03d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d80368d1b0e4f4982052d6c4b2b0559'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:49.953934 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fe91c4a9-925e-4596-ad16-c377df20d03d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d80368d1b0e4f4982052d6c4b2b0559'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:49.966658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1297/2582] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:49 2022] DELETE /identity/v3/users/3d80368d1b0e4f4982052d6c4b2b0559 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:49.971619 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02a3c9-658e-4693-8069-32b2a2a6e7e9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:49.975992 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02a3c9-658e-4693-8069-32b2a2a6e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:49.975992 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02a3c9-658e-4693-8069-32b2a2a6e7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:49.990447 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ec02a3c9-658e-4693-8069-32b2a2a6e7e9 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:49.991603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ec02a3c9-658e-4693-8069-32b2a2a6e7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:50.051685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1286/2583] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:50.063171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91c4a9-925e-4596-ad16-c377df20d03d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:50.064644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fe91c4a9-925e-4596-ad16-c377df20d03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:50.122382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91c4a9-925e-4596-ad16-c377df20d03d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:50.125992 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baade61c-784e-464a-ad91-96537e3292de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:50.126627 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baade61c-784e-464a-ad91-96537e3292de service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:50.126907 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baade61c-784e-464a-ad91-96537e3292de service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:50.127205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baade61c-784e-464a-ad91-96537e3292de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:50.136492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baade61c-784e-464a-ad91-96537e3292de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:50.137922 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baade61c-784e-464a-ad91-96537e3292de service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:50.147392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1298/2584] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:50.584597 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02a3c9-658e-4693-8069-32b2a2a6e7e9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:50.586778 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ec02a3c9-658e-4693-8069-32b2a2a6e7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:50.599413 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02a3c9-658e-4693-8069-32b2a2a6e7e9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:50.604995 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:50.606091 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:50.606498 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:50.606940 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b admin admin] PATH_INFO: `/v3/projects/e462c3a499214e96a5f9737425a676fd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:50.608289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e462c3a499214e96a5f9737425a676fd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:50.611090 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:50.724348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e462c3a499214e96a5f9737425a676fd', 'request_id': 'req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:50.796790 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e462c3a499214e96a5f9737425a676fd', 'request_id': 'req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:50.802775 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e462c3a499214e96a5f9737425a676fd', 'request_id': 'req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:50.815013 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b admin admin] The token cache is being invalidate because project e462c3a499214e96a5f9737425a676fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:50.815259 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:50.815897 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:50.817433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1287/2585] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:50 2022] DELETE /identity/v3/projects/e462c3a499214e96a5f9737425a676fd => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:50.822220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baade61c-784e-464a-ad91-96537e3292de service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:50.831670 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baade61c-784e-464a-ad91-96537e3292de service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:50.888345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae3d66-317c-4da1-b269-3c87289d3609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:50.889213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae3d66-317c-4da1-b269-3c87289d3609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:50.889492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae3d66-317c-4da1-b269-3c87289d3609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:50.889766 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae3d66-317c-4da1-b269-3c87289d3609 admin admin] PATH_INFO: `/v3/users/9930ded4cdec4fd3a77ec5b860cb5442` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:50.890956 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae3d66-317c-4da1-b269-3c87289d3609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9930ded4cdec4fd3a77ec5b860cb5442)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:50.893153 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae3d66-317c-4da1-b269-3c87289d3609 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:51.160722 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-52ae3d66-317c-4da1-b269-3c87289d3609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9930ded4cdec4fd3a77ec5b860cb5442'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:51.172654 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-52ae3d66-317c-4da1-b269-3c87289d3609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9930ded4cdec4fd3a77ec5b860cb5442'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:51.266577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-52ae3d66-317c-4da1-b269-3c87289d3609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9930ded4cdec4fd3a77ec5b860cb5442'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:51.267209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-52ae3d66-317c-4da1-b269-3c87289d3609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9930ded4cdec4fd3a77ec5b860cb5442'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:51.267829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-52ae3d66-317c-4da1-b269-3c87289d3609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9930ded4cdec4fd3a77ec5b860cb5442'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:51.280946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1299/2586] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:50 2022] DELETE /identity/v3/users/9930ded4cdec4fd3a77ec5b860cb5442 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:51.702796 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:51.704767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:51.718674 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09918c1c-7c6f-4d3b-a1a9-6a46da5d794b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:51.776209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d301d-f5fb-45ac-932c-4c941896a96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:51.777066 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d301d-f5fb-45ac-932c-4c941896a96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:51.777343 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d301d-f5fb-45ac-932c-4c941896a96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:51.777611 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d301d-f5fb-45ac-932c-4c941896a96c admin admin] PATH_INFO: `/v3/projects/74844f9662594be0a169c6786452d5f5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:51.778779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d301d-f5fb-45ac-932c-4c941896a96c admin admin] RBAC: Authorizing `identity:delete_project(project_id=74844f9662594be0a169c6786452d5f5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:51.780696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d301d-f5fb-45ac-932c-4c941896a96c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:51.871013 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-737d301d-f5fb-45ac-932c-4c941896a96c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74844f9662594be0a169c6786452d5f5', 'request_id': 'req-737d301d-f5fb-45ac-932c-4c941896a96c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:51.969504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-737d301d-f5fb-45ac-932c-4c941896a96c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74844f9662594be0a169c6786452d5f5', 'request_id': 'req-737d301d-f5fb-45ac-932c-4c941896a96c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:51.975429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-737d301d-f5fb-45ac-932c-4c941896a96c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74844f9662594be0a169c6786452d5f5', 'request_id': 'req-737d301d-f5fb-45ac-932c-4c941896a96c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:51.986319 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-737d301d-f5fb-45ac-932c-4c941896a96c admin admin] The token cache is being invalidate because project 74844f9662594be0a169c6786452d5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:51.986606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-737d301d-f5fb-45ac-932c-4c941896a96c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:51.987266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-737d301d-f5fb-45ac-932c-4c941896a96c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:51.989092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1288/2587] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:51 2022] DELETE /identity/v3/projects/74844f9662594be0a169c6786452d5f5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:51.994068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a2961-2abd-4ef5-8c7e-3af6ad93159d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:51.994546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a2961-2abd-4ef5-8c7e-3af6ad93159d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:51.994651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a2961-2abd-4ef5-8c7e-3af6ad93159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:52.013099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e25a2961-2abd-4ef5-8c7e-3af6ad93159d None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:52.018539 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e25a2961-2abd-4ef5-8c7e-3af6ad93159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:52.078132 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1300/2588] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:52.089140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6c48e-24ca-45b0-9a57-d79d9bc3549f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:52.095039 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6c48e-24ca-45b0-9a57-d79d9bc3549f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:52.095039 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6c48e-24ca-45b0-9a57-d79d9bc3549f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:52.109581 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-acd6c48e-24ca-45b0-9a57-d79d9bc3549f None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:52.110779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-acd6c48e-24ca-45b0-9a57-d79d9bc3549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:52.123324 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1289/2589] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:52.127678 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a2961-2abd-4ef5-8c7e-3af6ad93159d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:52.137659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a2961-2abd-4ef5-8c7e-3af6ad93159d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:52.142284 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99932a0b-421a-4aaf-a2fe-5c7a177d2c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:52.142951 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99932a0b-421a-4aaf-a2fe-5c7a177d2c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:52.143271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99932a0b-421a-4aaf-a2fe-5c7a177d2c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:52.143597 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99932a0b-421a-4aaf-a2fe-5c7a177d2c7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:52.144368 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99932a0b-421a-4aaf-a2fe-5c7a177d2c7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:16:52.144622 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99932a0b-421a-4aaf-a2fe-5c7a177d2c7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:52.146251 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99932a0b-421a-4aaf-a2fe-5c7a177d2c7f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:52.158446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1301/2590] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:16:52.162669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6c48e-24ca-45b0-9a57-d79d9bc3549f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:52.171967 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6c48e-24ca-45b0-9a57-d79d9bc3549f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:52.176827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba8f8c-f8f6-40c5-98f8-339b29b96d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:52.181097 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba8f8c-f8f6-40c5-98f8-339b29b96d91 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:52.181097 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba8f8c-f8f6-40c5-98f8-339b29b96d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:52.181097 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba8f8c-f8f6-40c5-98f8-339b29b96d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:52.181097 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba8f8c-f8f6-40c5-98f8-339b29b96d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:52.181097 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba8f8c-f8f6-40c5-98f8-339b29b96d91 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:52.284698 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1290/2591] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:52 2022] POST /identity/v3/projects => generated 401 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:52.288904 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99932a0b-421a-4aaf-a2fe-5c7a177d2c7f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:52.298667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99932a0b-421a-4aaf-a2fe-5c7a177d2c7f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:52.354348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b956ce-2b43-4677-9d49-75e6be1e3312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:52.355010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b956ce-2b43-4677-9d49-75e6be1e3312 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:52.355316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b956ce-2b43-4677-9d49-75e6be1e3312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:52.355587 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b956ce-2b43-4677-9d49-75e6be1e3312 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:52.356275 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b956ce-2b43-4677-9d49-75e6be1e3312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:52.358174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b956ce-2b43-4677-9d49-75e6be1e3312 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:52.459581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1302/2592] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:52 2022] POST /identity/v3/users => generated 301 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:52.463837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba8f8c-f8f6-40c5-98f8-339b29b96d91 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:52.475078 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba8f8c-f8f6-40c5-98f8-339b29b96d91 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:52.480397 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a0e36-5f66-479e-aea4-0962e355fb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:52.481107 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a0e36-5f66-479e-aea4-0962e355fb21 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:52.481392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a0e36-5f66-479e-aea4-0962e355fb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:52.481667 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a0e36-5f66-479e-aea4-0962e355fb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:52.482461 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a0e36-5f66-479e-aea4-0962e355fb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:52.484151 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a0e36-5f66-479e-aea4-0962e355fb21 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:52.496712 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1291/2593] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:52.500538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b956ce-2b43-4677-9d49-75e6be1e3312 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:52.511705 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b956ce-2b43-4677-9d49-75e6be1e3312 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:52.516482 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58794607-4b6a-4871-8c82-90f6fc9a5d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:52.517202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58794607-4b6a-4871-8c82-90f6fc9a5d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:52.517486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58794607-4b6a-4871-8c82-90f6fc9a5d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:52.517762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58794607-4b6a-4871-8c82-90f6fc9a5d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:52.518484 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58794607-4b6a-4871-8c82-90f6fc9a5d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:52.520104 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58794607-4b6a-4871-8c82-90f6fc9a5d35 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:52.530578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1303/2594] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:52.534784 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a0e36-5f66-479e-aea4-0962e355fb21 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:52.545204 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a0e36-5f66-479e-aea4-0962e355fb21 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:52.549750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acc889-8ef9-4396-b333-2a0bf1ee4119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:52.550609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acc889-8ef9-4396-b333-2a0bf1ee4119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:52.550886 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acc889-8ef9-4396-b333-2a0bf1ee4119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:52.551218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acc889-8ef9-4396-b333-2a0bf1ee4119 admin admin] PATH_INFO: `/v3/projects/34e3ffb798aa44779f82a15b2b9ddc30/users/6850baedff7c469fb389c968501c5f99/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:52.565463 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acc889-8ef9-4396-b333-2a0bf1ee4119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e3ffb798aa44779f82a15b2b9ddc30, user_id=6850baedff7c469fb389c968501c5f99, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:52.568344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acc889-8ef9-4396-b333-2a0bf1ee4119 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:52.643066 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1292/2595] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:52 2022] PUT /identity/v3/projects/34e3ffb798aa44779f82a15b2b9ddc30/users/6850baedff7c469fb389c968501c5f99/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:52.654214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7916c-2696-48bf-ab93-556f3d353452 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:52.654524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7916c-2696-48bf-ab93-556f3d353452 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:52.654800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7916c-2696-48bf-ab93-556f3d353452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:52.689041 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-72b7916c-2696-48bf-ab93-556f3d353452 None None] MFA Rules not processed for user `6850baedff7c469fb389c968501c5f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:52.690251 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-72b7916c-2696-48bf-ab93-556f3d353452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:52.751730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1304/2596] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:52.756112 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acc889-8ef9-4396-b333-2a0bf1ee4119 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:52.815417 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acc889-8ef9-4396-b333-2a0bf1ee4119 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:52.820024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e353e8-ba44-4a8e-a89b-a6af2d278e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:52.821211 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e353e8-ba44-4a8e-a89b-a6af2d278e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:52.821488 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e353e8-ba44-4a8e-a89b-a6af2d278e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:52.821759 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e353e8-ba44-4a8e-a89b-a6af2d278e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:52.822438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e353e8-ba44-4a8e-a89b-a6af2d278e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:52.824349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e353e8-ba44-4a8e-a89b-a6af2d278e10 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:52.908310 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1293/2597] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:52 2022] POST /identity/v3/projects => generated 401 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:52.912261 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7916c-2696-48bf-ab93-556f3d353452 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:52.923351 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7916c-2696-48bf-ab93-556f3d353452 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:52.979753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0a008-d18a-4b8f-9ef4-2db474e9e5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:52.980425 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0a008-d18a-4b8f-9ef4-2db474e9e5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:52.980708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0a008-d18a-4b8f-9ef4-2db474e9e5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:52.980987 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0a008-d18a-4b8f-9ef4-2db474e9e5f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:52.981675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0a008-d18a-4b8f-9ef4-2db474e9e5f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:52.983606 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0a008-d18a-4b8f-9ef4-2db474e9e5f1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:53.065756 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1305/2598] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:52 2022] POST /identity/v3/users => generated 307 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:53.069734 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e353e8-ba44-4a8e-a89b-a6af2d278e10 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:53.081369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e353e8-ba44-4a8e-a89b-a6af2d278e10 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:53.086503 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b9118-b569-46e6-992e-a3af7bd07389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:53.087210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b9118-b569-46e6-992e-a3af7bd07389 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:53.087537 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b9118-b569-46e6-992e-a3af7bd07389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:53.087864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b9118-b569-46e6-992e-a3af7bd07389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:53.088590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b9118-b569-46e6-992e-a3af7bd07389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:53.090230 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b9118-b569-46e6-992e-a3af7bd07389 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:53.100504 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1294/2599] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:53.104648 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0a008-d18a-4b8f-9ef4-2db474e9e5f1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:53.114577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0a008-d18a-4b8f-9ef4-2db474e9e5f1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:53.119935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96482295-9fd4-4282-b59c-08773868b8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:53.120844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96482295-9fd4-4282-b59c-08773868b8ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:53.121125 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96482295-9fd4-4282-b59c-08773868b8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:53.121399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96482295-9fd4-4282-b59c-08773868b8ac admin admin] PATH_INFO: `/v3/projects/652a63b036f949e2b22710ef40e2f162/users/576bbb2e4aa94045863b996ce660aeac/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:53.139231 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96482295-9fd4-4282-b59c-08773868b8ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=652a63b036f949e2b22710ef40e2f162, user_id=576bbb2e4aa94045863b996ce660aeac, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:53.142377 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96482295-9fd4-4282-b59c-08773868b8ac admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:53.227960 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1306/2600] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:53 2022] PUT /identity/v3/projects/652a63b036f949e2b22710ef40e2f162/users/576bbb2e4aa94045863b996ce660aeac/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:53.231541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b9118-b569-46e6-992e-a3af7bd07389 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:53.243065 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b9118-b569-46e6-992e-a3af7bd07389 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:53.300716 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430cfae-8d81-4f30-aea5-1488fb9f541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:53.301385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430cfae-8d81-4f30-aea5-1488fb9f541d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:53.301670 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430cfae-8d81-4f30-aea5-1488fb9f541d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:53.301948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430cfae-8d81-4f30-aea5-1488fb9f541d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:53.302676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430cfae-8d81-4f30-aea5-1488fb9f541d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:53.304296 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430cfae-8d81-4f30-aea5-1488fb9f541d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:53.314597 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1295/2601] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:16:53.318848 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96482295-9fd4-4282-b59c-08773868b8ac admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:53.329534 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96482295-9fd4-4282-b59c-08773868b8ac admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:53.334030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33413f5a-bda4-43ea-afd8-e38ff7d7d546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:53.334901 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33413f5a-bda4-43ea-afd8-e38ff7d7d546 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:53.335206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33413f5a-bda4-43ea-afd8-e38ff7d7d546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:53.335479 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33413f5a-bda4-43ea-afd8-e38ff7d7d546 admin admin] PATH_INFO: `/v3/projects/652a63b036f949e2b22710ef40e2f162/users/576bbb2e4aa94045863b996ce660aeac/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:53.337675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33413f5a-bda4-43ea-afd8-e38ff7d7d546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652a63b036f949e2b22710ef40e2f162, user_id=576bbb2e4aa94045863b996ce660aeac, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:53.342657 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33413f5a-bda4-43ea-afd8-e38ff7d7d546 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:53.350864 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1307/2602] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:53 2022] PUT /identity/v3/projects/652a63b036f949e2b22710ef40e2f162/users/576bbb2e4aa94045863b996ce660aeac/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:53.362707 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab495e-4908-470d-b6ea-a2858083d5b5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:53.363003 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab495e-4908-470d-b6ea-a2858083d5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:53.363322 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab495e-4908-470d-b6ea-a2858083d5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:53.391163 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-deab495e-4908-470d-b6ea-a2858083d5b5 None None] MFA Rules not processed for user `576bbb2e4aa94045863b996ce660aeac`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:53.392378 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-deab495e-4908-470d-b6ea-a2858083d5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:53.464155 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1296/2603] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:53 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:53.475835 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33413f5a-bda4-43ea-afd8-e38ff7d7d546 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:53.478043 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-33413f5a-bda4-43ea-afd8-e38ff7d7d546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:53.536445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33413f5a-bda4-43ea-afd8-e38ff7d7d546 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:53.540667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0dfca-d053-45af-81ad-2587615b30eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:53.541309 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0dfca-d053-45af-81ad-2587615b30eb service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:53.541586 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0dfca-d053-45af-81ad-2587615b30eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:53.541857 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0dfca-d053-45af-81ad-2587615b30eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:53.550667 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0dfca-d053-45af-81ad-2587615b30eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:53.552135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0dfca-d053-45af-81ad-2587615b30eb service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:53.562094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1308/2604] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:53 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:53.832434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab495e-4908-470d-b6ea-a2858083d5b5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:53.845321 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab495e-4908-470d-b6ea-a2858083d5b5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:53.849496 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325859c-266c-4b7d-9c53-85605c5b5fbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:53.849637 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325859c-266c-4b7d-9c53-85605c5b5fbf service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:53.849932 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325859c-266c-4b7d-9c53-85605c5b5fbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:53.850136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325859c-266c-4b7d-9c53-85605c5b5fbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:53.919374 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325859c-266c-4b7d-9c53-85605c5b5fbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:53.920850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325859c-266c-4b7d-9c53-85605c5b5fbf service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:53.930184 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1297/2605] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:56.572635 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0dfca-d053-45af-81ad-2587615b30eb service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:56.574015 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-90f0dfca-d053-45af-81ad-2587615b30eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:56.637709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0dfca-d053-45af-81ad-2587615b30eb service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:56.642145 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8da79-c7a3-4540-970e-56f5826ff461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:56.642999 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8da79-c7a3-4540-970e-56f5826ff461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:56.643305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8da79-c7a3-4540-970e-56f5826ff461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:56.643634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8da79-c7a3-4540-970e-56f5826ff461 admin admin] PATH_INFO: `/v3/users/56048a636f3345a1824b6fb0d8403efc` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:56.644788 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8da79-c7a3-4540-970e-56f5826ff461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56048a636f3345a1824b6fb0d8403efc)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:56.646680 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8da79-c7a3-4540-970e-56f5826ff461 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:56.781807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5da8da79-c7a3-4540-970e-56f5826ff461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56048a636f3345a1824b6fb0d8403efc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:56.793909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5da8da79-c7a3-4540-970e-56f5826ff461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56048a636f3345a1824b6fb0d8403efc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:56.844375 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5da8da79-c7a3-4540-970e-56f5826ff461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56048a636f3345a1824b6fb0d8403efc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:56.844958 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5da8da79-c7a3-4540-970e-56f5826ff461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56048a636f3345a1824b6fb0d8403efc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:56.845566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5da8da79-c7a3-4540-970e-56f5826ff461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56048a636f3345a1824b6fb0d8403efc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:56.859131 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1309/2606] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:56 2022] DELETE /identity/v3/users/56048a636f3345a1824b6fb0d8403efc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:56.863673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bcb00-4fab-4677-846c-90ba4790e97a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:56.864152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bcb00-4fab-4677-846c-90ba4790e97a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:56.864248 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bcb00-4fab-4677-846c-90ba4790e97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:56.881262 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4b2bcb00-4fab-4677-846c-90ba4790e97a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:56.882464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4b2bcb00-4fab-4677-846c-90ba4790e97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:56.944280 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1298/2607] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:56.954096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8da79-c7a3-4540-970e-56f5826ff461 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:56.955658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5da8da79-c7a3-4540-970e-56f5826ff461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:57.011843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8da79-c7a3-4540-970e-56f5826ff461 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:57.015445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ebeec-e137-47de-ad93-19053b81e73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:57.016076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ebeec-e137-47de-ad93-19053b81e73a service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:57.016356 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ebeec-e137-47de-ad93-19053b81e73a service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:57.016628 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ebeec-e137-47de-ad93-19053b81e73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:57.025930 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ebeec-e137-47de-ad93-19053b81e73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:57.027374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ebeec-e137-47de-ad93-19053b81e73a service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:57.036512 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1310/2608] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:57.446729 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bcb00-4fab-4677-846c-90ba4790e97a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:57.448147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4b2bcb00-4fab-4677-846c-90ba4790e97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:57.459745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bcb00-4fab-4677-846c-90ba4790e97a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:57.467749 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64186c2e-00da-4695-8c38-eb923126f041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:57.468688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64186c2e-00da-4695-8c38-eb923126f041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:57.468975 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64186c2e-00da-4695-8c38-eb923126f041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:57.469242 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64186c2e-00da-4695-8c38-eb923126f041 admin admin] PATH_INFO: `/v3/projects/cb530d5aa74840f3a8400cafb3975e71` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:57.470972 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64186c2e-00da-4695-8c38-eb923126f041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb530d5aa74840f3a8400cafb3975e71)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:57.472541 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64186c2e-00da-4695-8c38-eb923126f041 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:57.585529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-64186c2e-00da-4695-8c38-eb923126f041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb530d5aa74840f3a8400cafb3975e71', 'request_id': 'req-64186c2e-00da-4695-8c38-eb923126f041'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:57.653470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-64186c2e-00da-4695-8c38-eb923126f041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb530d5aa74840f3a8400cafb3975e71', 'request_id': 'req-64186c2e-00da-4695-8c38-eb923126f041'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:57.666149 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-64186c2e-00da-4695-8c38-eb923126f041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb530d5aa74840f3a8400cafb3975e71', 'request_id': 'req-64186c2e-00da-4695-8c38-eb923126f041'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:57.677140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-64186c2e-00da-4695-8c38-eb923126f041 admin admin] The token cache is being invalidate because project cb530d5aa74840f3a8400cafb3975e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:57.677472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-64186c2e-00da-4695-8c38-eb923126f041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:57.678056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-64186c2e-00da-4695-8c38-eb923126f041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:57.680210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1299/2609] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:57 2022] DELETE /identity/v3/projects/cb530d5aa74840f3a8400cafb3975e71 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:57.687541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ebeec-e137-47de-ad93-19053b81e73a service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:57.694851 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ebeec-e137-47de-ad93-19053b81e73a service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:57.751461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93e400-1022-4961-a08c-7d71f9a4304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:57.752343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93e400-1022-4961-a08c-7d71f9a4304c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:57.752627 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93e400-1022-4961-a08c-7d71f9a4304c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:57.752897 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93e400-1022-4961-a08c-7d71f9a4304c admin admin] PATH_INFO: `/v3/users/90c69275b0e34b638ca8c9ecb70d4da2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:57.754196 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93e400-1022-4961-a08c-7d71f9a4304c admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c69275b0e34b638ca8c9ecb70d4da2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:57.756151 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93e400-1022-4961-a08c-7d71f9a4304c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:57.995949 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc93e400-1022-4961-a08c-7d71f9a4304c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c69275b0e34b638ca8c9ecb70d4da2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:58.007779 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc93e400-1022-4961-a08c-7d71f9a4304c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c69275b0e34b638ca8c9ecb70d4da2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:58.077060 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc93e400-1022-4961-a08c-7d71f9a4304c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c69275b0e34b638ca8c9ecb70d4da2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:58.077728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc93e400-1022-4961-a08c-7d71f9a4304c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c69275b0e34b638ca8c9ecb70d4da2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:58.078331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc93e400-1022-4961-a08c-7d71f9a4304c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c69275b0e34b638ca8c9ecb70d4da2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:58.091015 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1311/2610] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:57 2022] DELETE /identity/v3/users/90c69275b0e34b638ca8c9ecb70d4da2 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:58.519716 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64186c2e-00da-4695-8c38-eb923126f041 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:58.521450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-64186c2e-00da-4695-8c38-eb923126f041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:58.535021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64186c2e-00da-4695-8c38-eb923126f041 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:58.593965 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de201ee-46f6-4180-82a3-6cd3f135064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:58.594856 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de201ee-46f6-4180-82a3-6cd3f135064f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:58.595173 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de201ee-46f6-4180-82a3-6cd3f135064f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:58.595460 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de201ee-46f6-4180-82a3-6cd3f135064f admin admin] PATH_INFO: `/v3/projects/d431c20518f94b44b364137db53f917e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:58.596649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de201ee-46f6-4180-82a3-6cd3f135064f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d431c20518f94b44b364137db53f917e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:58.598542 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de201ee-46f6-4180-82a3-6cd3f135064f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:58.700664 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5de201ee-46f6-4180-82a3-6cd3f135064f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd431c20518f94b44b364137db53f917e', 'request_id': 'req-5de201ee-46f6-4180-82a3-6cd3f135064f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:58.769506 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5de201ee-46f6-4180-82a3-6cd3f135064f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd431c20518f94b44b364137db53f917e', 'request_id': 'req-5de201ee-46f6-4180-82a3-6cd3f135064f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:58.776463 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5de201ee-46f6-4180-82a3-6cd3f135064f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd431c20518f94b44b364137db53f917e', 'request_id': 'req-5de201ee-46f6-4180-82a3-6cd3f135064f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:58.787572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5de201ee-46f6-4180-82a3-6cd3f135064f admin admin] The token cache is being invalidate because project d431c20518f94b44b364137db53f917e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:16:58.787862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5de201ee-46f6-4180-82a3-6cd3f135064f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:58.788505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5de201ee-46f6-4180-82a3-6cd3f135064f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:58.790081 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1300/2611] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:16:58 2022] DELETE /identity/v3/projects/d431c20518f94b44b364137db53f917e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:16:58.795382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a07dc2-fd19-45f3-a0ae-6ca64371598f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:58.795870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a07dc2-fd19-45f3-a0ae-6ca64371598f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:58.796087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a07dc2-fd19-45f3-a0ae-6ca64371598f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:58.814616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-04a07dc2-fd19-45f3-a0ae-6ca64371598f None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:58.815883 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-04a07dc2-fd19-45f3-a0ae-6ca64371598f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:58.874658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1312/2612] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:58.883560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fba4c-134f-4481-8611-91458ab08b76 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:58.884138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fba4c-134f-4481-8611-91458ab08b76 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:58.884420 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fba4c-134f-4481-8611-91458ab08b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:58.904364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-779fba4c-134f-4481-8611-91458ab08b76 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:58.905547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-779fba4c-134f-4481-8611-91458ab08b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:58.917402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1301/2613] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:16:58.918412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a07dc2-fd19-45f3-a0ae-6ca64371598f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:58.928077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a07dc2-fd19-45f3-a0ae-6ca64371598f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:58.932891 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ff806-ccef-409a-b2c9-00ea5dccb220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:58.933549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ff806-ccef-409a-b2c9-00ea5dccb220 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:58.933831 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ff806-ccef-409a-b2c9-00ea5dccb220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:58.934136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ff806-ccef-409a-b2c9-00ea5dccb220 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:58.934869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ff806-ccef-409a-b2c9-00ea5dccb220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:16:58.935216 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ff806-ccef-409a-b2c9-00ea5dccb220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:58.937409 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ff806-ccef-409a-b2c9-00ea5dccb220 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:58.949796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1313/2614] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:16:58.954100 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fba4c-134f-4481-8611-91458ab08b76 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:58.963961 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fba4c-134f-4481-8611-91458ab08b76 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:58.968766 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7db4be-c611-4616-b899-0e57f99fe5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:58.969408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7db4be-c611-4616-b899-0e57f99fe5cf admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:58.969685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7db4be-c611-4616-b899-0e57f99fe5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:58.969956 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7db4be-c611-4616-b899-0e57f99fe5cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:58.970637 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7db4be-c611-4616-b899-0e57f99fe5cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:58.972540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7db4be-c611-4616-b899-0e57f99fe5cf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:59.058190 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ff806-ccef-409a-b2c9-00ea5dccb220 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:59.059977 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1d0ff806-ccef-409a-b2c9-00ea5dccb220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:59.074993 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1302/2615] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:16:58 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:16:59.075736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ff806-ccef-409a-b2c9-00ea5dccb220 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:59.079618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7db4be-c611-4616-b899-0e57f99fe5cf admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:59.131876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd17949-cae3-4740-bef9-b6fc9b434dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:59.133450 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd17949-cae3-4740-bef9-b6fc9b434dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:59.133736 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd17949-cae3-4740-bef9-b6fc9b434dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:59.134023 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd17949-cae3-4740-bef9-b6fc9b434dce admin admin] PATH_INFO: `/v3/users/6850baedff7c469fb389c968501c5f99` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:59.135324 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd17949-cae3-4740-bef9-b6fc9b434dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=6850baedff7c469fb389c968501c5f99)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:59.137792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd17949-cae3-4740-bef9-b6fc9b434dce admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:59.141096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7db4be-c611-4616-b899-0e57f99fe5cf admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:59.146512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8fb17-de46-4c5c-8694-48bb77069e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:59.147218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8fb17-de46-4c5c-8694-48bb77069e1a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:59.147513 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8fb17-de46-4c5c-8694-48bb77069e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:59.147806 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8fb17-de46-4c5c-8694-48bb77069e1a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:59.149449 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8fb17-de46-4c5c-8694-48bb77069e1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:59.150441 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8fb17-de46-4c5c-8694-48bb77069e1a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:59.260213 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1303/2616] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:16:59 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:16:59.261304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8fb17-de46-4c5c-8694-48bb77069e1a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:59.270932 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8fb17-de46-4c5c-8694-48bb77069e1a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:59.276712 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0982f5f-67e3-4d69-a64c-60ba4464c00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:59.277352 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0982f5f-67e3-4d69-a64c-60ba4464c00a admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:59.281435 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0982f5f-67e3-4d69-a64c-60ba4464c00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:59.281435 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0982f5f-67e3-4d69-a64c-60ba4464c00a admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:59.281435 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0982f5f-67e3-4d69-a64c-60ba4464c00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:59.281435 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0982f5f-67e3-4d69-a64c-60ba4464c00a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:59.290096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1304/2617] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:59.294064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0982f5f-67e3-4d69-a64c-60ba4464c00a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:59.303400 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0982f5f-67e3-4d69-a64c-60ba4464c00a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:59.308910 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10153f4-ce10-45bd-b9de-020f4fc37b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:59.309540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10153f4-ce10-45bd-b9de-020f4fc37b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:59.309830 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10153f4-ce10-45bd-b9de-020f4fc37b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:59.310108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10153f4-ce10-45bd-b9de-020f4fc37b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:59.310829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10153f4-ce10-45bd-b9de-020f4fc37b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:59.312418 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10153f4-ce10-45bd-b9de-020f4fc37b02 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:59.323870 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1305/2618] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:16:59.327863 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10153f4-ce10-45bd-b9de-020f4fc37b02 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:59.338017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10153f4-ce10-45bd-b9de-020f4fc37b02 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:59.340068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6bd17949-cae3-4740-bef9-b6fc9b434dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6850baedff7c469fb389c968501c5f99'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:59.342845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06b7c8-0543-496c-8d66-80ee7b0def83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:59.343744 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06b7c8-0543-496c-8d66-80ee7b0def83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:59.344065 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06b7c8-0543-496c-8d66-80ee7b0def83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:59.344344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06b7c8-0543-496c-8d66-80ee7b0def83 admin admin] PATH_INFO: `/v3/projects/cd4f10a7a4a942d0943120e62aea823d/users/ee49d42d43ac45a7956d0bd03d5bc9b7/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:59.352285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6bd17949-cae3-4740-bef9-b6fc9b434dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6850baedff7c469fb389c968501c5f99'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:59.359852 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06b7c8-0543-496c-8d66-80ee7b0def83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4f10a7a4a942d0943120e62aea823d, user_id=ee49d42d43ac45a7956d0bd03d5bc9b7, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:59.362707 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06b7c8-0543-496c-8d66-80ee7b0def83 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:59.443873 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6bd17949-cae3-4740-bef9-b6fc9b434dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6850baedff7c469fb389c968501c5f99'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:59.444489 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6bd17949-cae3-4740-bef9-b6fc9b434dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6850baedff7c469fb389c968501c5f99'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:59.445747 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6bd17949-cae3-4740-bef9-b6fc9b434dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6850baedff7c469fb389c968501c5f99'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:59.459575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1314/2619] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:59 2022] DELETE /identity/v3/users/6850baedff7c469fb389c968501c5f99 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:59.461744 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1306/2620] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:16:59 2022] PUT /identity/v3/projects/cd4f10a7a4a942d0943120e62aea823d/users/ee49d42d43ac45a7956d0bd03d5bc9b7/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:16:59.469379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654180ea-33e8-40ba-a480-69e0fe639b62 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:59.469669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654180ea-33e8-40ba-a480-69e0fe639b62 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:59.469948 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654180ea-33e8-40ba-a480-69e0fe639b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:59.477125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a525bc-8fb8-4f38-8097-0c477d379a88 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:59.477855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a525bc-8fb8-4f38-8097-0c477d379a88 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:59.478135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a525bc-8fb8-4f38-8097-0c477d379a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:59.488290 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-654180ea-33e8-40ba-a480-69e0fe639b62 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:59.489491 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-654180ea-33e8-40ba-a480-69e0fe639b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:59.504762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b5a525bc-8fb8-4f38-8097-0c477d379a88 None None] MFA Rules not processed for user `ee49d42d43ac45a7956d0bd03d5bc9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:16:59.505984 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b5a525bc-8fb8-4f38-8097-0c477d379a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:59.549078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1315/2621] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:59.560183 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654180ea-33e8-40ba-a480-69e0fe639b62 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:59.563787 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-654180ea-33e8-40ba-a480-69e0fe639b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:59.573944 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1307/2622] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:16:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:16:59.585462 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a525bc-8fb8-4f38-8097-0c477d379a88 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:59.587495 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b5a525bc-8fb8-4f38-8097-0c477d379a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:59.633916 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654180ea-33e8-40ba-a480-69e0fe639b62 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:59.638360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627322c5-8209-41cd-8c42-280475c7ae04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:59.639317 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627322c5-8209-41cd-8c42-280475c7ae04 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:59.639594 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627322c5-8209-41cd-8c42-280475c7ae04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:59.639995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627322c5-8209-41cd-8c42-280475c7ae04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:59.649409 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627322c5-8209-41cd-8c42-280475c7ae04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:59.650931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627322c5-8209-41cd-8c42-280475c7ae04 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:59.655889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a525bc-8fb8-4f38-8097-0c477d379a88 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:59.656395 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a4cab-c345-4847-9605-ebb433c6b484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:59.657259 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4cab-c345-4847-9605-ebb433c6b484 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:59.657599 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4cab-c345-4847-9605-ebb433c6b484 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:59.657882 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4cab-c345-4847-9605-ebb433c6b484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:59.662506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1316/2623] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:59.667249 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a4cab-c345-4847-9605-ebb433c6b484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:59.668687 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a4cab-c345-4847-9605-ebb433c6b484 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:59.678463 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1308/2624] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:16:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:16:59.700428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627322c5-8209-41cd-8c42-280475c7ae04 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:16:59.701860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-627322c5-8209-41cd-8c42-280475c7ae04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:16:59.715017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627322c5-8209-41cd-8c42-280475c7ae04 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:16:59.720476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51883463-0643-467f-8699-7ee16b12a856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:16:59.725038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51883463-0643-467f-8699-7ee16b12a856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:16:59.725038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51883463-0643-467f-8699-7ee16b12a856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:16:59.725038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51883463-0643-467f-8699-7ee16b12a856 admin admin] PATH_INFO: `/v3/users/ee49d42d43ac45a7956d0bd03d5bc9b7` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:16:59.725038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51883463-0643-467f-8699-7ee16b12a856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee49d42d43ac45a7956d0bd03d5bc9b7)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:16:59.725761 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51883463-0643-467f-8699-7ee16b12a856 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:16:59.916254 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-51883463-0643-467f-8699-7ee16b12a856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee49d42d43ac45a7956d0bd03d5bc9b7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:59.928396 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-51883463-0643-467f-8699-7ee16b12a856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee49d42d43ac45a7956d0bd03d5bc9b7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:59.998397 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-51883463-0643-467f-8699-7ee16b12a856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee49d42d43ac45a7956d0bd03d5bc9b7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:59.999039 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-51883463-0643-467f-8699-7ee16b12a856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee49d42d43ac45a7956d0bd03d5bc9b7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:16:59.999726 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-51883463-0643-467f-8699-7ee16b12a856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee49d42d43ac45a7956d0bd03d5bc9b7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:00.012743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1317/2625] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:16:59 2022] DELETE /identity/v3/users/ee49d42d43ac45a7956d0bd03d5bc9b7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:00.017304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5782d9-9db3-476c-b4f5-2c4f2609b9e2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:00.017625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5782d9-9db3-476c-b4f5-2c4f2609b9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:00.017907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5782d9-9db3-476c-b4f5-2c4f2609b9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:00.035644 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ec5782d9-9db3-476c-b4f5-2c4f2609b9e2 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:00.039318 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ec5782d9-9db3-476c-b4f5-2c4f2609b9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:00.061546 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51883463-0643-467f-8699-7ee16b12a856 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:00.063672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-51883463-0643-467f-8699-7ee16b12a856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:00.118586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1309/2626] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:00.130472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5782d9-9db3-476c-b4f5-2c4f2609b9e2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:00.131956 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ec5782d9-9db3-476c-b4f5-2c4f2609b9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:00.157136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51883463-0643-467f-8699-7ee16b12a856 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:00.161785 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35917e-42d8-44bc-be73-a796864042fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:00.162636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35917e-42d8-44bc-be73-a796864042fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:00.162914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35917e-42d8-44bc-be73-a796864042fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:00.163217 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35917e-42d8-44bc-be73-a796864042fe admin admin] PATH_INFO: `/v3/projects/34e3ffb798aa44779f82a15b2b9ddc30` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:00.165355 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35917e-42d8-44bc-be73-a796864042fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=34e3ffb798aa44779f82a15b2b9ddc30)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:00.167405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35917e-42d8-44bc-be73-a796864042fe admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:00.194393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5782d9-9db3-476c-b4f5-2c4f2609b9e2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:00.198568 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d94b8-99d4-4512-a131-b5e8c08a1f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:00.199244 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d94b8-99d4-4512-a131-b5e8c08a1f0b service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:00.199530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d94b8-99d4-4512-a131-b5e8c08a1f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:00.199804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d94b8-99d4-4512-a131-b5e8c08a1f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:00.208935 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d94b8-99d4-4512-a131-b5e8c08a1f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:00.210339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d94b8-99d4-4512-a131-b5e8c08a1f0b service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:00.220843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1310/2627] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:17:00.283511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fa35917e-42d8-44bc-be73-a796864042fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34e3ffb798aa44779f82a15b2b9ddc30', 'request_id': 'req-fa35917e-42d8-44bc-be73-a796864042fe'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:00.289933 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fa35917e-42d8-44bc-be73-a796864042fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34e3ffb798aa44779f82a15b2b9ddc30', 'request_id': 'req-fa35917e-42d8-44bc-be73-a796864042fe'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:00.295376 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fa35917e-42d8-44bc-be73-a796864042fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34e3ffb798aa44779f82a15b2b9ddc30', 'request_id': 'req-fa35917e-42d8-44bc-be73-a796864042fe'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:00.392898 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fa35917e-42d8-44bc-be73-a796864042fe admin admin] The token cache is being invalidate because project 34e3ffb798aa44779f82a15b2b9ddc30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:00.393251 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fa35917e-42d8-44bc-be73-a796864042fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:00.394290 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fa35917e-42d8-44bc-be73-a796864042fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:00.397069 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1318/2628] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:00 2022] DELETE /identity/v3/projects/34e3ffb798aa44779f82a15b2b9ddc30 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:17:00.402009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d94b8-99d4-4512-a131-b5e8c08a1f0b service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:00.411963 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d94b8-99d4-4512-a131-b5e8c08a1f0b service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:00.486676 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aaec2-bb85-4deb-b0a3-8010bafc7e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:00.487589 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aaec2-bb85-4deb-b0a3-8010bafc7e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:00.487876 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aaec2-bb85-4deb-b0a3-8010bafc7e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:00.488162 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aaec2-bb85-4deb-b0a3-8010bafc7e4f admin admin] PATH_INFO: `/v3/users/576bbb2e4aa94045863b996ce660aeac` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:00.490234 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4aaec2-bb85-4deb-b0a3-8010bafc7e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=576bbb2e4aa94045863b996ce660aeac)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:00.499564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4aaec2-bb85-4deb-b0a3-8010bafc7e4f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:00.707527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35917e-42d8-44bc-be73-a796864042fe admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:00.709398 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fa35917e-42d8-44bc-be73-a796864042fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:00.723711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35917e-42d8-44bc-be73-a796864042fe admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:00.728966 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5c4aaec2-bb85-4deb-b0a3-8010bafc7e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '576bbb2e4aa94045863b996ce660aeac'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:00.730373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ed78a-488b-4d2c-9372-8513d9734048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:00.731436 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ed78a-488b-4d2c-9372-8513d9734048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:00.731721 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ed78a-488b-4d2c-9372-8513d9734048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:00.731996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ed78a-488b-4d2c-9372-8513d9734048 admin admin] PATH_INFO: `/v3/projects/cd4f10a7a4a942d0943120e62aea823d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:00.733370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ed78a-488b-4d2c-9372-8513d9734048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4f10a7a4a942d0943120e62aea823d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:00.735367 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ed78a-488b-4d2c-9372-8513d9734048 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:00.745188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5c4aaec2-bb85-4deb-b0a3-8010bafc7e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '576bbb2e4aa94045863b996ce660aeac'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:00.746056 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5c4aaec2-bb85-4deb-b0a3-8010bafc7e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '576bbb2e4aa94045863b996ce660aeac'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:00.838193 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5c4aaec2-bb85-4deb-b0a3-8010bafc7e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '576bbb2e4aa94045863b996ce660aeac'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:00.838742 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5c4aaec2-bb85-4deb-b0a3-8010bafc7e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '576bbb2e4aa94045863b996ce660aeac'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:00.852615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1311/2629] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:17:00 2022] DELETE /identity/v3/users/576bbb2e4aa94045863b996ce660aeac => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:00.887902 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6c2ed78a-488b-4d2c-9372-8513d9734048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4f10a7a4a942d0943120e62aea823d', 'request_id': 'req-6c2ed78a-488b-4d2c-9372-8513d9734048'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:00.894632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6c2ed78a-488b-4d2c-9372-8513d9734048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4f10a7a4a942d0943120e62aea823d', 'request_id': 'req-6c2ed78a-488b-4d2c-9372-8513d9734048'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:00.901209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6c2ed78a-488b-4d2c-9372-8513d9734048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4f10a7a4a942d0943120e62aea823d', 'request_id': 'req-6c2ed78a-488b-4d2c-9372-8513d9734048'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:01.010794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6c2ed78a-488b-4d2c-9372-8513d9734048 admin admin] The token cache is being invalidate because project cd4f10a7a4a942d0943120e62aea823d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:01.011508 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6c2ed78a-488b-4d2c-9372-8513d9734048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:01.011901 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6c2ed78a-488b-4d2c-9372-8513d9734048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:01.013467 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1319/2630] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:00 2022] DELETE /identity/v3/projects/cd4f10a7a4a942d0943120e62aea823d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:17:01.018592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64298589-dcc9-4270-9aea-69dd5ef4b4c7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:01.018890 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64298589-dcc9-4270-9aea-69dd5ef4b4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:01.019212 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64298589-dcc9-4270-9aea-69dd5ef4b4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:01.039137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-64298589-dcc9-4270-9aea-69dd5ef4b4c7 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:01.040371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-64298589-dcc9-4270-9aea-69dd5ef4b4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:01.099928 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1312/2631] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:01.108331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672344a3-f0da-46fa-955b-ea705e60dc94 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:01.108616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672344a3-f0da-46fa-955b-ea705e60dc94 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:01.108943 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672344a3-f0da-46fa-955b-ea705e60dc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:01.128231 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-672344a3-f0da-46fa-955b-ea705e60dc94 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:01.129417 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-672344a3-f0da-46fa-955b-ea705e60dc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:01.138403 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1320/2632] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:01.142702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64298589-dcc9-4270-9aea-69dd5ef4b4c7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:01.162104 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64298589-dcc9-4270-9aea-69dd5ef4b4c7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:01.167999 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17c646-283e-4dab-8caa-f7ed52e15823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:01.168789 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17c646-283e-4dab-8caa-f7ed52e15823 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:01.169068 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17c646-283e-4dab-8caa-f7ed52e15823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:01.169339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17c646-283e-4dab-8caa-f7ed52e15823 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:01.170057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17c646-283e-4dab-8caa-f7ed52e15823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:17:01.170358 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17c646-283e-4dab-8caa-f7ed52e15823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:01.172002 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17c646-283e-4dab-8caa-f7ed52e15823 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:01.184752 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1313/2633] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:17:01.189629 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672344a3-f0da-46fa-955b-ea705e60dc94 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:01.198782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672344a3-f0da-46fa-955b-ea705e60dc94 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:01.203944 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd751b-b539-4e9e-8230-746fbdc6b8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:01.204665 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd751b-b539-4e9e-8230-746fbdc6b8fe admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:01.205007 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd751b-b539-4e9e-8230-746fbdc6b8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:01.205349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd751b-b539-4e9e-8230-746fbdc6b8fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:01.206133 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd751b-b539-4e9e-8230-746fbdc6b8fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:01.208107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd751b-b539-4e9e-8230-746fbdc6b8fe admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:01.352222 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1321/2634] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:17:01 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:01.353721 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17c646-283e-4dab-8caa-f7ed52e15823 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:01.363853 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17c646-283e-4dab-8caa-f7ed52e15823 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:01.380470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd751b-b539-4e9e-8230-746fbdc6b8fe admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:01.383070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-48bd751b-b539-4e9e-8230-746fbdc6b8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:01.424344 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914c29-7a9a-4212-adf8-f358476013b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:01.425073 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914c29-7a9a-4212-adf8-f358476013b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:01.425314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914c29-7a9a-4212-adf8-f358476013b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:01.425593 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914c29-7a9a-4212-adf8-f358476013b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:01.426303 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c914c29-7a9a-4212-adf8-f358476013b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:01.428266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c914c29-7a9a-4212-adf8-f358476013b6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:01.455772 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd751b-b539-4e9e-8230-746fbdc6b8fe admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:01.460405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b861a-723c-4339-ac8d-ab364664bbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:01.461869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b861a-723c-4339-ac8d-ab364664bbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:01.462204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b861a-723c-4339-ac8d-ab364664bbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:01.462477 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b861a-723c-4339-ac8d-ab364664bbe3 admin admin] PATH_INFO: `/v3/projects/652a63b036f949e2b22710ef40e2f162` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:01.463689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b861a-723c-4339-ac8d-ab364664bbe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=652a63b036f949e2b22710ef40e2f162)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:01.469624 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b861a-723c-4339-ac8d-ab364664bbe3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:01.523762 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1314/2635] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:17:01 2022] POST /identity/v3/users => generated 281 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:01.527848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914c29-7a9a-4212-adf8-f358476013b6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:01.537388 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914c29-7a9a-4212-adf8-f358476013b6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:01.542755 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cad58-00e1-445f-bfcf-09ecd742c586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:01.543440 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cad58-00e1-445f-bfcf-09ecd742c586 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:01.543722 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cad58-00e1-445f-bfcf-09ecd742c586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:01.543999 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cad58-00e1-445f-bfcf-09ecd742c586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:01.544718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cad58-00e1-445f-bfcf-09ecd742c586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:01.546300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cad58-00e1-445f-bfcf-09ecd742c586 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:01.556281 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1315/2636] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:17:01.559907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cad58-00e1-445f-bfcf-09ecd742c586 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:01.569337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cad58-00e1-445f-bfcf-09ecd742c586 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:01.574077 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b271627-ae84-4355-b7b5-21d3e83e0bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:01.574707 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b271627-ae84-4355-b7b5-21d3e83e0bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:01.574988 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b271627-ae84-4355-b7b5-21d3e83e0bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:01.575295 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b271627-ae84-4355-b7b5-21d3e83e0bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:01.576012 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b271627-ae84-4355-b7b5-21d3e83e0bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:01.577586 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b271627-ae84-4355-b7b5-21d3e83e0bc7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:01.586112 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2d7b861a-723c-4339-ac8d-ab364664bbe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652a63b036f949e2b22710ef40e2f162', 'request_id': 'req-2d7b861a-723c-4339-ac8d-ab364664bbe3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:01.588514 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1316/2637] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:17:01.592658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b271627-ae84-4355-b7b5-21d3e83e0bc7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:01.592974 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2d7b861a-723c-4339-ac8d-ab364664bbe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652a63b036f949e2b22710ef40e2f162', 'request_id': 'req-2d7b861a-723c-4339-ac8d-ab364664bbe3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:01.598659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2d7b861a-723c-4339-ac8d-ab364664bbe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652a63b036f949e2b22710ef40e2f162', 'request_id': 'req-2d7b861a-723c-4339-ac8d-ab364664bbe3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:01.609512 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b271627-ae84-4355-b7b5-21d3e83e0bc7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:01.656806 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75685ba1-bc09-402d-955a-5d50aa7e0614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:01.657712 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75685ba1-bc09-402d-955a-5d50aa7e0614 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:01.657994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75685ba1-bc09-402d-955a-5d50aa7e0614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:01.658268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75685ba1-bc09-402d-955a-5d50aa7e0614 admin admin] PATH_INFO: `/v3/projects/af81c77f06234851bcb62c014e9fbbe0/users/5c3deb4742fd456386bea35109c1fe33/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:01.673426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75685ba1-bc09-402d-955a-5d50aa7e0614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af81c77f06234851bcb62c014e9fbbe0, user_id=5c3deb4742fd456386bea35109c1fe33, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:01.676223 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75685ba1-bc09-402d-955a-5d50aa7e0614 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:01.706273 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2d7b861a-723c-4339-ac8d-ab364664bbe3 admin admin] The token cache is being invalidate because project 652a63b036f949e2b22710ef40e2f162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:01.706557 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2d7b861a-723c-4339-ac8d-ab364664bbe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:01.707214 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2d7b861a-723c-4339-ac8d-ab364664bbe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:01.708760 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1322/2638] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:01 2022] DELETE /identity/v3/projects/652a63b036f949e2b22710ef40e2f162 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:17:01.713893 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f0947-4a54-4cf4-b45a-8aec1a776187 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:01.714189 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f0947-4a54-4cf4-b45a-8aec1a776187 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:01.714468 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f0947-4a54-4cf4-b45a-8aec1a776187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:01.732371 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-294f0947-4a54-4cf4-b45a-8aec1a776187 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:01.733560 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-294f0947-4a54-4cf4-b45a-8aec1a776187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:01.741513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1323/2639] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:17:01.749318 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28701b0-419a-4809-a42a-6b1e75f708fc None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:01.749607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28701b0-419a-4809-a42a-6b1e75f708fc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:01.749888 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28701b0-419a-4809-a42a-6b1e75f708fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:01.767632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a28701b0-419a-4809-a42a-6b1e75f708fc None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:01.769765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a28701b0-419a-4809-a42a-6b1e75f708fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:01.777283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1324/2640] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:01.781292 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28701b0-419a-4809-a42a-6b1e75f708fc None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:01.790569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28701b0-419a-4809-a42a-6b1e75f708fc None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:01.792994 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1317/2641] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:01 2022] PUT /identity/v3/projects/af81c77f06234851bcb62c014e9fbbe0/users/5c3deb4742fd456386bea35109c1fe33/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:17:01.805427 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d948c-ab0c-49d0-a9d8-2e9e202c3153 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:01.806004 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d948c-ab0c-49d0-a9d8-2e9e202c3153 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:01.806441 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d948c-ab0c-49d0-a9d8-2e9e202c3153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:01.839782 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8e6d948c-ab0c-49d0-a9d8-2e9e202c3153 None None] MFA Rules not processed for user `5c3deb4742fd456386bea35109c1fe33`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:01.840982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e6d948c-ab0c-49d0-a9d8-2e9e202c3153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:01.859051 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2171c75-2c0a-443a-bbd2-0b1aabcb22d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:01.859794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2171c75-2c0a-443a-bbd2-0b1aabcb22d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:01.860162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2171c75-2c0a-443a-bbd2-0b1aabcb22d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:01.860389 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2171c75-2c0a-443a-bbd2-0b1aabcb22d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:01.861119 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2171c75-2c0a-443a-bbd2-0b1aabcb22d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:17:01.861426 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2171c75-2c0a-443a-bbd2-0b1aabcb22d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:01.863254 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2171c75-2c0a-443a-bbd2-0b1aabcb22d7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:01.878743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1325/2642] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:17:01.879844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2171c75-2c0a-443a-bbd2-0b1aabcb22d7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:01.890481 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2171c75-2c0a-443a-bbd2-0b1aabcb22d7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:01.899205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cd8ab-1ff9-4777-aea0-9575a7147557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:01.899205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cd8ab-1ff9-4777-aea0-9575a7147557 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:01.899205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cd8ab-1ff9-4777-aea0-9575a7147557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:01.899205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cd8ab-1ff9-4777-aea0-9575a7147557 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:01.899566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cd8ab-1ff9-4777-aea0-9575a7147557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:01.899734 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cd8ab-1ff9-4777-aea0-9575a7147557 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:01.907382 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1318/2643] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:17:01.941256 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d948c-ab0c-49d0-a9d8-2e9e202c3153 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:01.942685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e6d948c-ab0c-49d0-a9d8-2e9e202c3153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:01.994621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1326/2644] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:17:01 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:01.998821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cd8ab-1ff9-4777-aea0-9575a7147557 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:02.000224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d948c-ab0c-49d0-a9d8-2e9e202c3153 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:02.049700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2dab88-65dd-470d-9f95-79972d5eaa23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:02.050357 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2dab88-65dd-470d-9f95-79972d5eaa23 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:02.050661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2dab88-65dd-470d-9f95-79972d5eaa23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:02.051067 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2dab88-65dd-470d-9f95-79972d5eaa23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:02.060271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cd8ab-1ff9-4777-aea0-9575a7147557 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:02.066115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a6979-9735-4480-8d65-f64c638d1402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:02.066793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a6979-9735-4480-8d65-f64c638d1402 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:02.067061 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a6979-9735-4480-8d65-f64c638d1402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:02.067390 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a6979-9735-4480-8d65-f64c638d1402 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:02.068061 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a6979-9735-4480-8d65-f64c638d1402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:02.071059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a6979-9735-4480-8d65-f64c638d1402 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:02.111491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2dab88-65dd-470d-9f95-79972d5eaa23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:02.112851 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2dab88-65dd-470d-9f95-79972d5eaa23 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:02.122765 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1319/2645] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:17:02.138735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2dab88-65dd-470d-9f95-79972d5eaa23 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:02.140091 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cc2dab88-65dd-470d-9f95-79972d5eaa23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:02.154101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2dab88-65dd-470d-9f95-79972d5eaa23 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:02.159808 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1119771-bf9b-4715-96bb-98d9a243d4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:02.160685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1119771-bf9b-4715-96bb-98d9a243d4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:02.160970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1119771-bf9b-4715-96bb-98d9a243d4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:02.161248 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1119771-bf9b-4715-96bb-98d9a243d4bc admin admin] PATH_INFO: `/v3/users/5c3deb4742fd456386bea35109c1fe33` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:02.162491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1119771-bf9b-4715-96bb-98d9a243d4bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3deb4742fd456386bea35109c1fe33)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:02.164711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1327/2646] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:17:01 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:17:02.167233 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1119771-bf9b-4715-96bb-98d9a243d4bc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:02.168910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a6979-9735-4480-8d65-f64c638d1402 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:02.180423 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a6979-9735-4480-8d65-f64c638d1402 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:02.185656 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c27d9-b217-42b8-9c65-c42af1e41fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:02.186316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c27d9-b217-42b8-9c65-c42af1e41fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:02.186603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c27d9-b217-42b8-9c65-c42af1e41fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:02.186878 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c27d9-b217-42b8-9c65-c42af1e41fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:02.187912 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c27d9-b217-42b8-9c65-c42af1e41fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:02.189501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c27d9-b217-42b8-9c65-c42af1e41fa9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:02.202252 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1328/2647] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:17:02.206322 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c27d9-b217-42b8-9c65-c42af1e41fa9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:02.216128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c27d9-b217-42b8-9c65-c42af1e41fa9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:02.220863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8829d-da85-44b9-88ae-a96d883f4c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:02.221516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8829d-da85-44b9-88ae-a96d883f4c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:02.221802 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8829d-da85-44b9-88ae-a96d883f4c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:02.222078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8829d-da85-44b9-88ae-a96d883f4c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:02.222797 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8829d-da85-44b9-88ae-a96d883f4c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:02.224424 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8829d-da85-44b9-88ae-a96d883f4c66 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:02.235059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1329/2648] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:02.239249 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8829d-da85-44b9-88ae-a96d883f4c66 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:02.249517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8829d-da85-44b9-88ae-a96d883f4c66 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:02.254368 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbae9cc-7e63-4875-b7a6-1f6b4ffce569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:02.255320 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbae9cc-7e63-4875-b7a6-1f6b4ffce569 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:02.255603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbae9cc-7e63-4875-b7a6-1f6b4ffce569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:02.255879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbae9cc-7e63-4875-b7a6-1f6b4ffce569 admin admin] PATH_INFO: `/v3/projects/5786c7f0737c471dba4c52eaacd7bdbf/users/c53de572c34646eaaddbc570393369ef/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:02.273575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbae9cc-7e63-4875-b7a6-1f6b4ffce569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5786c7f0737c471dba4c52eaacd7bdbf, user_id=c53de572c34646eaaddbc570393369ef, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:02.276512 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbae9cc-7e63-4875-b7a6-1f6b4ffce569 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:02.393411 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b1119771-bf9b-4715-96bb-98d9a243d4bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3deb4742fd456386bea35109c1fe33'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:02.405035 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b1119771-bf9b-4715-96bb-98d9a243d4bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3deb4742fd456386bea35109c1fe33'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:02.405701 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b1119771-bf9b-4715-96bb-98d9a243d4bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3deb4742fd456386bea35109c1fe33'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:02.422343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1330/2649] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:02 2022] PUT /identity/v3/projects/5786c7f0737c471dba4c52eaacd7bdbf/users/c53de572c34646eaaddbc570393369ef/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:17:02.434708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301af0-8c9d-430b-9756-c354c9236ba2 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:02.434988 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301af0-8c9d-430b-9756-c354c9236ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:02.435307 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301af0-8c9d-430b-9756-c354c9236ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:02.462147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d0301af0-8c9d-430b-9756-c354c9236ba2 None None] MFA Rules not processed for user `c53de572c34646eaaddbc570393369ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:02.463399 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d0301af0-8c9d-430b-9756-c354c9236ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:02.526702 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1331/2650] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:17:02.531094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301af0-8c9d-430b-9756-c354c9236ba2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:02.532454 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d0301af0-8c9d-430b-9756-c354c9236ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:02.546698 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b1119771-bf9b-4715-96bb-98d9a243d4bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3deb4742fd456386bea35109c1fe33'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:02.547640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b1119771-bf9b-4715-96bb-98d9a243d4bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3deb4742fd456386bea35109c1fe33'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:02.562438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1320/2651] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:17:02 2022] DELETE /identity/v3/users/5c3deb4742fd456386bea35109c1fe33 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:17:02.567086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93bef1-d0c7-4ecd-bde3-cf24d164e956 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:02.567638 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93bef1-d0c7-4ecd-bde3-cf24d164e956 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:02.567921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93bef1-d0c7-4ecd-bde3-cf24d164e956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:02.586856 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1a93bef1-d0c7-4ecd-bde3-cf24d164e956 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:02.588159 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1a93bef1-d0c7-4ecd-bde3-cf24d164e956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:02.604171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301af0-8c9d-430b-9756-c354c9236ba2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:02.653475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1321/2652] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:02.660825 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93bef1-d0c7-4ecd-bde3-cf24d164e956 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:02.662350 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1a93bef1-d0c7-4ecd-bde3-cf24d164e956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:02.673348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824cdcc-b928-4d26-b70d-8ed87c1df4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:02.674228 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824cdcc-b928-4d26-b70d-8ed87c1df4e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:02.674576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824cdcc-b928-4d26-b70d-8ed87c1df4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:02.675415 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824cdcc-b928-4d26-b70d-8ed87c1df4e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:02.675847 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824cdcc-b928-4d26-b70d-8ed87c1df4e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:02.677749 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824cdcc-b928-4d26-b70d-8ed87c1df4e6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:02.724811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93bef1-d0c7-4ecd-bde3-cf24d164e956 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:02.729175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257d594-b083-408a-b663-9bf74ff2aaad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:02.729822 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257d594-b083-408a-b663-9bf74ff2aaad service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:02.730101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257d594-b083-408a-b663-9bf74ff2aaad service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:02.730372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257d594-b083-408a-b663-9bf74ff2aaad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:02.739372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257d594-b083-408a-b663-9bf74ff2aaad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:02.740799 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257d594-b083-408a-b663-9bf74ff2aaad service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:02.750728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1322/2653] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:02.817933 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1332/2654] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:17:02 2022] POST /identity/v3/projects => generated 375 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:17:02.822244 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257d594-b083-408a-b663-9bf74ff2aaad service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:02.832040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257d594-b083-408a-b663-9bf74ff2aaad service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:02.894835 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfe65c-d3ec-443a-b8e4-eb88163d0f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:02.895607 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfe65c-d3ec-443a-b8e4-eb88163d0f5c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:02.895607 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfe65c-d3ec-443a-b8e4-eb88163d0f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:02.895881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfe65c-d3ec-443a-b8e4-eb88163d0f5c admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:02.896573 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfe65c-d3ec-443a-b8e4-eb88163d0f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:02.899277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfe65c-d3ec-443a-b8e4-eb88163d0f5c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:02.998017 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1323/2655] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:17:02 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:03.006869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824cdcc-b928-4d26-b70d-8ed87c1df4e6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:03.018150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824cdcc-b928-4d26-b70d-8ed87c1df4e6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:03.024564 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfea729-ca68-4651-a0c6-16822842534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:03.025316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfea729-ca68-4651-a0c6-16822842534b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:03.027193 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfea729-ca68-4651-a0c6-16822842534b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:03.027193 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfea729-ca68-4651-a0c6-16822842534b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:03.027193 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfea729-ca68-4651-a0c6-16822842534b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:03.028348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfea729-ca68-4651-a0c6-16822842534b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:03.040348 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1333/2656] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:03.044377 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfe65c-d3ec-443a-b8e4-eb88163d0f5c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:03.054804 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfe65c-d3ec-443a-b8e4-eb88163d0f5c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:03.060359 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dc846-53a0-4d63-a626-6ea076b4ec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:03.061100 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dc846-53a0-4d63-a626-6ea076b4ec48 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:03.061453 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dc846-53a0-4d63-a626-6ea076b4ec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:03.061798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dc846-53a0-4d63-a626-6ea076b4ec48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:03.062989 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dc846-53a0-4d63-a626-6ea076b4ec48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:03.064895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dc846-53a0-4d63-a626-6ea076b4ec48 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:03.075037 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1324/2657] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:17:03.079577 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfea729-ca68-4651-a0c6-16822842534b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:03.093125 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfea729-ca68-4651-a0c6-16822842534b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:03.099621 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93202c05-8ecb-4600-b72c-cb95486d3ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:03.100501 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93202c05-8ecb-4600-b72c-cb95486d3ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:03.100785 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93202c05-8ecb-4600-b72c-cb95486d3ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:03.101757 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93202c05-8ecb-4600-b72c-cb95486d3ad9 admin admin] PATH_INFO: `/v3/projects/38f5c0c595df487996215d97cd8515d2/users/e04fa19bb6b84c8f8761490a87f65572/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:03.142148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93202c05-8ecb-4600-b72c-cb95486d3ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f5c0c595df487996215d97cd8515d2, user_id=e04fa19bb6b84c8f8761490a87f65572, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:03.145285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93202c05-8ecb-4600-b72c-cb95486d3ad9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:03.221040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dc846-53a0-4d63-a626-6ea076b4ec48 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:03.222820 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e61dc846-53a0-4d63-a626-6ea076b4ec48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:03.237163 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dc846-53a0-4d63-a626-6ea076b4ec48 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:03.242051 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66503f7a-4248-4de9-a7b7-b311b7ac3315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:03.242917 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66503f7a-4248-4de9-a7b7-b311b7ac3315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:03.243277 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66503f7a-4248-4de9-a7b7-b311b7ac3315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:03.243557 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66503f7a-4248-4de9-a7b7-b311b7ac3315 admin admin] PATH_INFO: `/v3/projects/af81c77f06234851bcb62c014e9fbbe0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:03.244738 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66503f7a-4248-4de9-a7b7-b311b7ac3315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af81c77f06234851bcb62c014e9fbbe0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:03.246651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66503f7a-4248-4de9-a7b7-b311b7ac3315 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:03.275465 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1334/2658] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:03 2022] PUT /identity/v3/projects/38f5c0c595df487996215d97cd8515d2/users/e04fa19bb6b84c8f8761490a87f65572/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:17:03.277990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6ea55-fe73-41e8-975c-1273f1131950 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:03.278287 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6ea55-fe73-41e8-975c-1273f1131950 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:03.278573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6ea55-fe73-41e8-975c-1273f1131950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:03.306457 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-89b6ea55-fe73-41e8-975c-1273f1131950 None None] MFA Rules not processed for user `e04fa19bb6b84c8f8761490a87f65572`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:03.307740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-89b6ea55-fe73-41e8-975c-1273f1131950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:03.426380 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-66503f7a-4248-4de9-a7b7-b311b7ac3315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af81c77f06234851bcb62c014e9fbbe0', 'request_id': 'req-66503f7a-4248-4de9-a7b7-b311b7ac3315'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:03.446921 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1335/2659] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:03.451676 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6ea55-fe73-41e8-975c-1273f1131950 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:03.542263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6ea55-fe73-41e8-975c-1273f1131950 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:03.564747 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-66503f7a-4248-4de9-a7b7-b311b7ac3315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af81c77f06234851bcb62c014e9fbbe0', 'request_id': 'req-66503f7a-4248-4de9-a7b7-b311b7ac3315'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:03.575655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-66503f7a-4248-4de9-a7b7-b311b7ac3315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af81c77f06234851bcb62c014e9fbbe0', 'request_id': 'req-66503f7a-4248-4de9-a7b7-b311b7ac3315'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:03.593058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-66503f7a-4248-4de9-a7b7-b311b7ac3315 admin admin] The token cache is being invalidate because project af81c77f06234851bcb62c014e9fbbe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:03.593695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-66503f7a-4248-4de9-a7b7-b311b7ac3315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:03.595139 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-66503f7a-4248-4de9-a7b7-b311b7ac3315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:03.599155 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1325/2660] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:03 2022] DELETE /identity/v3/projects/af81c77f06234851bcb62c014e9fbbe0 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:17:03.604268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe8453-ce0e-4b85-95cd-a947875e8984 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:03.604268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe8453-ce0e-4b85-95cd-a947875e8984 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:03.604564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe8453-ce0e-4b85-95cd-a947875e8984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:03.628551 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0233e-8b44-4428-ab16-4cbbd9db606e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:03.629658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0233e-8b44-4428-ab16-4cbbd9db606e admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:03.629807 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9cfe8453-ce0e-4b85-95cd-a947875e8984 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:03.630242 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0233e-8b44-4428-ab16-4cbbd9db606e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:03.630687 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0233e-8b44-4428-ab16-4cbbd9db606e admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:03.631718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0233e-8b44-4428-ab16-4cbbd9db606e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:03.631930 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9cfe8453-ce0e-4b85-95cd-a947875e8984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:03.634209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0233e-8b44-4428-ab16-4cbbd9db606e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:03.644606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1326/2661] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:17:03.654814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2955f9-0848-4d3b-9843-89a29403aeef None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:03.655290 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2955f9-0848-4d3b-9843-89a29403aeef None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:03.655573 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2955f9-0848-4d3b-9843-89a29403aeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:03.682779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6e2955f9-0848-4d3b-9843-89a29403aeef None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:03.684188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6e2955f9-0848-4d3b-9843-89a29403aeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:03.700694 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1327/2662] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:17:03.704689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2955f9-0848-4d3b-9843-89a29403aeef None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:03.714733 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2955f9-0848-4d3b-9843-89a29403aeef None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:03.719619 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a81859-e63a-44ff-a37d-030362f6b26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:03.720278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a81859-e63a-44ff-a37d-030362f6b26e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:03.720685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a81859-e63a-44ff-a37d-030362f6b26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:03.720963 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a81859-e63a-44ff-a37d-030362f6b26e admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:03.721694 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a81859-e63a-44ff-a37d-030362f6b26e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:17:03.721988 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a81859-e63a-44ff-a37d-030362f6b26e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:03.728881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a81859-e63a-44ff-a37d-030362f6b26e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:03.732160 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1336/2663] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:17:03 2022] POST /identity/v3/projects => generated 377 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:03.736290 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0233e-8b44-4428-ab16-4cbbd9db606e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:03.739979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bdd0233e-8b44-4428-ab16-4cbbd9db606e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:03.744085 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1328/2664] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:17:03.745110 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a81859-e63a-44ff-a37d-030362f6b26e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:03.754776 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a81859-e63a-44ff-a37d-030362f6b26e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:03.815357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0233e-8b44-4428-ab16-4cbbd9db606e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:03.822555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a53a3-6dad-4ed8-8844-2df889dc028b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:03.823356 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a53a3-6dad-4ed8-8844-2df889dc028b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:03.823695 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a53a3-6dad-4ed8-8844-2df889dc028b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:03.824028 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a53a3-6dad-4ed8-8844-2df889dc028b admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:03.824829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a53a3-6dad-4ed8-8844-2df889dc028b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:03.826345 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678750e-9e67-43ed-932a-8f9cb1da15ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:03.827606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678750e-9e67-43ed-932a-8f9cb1da15ce admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:03.827817 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a53a3-6dad-4ed8-8844-2df889dc028b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:03.828119 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678750e-9e67-43ed-932a-8f9cb1da15ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:03.828404 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678750e-9e67-43ed-932a-8f9cb1da15ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:03.829160 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678750e-9e67-43ed-932a-8f9cb1da15ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:03.831160 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678750e-9e67-43ed-932a-8f9cb1da15ce admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:03.909912 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1337/2665] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:17:03 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:17:03.910986 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a53a3-6dad-4ed8-8844-2df889dc028b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:03.921449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a53a3-6dad-4ed8-8844-2df889dc028b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:03.926180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c4ea1-b4b6-479a-a47f-70295702dd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:03.926827 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c4ea1-b4b6-479a-a47f-70295702dd2e admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:03.927152 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c4ea1-b4b6-479a-a47f-70295702dd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:03.927445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c4ea1-b4b6-479a-a47f-70295702dd2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:03.928261 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c4ea1-b4b6-479a-a47f-70295702dd2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:03.931405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c4ea1-b4b6-479a-a47f-70295702dd2e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:03.941938 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1338/2666] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:17:03.960631 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c4ea1-b4b6-479a-a47f-70295702dd2e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:03.973147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c4ea1-b4b6-479a-a47f-70295702dd2e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:03.979260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f86d2e-067e-4405-be6b-d8e9a63bfd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:03.995004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f86d2e-067e-4405-be6b-d8e9a63bfd33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:03.995004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f86d2e-067e-4405-be6b-d8e9a63bfd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:03.995004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f86d2e-067e-4405-be6b-d8e9a63bfd33 admin admin] PATH_INFO: `/v3/projects/6dd66f286d364b80bec82275d562cba1/users/991726d4c2fc4fcd82f8b3d609be7275/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:03.996451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1329/2667] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:17:03 2022] POST /identity/v3/projects => generated 369 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:03.997979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678750e-9e67-43ed-932a-8f9cb1da15ce admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:03.998771 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f86d2e-067e-4405-be6b-d8e9a63bfd33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd66f286d364b80bec82275d562cba1, user_id=991726d4c2fc4fcd82f8b3d609be7275, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:04.001852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f86d2e-067e-4405-be6b-d8e9a63bfd33 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:04.066965 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678750e-9e67-43ed-932a-8f9cb1da15ce admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:04.073356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8a681-7818-40e2-a246-49e6eb76703a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:04.074115 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8a681-7818-40e2-a246-49e6eb76703a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:04.074461 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8a681-7818-40e2-a246-49e6eb76703a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:04.074969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8a681-7818-40e2-a246-49e6eb76703a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:04.075797 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8a681-7818-40e2-a246-49e6eb76703a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:04.077717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8a681-7818-40e2-a246-49e6eb76703a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:04.086133 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1339/2668] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:03 2022] PUT /identity/v3/projects/6dd66f286d364b80bec82275d562cba1/users/991726d4c2fc4fcd82f8b3d609be7275/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:17:04.089535 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f86d2e-067e-4405-be6b-d8e9a63bfd33 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:04.090417 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-20f86d2e-067e-4405-be6b-d8e9a63bfd33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:04.160079 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f86d2e-067e-4405-be6b-d8e9a63bfd33 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:04.165933 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717175b9-fd69-4b0a-a33b-18e82d4cef4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cbd89f9b7a24b6cb993ca86e964c54d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:04.166586 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717175b9-fd69-4b0a-a33b-18e82d4cef4b service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:04.166868 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717175b9-fd69-4b0a-a33b-18e82d4cef4b service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:04.167174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717175b9-fd69-4b0a-a33b-18e82d4cef4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:04.168984 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-717175b9-fd69-4b0a-a33b-18e82d4cef4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:04.181804 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717175b9-fd69-4b0a-a33b-18e82d4cef4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:04.183419 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717175b9-fd69-4b0a-a33b-18e82d4cef4b service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:04.193621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1330/2669] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:17:03 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:04.194455 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8a681-7818-40e2-a246-49e6eb76703a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:04.194843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1340/2670] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:04.197486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717175b9-fd69-4b0a-a33b-18e82d4cef4b service placement] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:04.205434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8a681-7818-40e2-a246-49e6eb76703a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:04.274078 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717175b9-fd69-4b0a-a33b-18e82d4cef4b service placement] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:04.276389 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7781940-5b56-45b8-9a43-23aadc0d5251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:04.277138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7781940-5b56-45b8-9a43-23aadc0d5251 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:04.277491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7781940-5b56-45b8-9a43-23aadc0d5251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:04.277839 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7781940-5b56-45b8-9a43-23aadc0d5251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:04.278682 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7781940-5b56-45b8-9a43-23aadc0d5251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:04.279651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023c773-75ec-4b0f-9d43-7d67e1a5f501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:04.280711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023c773-75ec-4b0f-9d43-7d67e1a5f501 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:04.280952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7781940-5b56-45b8-9a43-23aadc0d5251 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:04.281153 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023c773-75ec-4b0f-9d43-7d67e1a5f501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:04.281523 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023c773-75ec-4b0f-9d43-7d67e1a5f501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:04.282339 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023c773-75ec-4b0f-9d43-7d67e1a5f501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:04.284103 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023c773-75ec-4b0f-9d43-7d67e1a5f501 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:04.293209 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1331/2671] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:04.298946 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1341/2672] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:17:04.299098 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7781940-5b56-45b8-9a43-23aadc0d5251 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:04.299976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023c773-75ec-4b0f-9d43-7d67e1a5f501 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:04.309999 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7781940-5b56-45b8-9a43-23aadc0d5251 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:04.312167 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023c773-75ec-4b0f-9d43-7d67e1a5f501 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:04.316108 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4134c32-964e-4a5a-bb5d-05395b4a81dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:04.317138 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4134c32-964e-4a5a-bb5d-05395b4a81dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:04.317426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4134c32-964e-4a5a-bb5d-05395b4a81dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:04.317545 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f93af-41e4-4d85-9396-9715dc51ecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:04.317746 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4134c32-964e-4a5a-bb5d-05395b4a81dd admin admin] PATH_INFO: `/v3/projects/6dd66f286d364b80bec82275d562cba1/users/991726d4c2fc4fcd82f8b3d609be7275/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:04.318100 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f93af-41e4-4d85-9396-9715dc51ecfc admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:04.318386 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f93af-41e4-4d85-9396-9715dc51ecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:04.318790 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f93af-41e4-4d85-9396-9715dc51ecfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:04.319557 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f93af-41e4-4d85-9396-9715dc51ecfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:04.319842 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4134c32-964e-4a5a-bb5d-05395b4a81dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd66f286d364b80bec82275d562cba1, user_id=991726d4c2fc4fcd82f8b3d609be7275, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:04.321178 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f93af-41e4-4d85-9396-9715dc51ecfc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:04.331741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4134c32-964e-4a5a-bb5d-05395b4a81dd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:04.332539 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1342/2673] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:04.337589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f93af-41e4-4d85-9396-9715dc51ecfc admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:04.347793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f93af-41e4-4d85-9396-9715dc51ecfc admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:04.348293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1332/2674] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:04 2022] PUT /identity/v3/projects/6dd66f286d364b80bec82275d562cba1/users/991726d4c2fc4fcd82f8b3d609be7275/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:04.359660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384195e-eca3-4cda-9ca0-20fec6bded71 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:04.359953 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384195e-eca3-4cda-9ca0-20fec6bded71 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:04.360229 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384195e-eca3-4cda-9ca0-20fec6bded71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:04.387259 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e384195e-eca3-4cda-9ca0-20fec6bded71 None None] MFA Rules not processed for user `991726d4c2fc4fcd82f8b3d609be7275`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:04.388542 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e384195e-eca3-4cda-9ca0-20fec6bded71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:04.409349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665285b-6b92-4ace-afd4-91ee9fb0f934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:04.410291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665285b-6b92-4ace-afd4-91ee9fb0f934 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:04.410578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665285b-6b92-4ace-afd4-91ee9fb0f934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:04.410860 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665285b-6b92-4ace-afd4-91ee9fb0f934 admin admin] PATH_INFO: `/v3/projects/ca03fe99c55a49cc8c965679f9003575/users/21ea798de9b6493895851b3aedbb40ca/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:04.427406 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665285b-6b92-4ace-afd4-91ee9fb0f934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca03fe99c55a49cc8c965679f9003575, user_id=21ea798de9b6493895851b3aedbb40ca, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:04.430094 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665285b-6b92-4ace-afd4-91ee9fb0f934 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:04.477413 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1333/2675] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:04.487430 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384195e-eca3-4cda-9ca0-20fec6bded71 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:04.488971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e384195e-eca3-4cda-9ca0-20fec6bded71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:04.515953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1343/2676] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:04 2022] PUT /identity/v3/projects/ca03fe99c55a49cc8c965679f9003575/users/21ea798de9b6493895851b3aedbb40ca/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:17:04.519376 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db958217-5ed4-4b05-9a81-9fbdb87b5051 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:04.519919 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db958217-5ed4-4b05-9a81-9fbdb87b5051 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:04.520038 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db958217-5ed4-4b05-9a81-9fbdb87b5051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:04.552321 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-db958217-5ed4-4b05-9a81-9fbdb87b5051 None None] MFA Rules not processed for user `21ea798de9b6493895851b3aedbb40ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:04.553547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-db958217-5ed4-4b05-9a81-9fbdb87b5051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:04.607259 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384195e-eca3-4cda-9ca0-20fec6bded71 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:04.662718 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1344/2677] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:04.667645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9ad36-6bfe-42af-abfb-7f76065d743e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:04.667645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9ad36-6bfe-42af-abfb-7f76065d743e service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:04.667645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9ad36-6bfe-42af-abfb-7f76065d743e service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:04.667645 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9ad36-6bfe-42af-abfb-7f76065d743e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:04.668843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4dd9ad36-6bfe-42af-abfb-7f76065d743e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:04.680824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db958217-5ed4-4b05-9a81-9fbdb87b5051 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:04.683652 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-db958217-5ed4-4b05-9a81-9fbdb87b5051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:04.736402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9ad36-6bfe-42af-abfb-7f76065d743e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:04.736402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9ad36-6bfe-42af-abfb-7f76065d743e service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:04.743979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1334/2678] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:04.750828 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db958217-5ed4-4b05-9a81-9fbdb87b5051 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:04.754569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae8150-d995-4e6b-8273-d0ec70526e1c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68748827b9f14eb7958d5b202c5d6877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:04.755336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae8150-d995-4e6b-8273-d0ec70526e1c service glance] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:04.755550 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae8150-d995-4e6b-8273-d0ec70526e1c service glance] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:04.755908 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae8150-d995-4e6b-8273-d0ec70526e1c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:04.765401 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae8150-d995-4e6b-8273-d0ec70526e1c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:04.766662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae8150-d995-4e6b-8273-d0ec70526e1c service glance] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:04.777451 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1345/2679] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:05.766664 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9ad36-6bfe-42af-abfb-7f76065d743e service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:05.768130 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4dd9ad36-6bfe-42af-abfb-7f76065d743e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:05.838176 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9ad36-6bfe-42af-abfb-7f76065d743e service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:05.844152 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264d16e-aca2-456a-aef2-72038dce341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:05.845042 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264d16e-aca2-456a-aef2-72038dce341b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:05.845327 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264d16e-aca2-456a-aef2-72038dce341b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:05.845603 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264d16e-aca2-456a-aef2-72038dce341b admin admin] PATH_INFO: `/v3/users/96c173585d784a4dae36fe8fabcca0e4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:05.846925 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264d16e-aca2-456a-aef2-72038dce341b admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c173585d784a4dae36fe8fabcca0e4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:05.849765 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264d16e-aca2-456a-aef2-72038dce341b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:06.107706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0264d16e-aca2-456a-aef2-72038dce341b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c173585d784a4dae36fe8fabcca0e4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:06.119257 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0264d16e-aca2-456a-aef2-72038dce341b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c173585d784a4dae36fe8fabcca0e4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:06.119952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0264d16e-aca2-456a-aef2-72038dce341b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c173585d784a4dae36fe8fabcca0e4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:06.207906 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0264d16e-aca2-456a-aef2-72038dce341b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c173585d784a4dae36fe8fabcca0e4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:06.208530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0264d16e-aca2-456a-aef2-72038dce341b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c173585d784a4dae36fe8fabcca0e4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:06.222263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1335/2680] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:17:05 2022] DELETE /identity/v3/users/96c173585d784a4dae36fe8fabcca0e4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:06.227137 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e92925-a472-49ae-a682-5e134e35e034 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:06.227571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e92925-a472-49ae-a682-5e134e35e034 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:06.227654 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e92925-a472-49ae-a682-5e134e35e034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:06.245972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a8e92925-a472-49ae-a682-5e134e35e034 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:06.247230 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a8e92925-a472-49ae-a682-5e134e35e034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:06.315826 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1346/2681] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:06.326036 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264d16e-aca2-456a-aef2-72038dce341b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:06.328496 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0264d16e-aca2-456a-aef2-72038dce341b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:06.390025 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264d16e-aca2-456a-aef2-72038dce341b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:06.393822 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3988b3-5eb8-487f-b3f5-1a96e7374ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:06.394467 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3988b3-5eb8-487f-b3f5-1a96e7374ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:06.394754 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3988b3-5eb8-487f-b3f5-1a96e7374ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:06.395032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3988b3-5eb8-487f-b3f5-1a96e7374ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:06.405009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3988b3-5eb8-487f-b3f5-1a96e7374ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:06.406441 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3988b3-5eb8-487f-b3f5-1a96e7374ca8 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:06.416254 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1336/2682] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:06.851408 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e92925-a472-49ae-a682-5e134e35e034 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:06.852939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a8e92925-a472-49ae-a682-5e134e35e034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:06.865513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e92925-a472-49ae-a682-5e134e35e034 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:06.871305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:06.872438 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:06.883883 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:06.884188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e admin admin] PATH_INFO: `/v3/projects/4faf17e96a0c4d69ac410971d2fbe97c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:06.885551 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4faf17e96a0c4d69ac410971d2fbe97c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:06.891245 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:07.055803 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4faf17e96a0c4d69ac410971d2fbe97c', 'request_id': 'req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:07.058207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3988b3-5eb8-487f-b3f5-1a96e7374ca8 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:07.059719 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6f3988b3-5eb8-487f-b3f5-1a96e7374ca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:07.062455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4faf17e96a0c4d69ac410971d2fbe97c', 'request_id': 'req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:07.068144 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4faf17e96a0c4d69ac410971d2fbe97c', 'request_id': 'req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:07.114486 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3988b3-5eb8-487f-b3f5-1a96e7374ca8 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:07.161762 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e admin admin] The token cache is being invalidate because project 4faf17e96a0c4d69ac410971d2fbe97c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:07.161976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:07.162571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:07.163972 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82aa2be-6ab0-423a-92b4-4875bbc1c86c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:07.164198 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1347/2683] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:06 2022] DELETE /identity/v3/projects/4faf17e96a0c4d69ac410971d2fbe97c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:07.179315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82aa2be-6ab0-423a-92b4-4875bbc1c86c service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:07.179315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82aa2be-6ab0-423a-92b4-4875bbc1c86c service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:07.179315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82aa2be-6ab0-423a-92b4-4875bbc1c86c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:07.179315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b82aa2be-6ab0-423a-92b4-4875bbc1c86c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:07.233835 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82aa2be-6ab0-423a-92b4-4875bbc1c86c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:07.235347 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82aa2be-6ab0-423a-92b4-4875bbc1c86c service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:07.245866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1337/2684] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:17:09.329212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:09.330623 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:09.344254 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d1dd8-5b9a-4d5a-bf6b-5831f7184f2e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:09.347651 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4838ad-1102-4148-ac59-098bdf08e79d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:09.348275 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4838ad-1102-4148-ac59-098bdf08e79d service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:09.348552 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4838ad-1102-4148-ac59-098bdf08e79d service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:09.348823 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4838ad-1102-4148-ac59-098bdf08e79d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:09.350527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5a4838ad-1102-4148-ac59-098bdf08e79d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:09.426536 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4838ad-1102-4148-ac59-098bdf08e79d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:09.428009 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4838ad-1102-4148-ac59-098bdf08e79d service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:09.437970 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1348/2685] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:09.456072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82aa2be-6ab0-423a-92b4-4875bbc1c86c service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:09.457459 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b82aa2be-6ab0-423a-92b4-4875bbc1c86c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:09.512829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82aa2be-6ab0-423a-92b4-4875bbc1c86c service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:09.516388 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fc97d-c25b-4978-9b76-f68cb6ec78ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:09.517022 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fc97d-c25b-4978-9b76-f68cb6ec78ab service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:09.517301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fc97d-c25b-4978-9b76-f68cb6ec78ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:09.517574 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fc97d-c25b-4978-9b76-f68cb6ec78ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:09.519493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-de0fc97d-c25b-4978-9b76-f68cb6ec78ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:09.584470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fc97d-c25b-4978-9b76-f68cb6ec78ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:09.586579 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fc97d-c25b-4978-9b76-f68cb6ec78ab service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:09.596565 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1338/2686] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:13.503175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4838ad-1102-4148-ac59-098bdf08e79d service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:13.503175 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5a4838ad-1102-4148-ac59-098bdf08e79d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:13.518578 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4838ad-1102-4148-ac59-098bdf08e79d service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:13.523691 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a01eb-c2d7-42af-b744-86faf99bb789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:13.524562 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a01eb-c2d7-42af-b744-86faf99bb789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:13.524842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a01eb-c2d7-42af-b744-86faf99bb789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:13.525113 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a01eb-c2d7-42af-b744-86faf99bb789 admin admin] PATH_INFO: `/v3/users/532092f483874f05bc119211b9624492` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:13.526358 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a01eb-c2d7-42af-b744-86faf99bb789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=532092f483874f05bc119211b9624492)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:13.528531 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a01eb-c2d7-42af-b744-86faf99bb789 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:13.785351 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e99a01eb-c2d7-42af-b744-86faf99bb789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532092f483874f05bc119211b9624492'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:13.797467 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e99a01eb-c2d7-42af-b744-86faf99bb789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532092f483874f05bc119211b9624492'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:13.912110 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e99a01eb-c2d7-42af-b744-86faf99bb789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532092f483874f05bc119211b9624492'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:13.912725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e99a01eb-c2d7-42af-b744-86faf99bb789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532092f483874f05bc119211b9624492'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:13.913395 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e99a01eb-c2d7-42af-b744-86faf99bb789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532092f483874f05bc119211b9624492'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:13.926090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1349/2687] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:17:13 2022] DELETE /identity/v3/users/532092f483874f05bc119211b9624492 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:14.226956 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fc97d-c25b-4978-9b76-f68cb6ec78ab service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:14.237361 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fc97d-c25b-4978-9b76-f68cb6ec78ab service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:14.300835 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31617dc-7e96-49d4-8530-ccbc96c457b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:14.303060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31617dc-7e96-49d4-8530-ccbc96c457b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:14.304540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31617dc-7e96-49d4-8530-ccbc96c457b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:14.305392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31617dc-7e96-49d4-8530-ccbc96c457b9 admin admin] PATH_INFO: `/v3/projects/422158a05bcb44c8917cf1a6408cd7ad` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:14.307726 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31617dc-7e96-49d4-8530-ccbc96c457b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=422158a05bcb44c8917cf1a6408cd7ad)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:14.313106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31617dc-7e96-49d4-8530-ccbc96c457b9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:14.494356 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e31617dc-7e96-49d4-8530-ccbc96c457b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422158a05bcb44c8917cf1a6408cd7ad', 'request_id': 'req-e31617dc-7e96-49d4-8530-ccbc96c457b9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:14.586655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e31617dc-7e96-49d4-8530-ccbc96c457b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422158a05bcb44c8917cf1a6408cd7ad', 'request_id': 'req-e31617dc-7e96-49d4-8530-ccbc96c457b9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:14.592754 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e31617dc-7e96-49d4-8530-ccbc96c457b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422158a05bcb44c8917cf1a6408cd7ad', 'request_id': 'req-e31617dc-7e96-49d4-8530-ccbc96c457b9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:14.605904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e31617dc-7e96-49d4-8530-ccbc96c457b9 admin admin] The token cache is being invalidate because project 422158a05bcb44c8917cf1a6408cd7ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:14.606194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e31617dc-7e96-49d4-8530-ccbc96c457b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:14.606852 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e31617dc-7e96-49d4-8530-ccbc96c457b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:14.608553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1339/2688] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:14 2022] DELETE /identity/v3/projects/422158a05bcb44c8917cf1a6408cd7ad => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:14.613754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5361ad-c853-4569-8c83-dad7bcd8ad9a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:14.614231 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5361ad-c853-4569-8c83-dad7bcd8ad9a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:14.614341 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5361ad-c853-4569-8c83-dad7bcd8ad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:14.628091 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31617dc-7e96-49d4-8530-ccbc96c457b9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:14.629613 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e31617dc-7e96-49d4-8530-ccbc96c457b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:14.633925 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2e5361ad-c853-4569-8c83-dad7bcd8ad9a None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:14.635099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2e5361ad-c853-4569-8c83-dad7bcd8ad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:14.692351 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31617dc-7e96-49d4-8530-ccbc96c457b9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:14.693268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1350/2689] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:14.699669 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc005433-00d1-4839-ba9c-cdba48ab893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:14.700545 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc005433-00d1-4839-ba9c-cdba48ab893d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:14.700828 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc005433-00d1-4839-ba9c-cdba48ab893d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:14.701102 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc005433-00d1-4839-ba9c-cdba48ab893d admin admin] PATH_INFO: `/v3/users/c53de572c34646eaaddbc570393369ef` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:14.701436 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836db04-3248-4089-b876-331d5b34cc44 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:14.701727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836db04-3248-4089-b876-331d5b34cc44 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:14.702001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836db04-3248-4089-b876-331d5b34cc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:14.702315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc005433-00d1-4839-ba9c-cdba48ab893d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c53de572c34646eaaddbc570393369ef)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:14.704294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc005433-00d1-4839-ba9c-cdba48ab893d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:14.720263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5836db04-3248-4089-b876-331d5b34cc44 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:14.721451 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5836db04-3248-4089-b876-331d5b34cc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:14.729987 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1351/2690] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:17:14.734108 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836db04-3248-4089-b876-331d5b34cc44 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:14.743512 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836db04-3248-4089-b876-331d5b34cc44 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:14.748075 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710be0a1-f6bc-4a00-b81b-73f8486d1d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:14.748699 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710be0a1-f6bc-4a00-b81b-73f8486d1d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:14.748988 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710be0a1-f6bc-4a00-b81b-73f8486d1d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:14.749263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710be0a1-f6bc-4a00-b81b-73f8486d1d1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:14.749973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710be0a1-f6bc-4a00-b81b-73f8486d1d1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:17:14.750278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710be0a1-f6bc-4a00-b81b-73f8486d1d1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:14.751892 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710be0a1-f6bc-4a00-b81b-73f8486d1d1c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:14.763136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1352/2691] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 22:17:14.767087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710be0a1-f6bc-4a00-b81b-73f8486d1d1c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:14.776254 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710be0a1-f6bc-4a00-b81b-73f8486d1d1c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:14.780845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572ac4d-6039-4038-b3c1-17d0cb14d8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:14.781444 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572ac4d-6039-4038-b3c1-17d0cb14d8fa admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:14.781725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572ac4d-6039-4038-b3c1-17d0cb14d8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:14.782002 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572ac4d-6039-4038-b3c1-17d0cb14d8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:14.782662 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572ac4d-6039-4038-b3c1-17d0cb14d8fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:14.784644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572ac4d-6039-4038-b3c1-17d0cb14d8fa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:14.878186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1353/2692] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:17:14 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:17:14.882424 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572ac4d-6039-4038-b3c1-17d0cb14d8fa admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:14.931456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc005433-00d1-4839-ba9c-cdba48ab893d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c53de572c34646eaaddbc570393369ef'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:14.943556 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc005433-00d1-4839-ba9c-cdba48ab893d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c53de572c34646eaaddbc570393369ef'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:14.944272 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc005433-00d1-4839-ba9c-cdba48ab893d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c53de572c34646eaaddbc570393369ef'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:14.946507 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572ac4d-6039-4038-b3c1-17d0cb14d8fa admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:14.951349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29ab46-0c22-4dec-9b4c-7315abab76ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:14.952013 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29ab46-0c22-4dec-9b4c-7315abab76ed admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:14.952298 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29ab46-0c22-4dec-9b4c-7315abab76ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:14.952576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29ab46-0c22-4dec-9b4c-7315abab76ed admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:14.953265 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29ab46-0c22-4dec-9b4c-7315abab76ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:14.955199 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29ab46-0c22-4dec-9b4c-7315abab76ed admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:15.026169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc005433-00d1-4839-ba9c-cdba48ab893d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c53de572c34646eaaddbc570393369ef'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:15.026788 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc005433-00d1-4839-ba9c-cdba48ab893d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c53de572c34646eaaddbc570393369ef'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:15.039938 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1340/2693] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:17:14 2022] DELETE /identity/v3/users/c53de572c34646eaaddbc570393369ef => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:17:15.044173 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68763050-05ec-4946-a4b3-38a9afe375de None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:15.044467 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68763050-05ec-4946-a4b3-38a9afe375de None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:15.044750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68763050-05ec-4946-a4b3-38a9afe375de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:15.061580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-68763050-05ec-4946-a4b3-38a9afe375de None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:15.063300 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-68763050-05ec-4946-a4b3-38a9afe375de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:15.095555 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1354/2694] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:17:14 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:17:15.099599 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29ab46-0c22-4dec-9b4c-7315abab76ed admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:15.101749 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cc29ab46-0c22-4dec-9b4c-7315abab76ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:15.113503 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29ab46-0c22-4dec-9b4c-7315abab76ed admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:15.127431 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1341/2695] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:17:15.137533 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68763050-05ec-4946-a4b3-38a9afe375de None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:15.138892 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-68763050-05ec-4946-a4b3-38a9afe375de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:15.169774 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6d3f3-ddb3-437f-9f84-839cc0160987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:15.170445 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d3f3-ddb3-437f-9f84-839cc0160987 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:15.170728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d3f3-ddb3-437f-9f84-839cc0160987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:15.171008 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d3f3-ddb3-437f-9f84-839cc0160987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:15.171773 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6d3f3-ddb3-437f-9f84-839cc0160987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:15.173418 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6d3f3-ddb3-437f-9f84-839cc0160987 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:15.183221 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1355/2696] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:15.187180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6d3f3-ddb3-437f-9f84-839cc0160987 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:15.197493 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6d3f3-ddb3-437f-9f84-839cc0160987 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:15.199009 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68763050-05ec-4946-a4b3-38a9afe375de None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:15.202231 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d22f7-62dd-4101-84e3-6ada03af89c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:15.202614 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3282ca-3a77-463a-a21c-057cbf379eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:15.202903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d22f7-62dd-4101-84e3-6ada03af89c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:15.203220 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d22f7-62dd-4101-84e3-6ada03af89c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:15.203337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3282ca-3a77-463a-a21c-057cbf379eec service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:15.203496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d22f7-62dd-4101-84e3-6ada03af89c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:15.203610 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3282ca-3a77-463a-a21c-057cbf379eec service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:15.203807 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3282ca-3a77-463a-a21c-057cbf379eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:15.204215 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d22f7-62dd-4101-84e3-6ada03af89c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:15.205805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d22f7-62dd-4101-84e3-6ada03af89c6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:15.213501 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3282ca-3a77-463a-a21c-057cbf379eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:15.214909 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3282ca-3a77-463a-a21c-057cbf379eec service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:15.219158 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1356/2697] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:17:15.220059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d22f7-62dd-4101-84e3-6ada03af89c6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:15.224549 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1342/2698] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:17:15.229487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d22f7-62dd-4101-84e3-6ada03af89c6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:15.236294 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81a600-8096-41d7-8baf-d7d4af748848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:15.237253 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81a600-8096-41d7-8baf-d7d4af748848 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:15.238914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81a600-8096-41d7-8baf-d7d4af748848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:15.238914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81a600-8096-41d7-8baf-d7d4af748848 admin admin] PATH_INFO: `/v3/projects/5fe81abec91245bfa2f58ac691f4acf0/users/a57d3e993a2d4dff84e372a061dcf3f8/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:15.254894 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81a600-8096-41d7-8baf-d7d4af748848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe81abec91245bfa2f58ac691f4acf0, user_id=a57d3e993a2d4dff84e372a061dcf3f8, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:15.258297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81a600-8096-41d7-8baf-d7d4af748848 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:15.390953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1357/2699] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:15 2022] PUT /identity/v3/projects/5fe81abec91245bfa2f58ac691f4acf0/users/a57d3e993a2d4dff84e372a061dcf3f8/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:15.401852 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fc087-a7b6-49bf-9305-042c33762cd3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:15.402336 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fc087-a7b6-49bf-9305-042c33762cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:15.402461 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fc087-a7b6-49bf-9305-042c33762cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:15.428035 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-088fc087-a7b6-49bf-9305-042c33762cd3 None None] MFA Rules not processed for user `a57d3e993a2d4dff84e372a061dcf3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:15.429364 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-088fc087-a7b6-49bf-9305-042c33762cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:15.496291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1343/2700] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:15.507615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81a600-8096-41d7-8baf-d7d4af748848 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:15.509353 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7b81a600-8096-41d7-8baf-d7d4af748848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:15.590209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81a600-8096-41d7-8baf-d7d4af748848 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:15.596766 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5e799-3491-424b-bce7-c2648a178764 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:15.597535 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5e799-3491-424b-bce7-c2648a178764 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:15.600156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5e799-3491-424b-bce7-c2648a178764 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:15.600156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5e799-3491-424b-bce7-c2648a178764 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:15.607250 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5e799-3491-424b-bce7-c2648a178764 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:15.609161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5e799-3491-424b-bce7-c2648a178764 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:15.618852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1358/2701] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:17:15.715500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fc087-a7b6-49bf-9305-042c33762cd3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:15.717805 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-088fc087-a7b6-49bf-9305-042c33762cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:15.793471 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fc087-a7b6-49bf-9305-042c33762cd3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:15.798096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fb7df-83dd-4898-8785-f8888e923be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:15.798948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fb7df-83dd-4898-8785-f8888e923be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:15.799268 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fb7df-83dd-4898-8785-f8888e923be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:15.799546 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fb7df-83dd-4898-8785-f8888e923be0 admin admin] PATH_INFO: `/v3/projects/5786c7f0737c471dba4c52eaacd7bdbf` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:15.800718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fb7df-83dd-4898-8785-f8888e923be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5786c7f0737c471dba4c52eaacd7bdbf)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:15.802609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fb7df-83dd-4898-8785-f8888e923be0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:15.930163 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-360fb7df-83dd-4898-8785-f8888e923be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5786c7f0737c471dba4c52eaacd7bdbf', 'request_id': 'req-360fb7df-83dd-4898-8785-f8888e923be0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:16.009403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-360fb7df-83dd-4898-8785-f8888e923be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5786c7f0737c471dba4c52eaacd7bdbf', 'request_id': 'req-360fb7df-83dd-4898-8785-f8888e923be0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:16.017146 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-360fb7df-83dd-4898-8785-f8888e923be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5786c7f0737c471dba4c52eaacd7bdbf', 'request_id': 'req-360fb7df-83dd-4898-8785-f8888e923be0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:16.033785 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-360fb7df-83dd-4898-8785-f8888e923be0 admin admin] The token cache is being invalidate because project 5786c7f0737c471dba4c52eaacd7bdbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:16.034222 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-360fb7df-83dd-4898-8785-f8888e923be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:16.035169 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-360fb7df-83dd-4898-8785-f8888e923be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:16.037480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1344/2702] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:15 2022] DELETE /identity/v3/projects/5786c7f0737c471dba4c52eaacd7bdbf => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:17:16.042770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5e799-3491-424b-bce7-c2648a178764 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:16.073133 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5e799-3491-424b-bce7-c2648a178764 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:16.130485 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060c407-13f2-4e01-b454-b9cf0638de36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:16.131386 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060c407-13f2-4e01-b454-b9cf0638de36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:16.131669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060c407-13f2-4e01-b454-b9cf0638de36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:16.131942 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060c407-13f2-4e01-b454-b9cf0638de36 admin admin] PATH_INFO: `/v3/users/e04fa19bb6b84c8f8761490a87f65572` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:16.133114 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060c407-13f2-4e01-b454-b9cf0638de36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04fa19bb6b84c8f8761490a87f65572)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:16.135011 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060c407-13f2-4e01-b454-b9cf0638de36 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:16.356115 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a060c407-13f2-4e01-b454-b9cf0638de36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04fa19bb6b84c8f8761490a87f65572'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:16.369194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a060c407-13f2-4e01-b454-b9cf0638de36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04fa19bb6b84c8f8761490a87f65572'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:16.428556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a060c407-13f2-4e01-b454-b9cf0638de36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04fa19bb6b84c8f8761490a87f65572'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:16.429370 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a060c407-13f2-4e01-b454-b9cf0638de36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04fa19bb6b84c8f8761490a87f65572'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:16.429982 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a060c407-13f2-4e01-b454-b9cf0638de36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04fa19bb6b84c8f8761490a87f65572'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:16.442891 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1359/2703] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:17:16 2022] DELETE /identity/v3/users/e04fa19bb6b84c8f8761490a87f65572 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:16.880261 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fb7df-83dd-4898-8785-f8888e923be0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:16.881729 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-360fb7df-83dd-4898-8785-f8888e923be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:16.896191 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fb7df-83dd-4898-8785-f8888e923be0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:16.954404 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:16.955291 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:16.955574 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:16.955846 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8 admin admin] PATH_INFO: `/v3/projects/38f5c0c595df487996215d97cd8515d2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:16.957005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f5c0c595df487996215d97cd8515d2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:16.958878 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:17.117806 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f5c0c595df487996215d97cd8515d2', 'request_id': 'req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:17.237600 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f5c0c595df487996215d97cd8515d2', 'request_id': 'req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:17.243731 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f5c0c595df487996215d97cd8515d2', 'request_id': 'req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:17.254517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8 admin admin] The token cache is being invalidate because project 38f5c0c595df487996215d97cd8515d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:17.254803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:17.255421 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:17.257360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1345/2704] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:16 2022] DELETE /identity/v3/projects/38f5c0c595df487996215d97cd8515d2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:17.261387 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060c407-13f2-4e01-b454-b9cf0638de36 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:17.262843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a060c407-13f2-4e01-b454-b9cf0638de36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:17.276375 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060c407-13f2-4e01-b454-b9cf0638de36 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:17.335375 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce3a28-d79a-4a1b-994a-33c4ec0d8e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:17.344156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce3a28-d79a-4a1b-994a-33c4ec0d8e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:17.344156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce3a28-d79a-4a1b-994a-33c4ec0d8e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:17.344156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce3a28-d79a-4a1b-994a-33c4ec0d8e4a admin admin] PATH_INFO: `/v3/users/991726d4c2fc4fcd82f8b3d609be7275` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:17.344156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce3a28-d79a-4a1b-994a-33c4ec0d8e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=991726d4c2fc4fcd82f8b3d609be7275)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:17.344156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce3a28-d79a-4a1b-994a-33c4ec0d8e4a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:17.570807 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b2ce3a28-d79a-4a1b-994a-33c4ec0d8e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991726d4c2fc4fcd82f8b3d609be7275'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:17.582959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b2ce3a28-d79a-4a1b-994a-33c4ec0d8e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991726d4c2fc4fcd82f8b3d609be7275'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:17.664986 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b2ce3a28-d79a-4a1b-994a-33c4ec0d8e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991726d4c2fc4fcd82f8b3d609be7275'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:17.665532 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b2ce3a28-d79a-4a1b-994a-33c4ec0d8e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991726d4c2fc4fcd82f8b3d609be7275'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:17.666128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b2ce3a28-d79a-4a1b-994a-33c4ec0d8e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991726d4c2fc4fcd82f8b3d609be7275'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:17.679288 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1360/2705] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:17:17 2022] DELETE /identity/v3/users/991726d4c2fc4fcd82f8b3d609be7275 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:18.222319 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:18.223741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:18.238862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dbb0e-8c1b-42f4-bc85-3775197889c8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:18.295129 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc6380-ed31-4e15-a96a-c5a5aadad9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:18.296011 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc6380-ed31-4e15-a96a-c5a5aadad9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:18.296290 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc6380-ed31-4e15-a96a-c5a5aadad9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:18.296564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc6380-ed31-4e15-a96a-c5a5aadad9a7 admin admin] PATH_INFO: `/v3/projects/6dd66f286d364b80bec82275d562cba1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:18.297736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc6380-ed31-4e15-a96a-c5a5aadad9a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd66f286d364b80bec82275d562cba1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:18.299660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc6380-ed31-4e15-a96a-c5a5aadad9a7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:18.466063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ebcc6380-ed31-4e15-a96a-c5a5aadad9a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd66f286d364b80bec82275d562cba1', 'request_id': 'req-ebcc6380-ed31-4e15-a96a-c5a5aadad9a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:18.546172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ebcc6380-ed31-4e15-a96a-c5a5aadad9a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd66f286d364b80bec82275d562cba1', 'request_id': 'req-ebcc6380-ed31-4e15-a96a-c5a5aadad9a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:18.552102 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ebcc6380-ed31-4e15-a96a-c5a5aadad9a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd66f286d364b80bec82275d562cba1', 'request_id': 'req-ebcc6380-ed31-4e15-a96a-c5a5aadad9a7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:18.566315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ebcc6380-ed31-4e15-a96a-c5a5aadad9a7 admin admin] The token cache is being invalidate because project 6dd66f286d364b80bec82275d562cba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:18.566649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ebcc6380-ed31-4e15-a96a-c5a5aadad9a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:18.567319 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ebcc6380-ed31-4e15-a96a-c5a5aadad9a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:18.568858 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1346/2706] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:18 2022] DELETE /identity/v3/projects/6dd66f286d364b80bec82275d562cba1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:18.908080 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce3a28-d79a-4a1b-994a-33c4ec0d8e4a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:18.908080 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b2ce3a28-d79a-4a1b-994a-33c4ec0d8e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:18.920083 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce3a28-d79a-4a1b-994a-33c4ec0d8e4a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:18.976584 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1984ccf-268b-4755-aa18-86c416ae7e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:18.977436 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1984ccf-268b-4755-aa18-86c416ae7e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:18.977709 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1984ccf-268b-4755-aa18-86c416ae7e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:18.977981 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1984ccf-268b-4755-aa18-86c416ae7e2e admin admin] PATH_INFO: `/v3/users/a57d3e993a2d4dff84e372a061dcf3f8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:18.979159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1984ccf-268b-4755-aa18-86c416ae7e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57d3e993a2d4dff84e372a061dcf3f8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:18.981054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1984ccf-268b-4755-aa18-86c416ae7e2e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:19.187014 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d1984ccf-268b-4755-aa18-86c416ae7e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57d3e993a2d4dff84e372a061dcf3f8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:19.198825 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d1984ccf-268b-4755-aa18-86c416ae7e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57d3e993a2d4dff84e372a061dcf3f8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:19.266254 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d1984ccf-268b-4755-aa18-86c416ae7e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57d3e993a2d4dff84e372a061dcf3f8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:19.266874 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d1984ccf-268b-4755-aa18-86c416ae7e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57d3e993a2d4dff84e372a061dcf3f8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:19.267517 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d1984ccf-268b-4755-aa18-86c416ae7e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57d3e993a2d4dff84e372a061dcf3f8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:19.280556 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1361/2707] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:17:18 2022] DELETE /identity/v3/users/a57d3e993a2d4dff84e372a061dcf3f8 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:19.285074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86a9b6-45db-41c6-84f6-2c6a93fcb1fc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:19.285570 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86a9b6-45db-41c6-84f6-2c6a93fcb1fc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:19.285673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86a9b6-45db-41c6-84f6-2c6a93fcb1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:19.303093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0b86a9b6-45db-41c6-84f6-2c6a93fcb1fc None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:19.304996 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0b86a9b6-45db-41c6-84f6-2c6a93fcb1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:19.360575 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1347/2708] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:19.371156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1984ccf-268b-4755-aa18-86c416ae7e2e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:19.372528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d1984ccf-268b-4755-aa18-86c416ae7e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:19.427191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1984ccf-268b-4755-aa18-86c416ae7e2e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:19.431659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0497e8-724f-44bb-a58f-321e20cb68f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:19.432304 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0497e8-724f-44bb-a58f-321e20cb68f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:19.432586 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0497e8-724f-44bb-a58f-321e20cb68f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:19.432965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0497e8-724f-44bb-a58f-321e20cb68f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:19.442671 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0497e8-724f-44bb-a58f-321e20cb68f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:19.444941 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0497e8-724f-44bb-a58f-321e20cb68f9 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:19.454581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1362/2709] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:19.837833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86a9b6-45db-41c6-84f6-2c6a93fcb1fc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:19.839372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0b86a9b6-45db-41c6-84f6-2c6a93fcb1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:19.852140 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86a9b6-45db-41c6-84f6-2c6a93fcb1fc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:19.857053 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3167d03-d14d-4be4-b3c1-4817f0474df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:19.857946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3167d03-d14d-4be4-b3c1-4817f0474df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:19.858231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3167d03-d14d-4be4-b3c1-4817f0474df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:19.864151 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3167d03-d14d-4be4-b3c1-4817f0474df5 admin admin] PATH_INFO: `/v3/projects/5fe81abec91245bfa2f58ac691f4acf0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:19.864151 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3167d03-d14d-4be4-b3c1-4817f0474df5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe81abec91245bfa2f58ac691f4acf0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:19.864151 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3167d03-d14d-4be4-b3c1-4817f0474df5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:19.976101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d3167d03-d14d-4be4-b3c1-4817f0474df5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe81abec91245bfa2f58ac691f4acf0', 'request_id': 'req-d3167d03-d14d-4be4-b3c1-4817f0474df5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:20.048917 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d3167d03-d14d-4be4-b3c1-4817f0474df5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe81abec91245bfa2f58ac691f4acf0', 'request_id': 'req-d3167d03-d14d-4be4-b3c1-4817f0474df5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:20.055202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d3167d03-d14d-4be4-b3c1-4817f0474df5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe81abec91245bfa2f58ac691f4acf0', 'request_id': 'req-d3167d03-d14d-4be4-b3c1-4817f0474df5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:20.066128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d3167d03-d14d-4be4-b3c1-4817f0474df5 admin admin] The token cache is being invalidate because project 5fe81abec91245bfa2f58ac691f4acf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:20.066413 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d3167d03-d14d-4be4-b3c1-4817f0474df5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:20.067035 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d3167d03-d14d-4be4-b3c1-4817f0474df5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:20.068598 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1348/2710] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:19 2022] DELETE /identity/v3/projects/5fe81abec91245bfa2f58ac691f4acf0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:20.073573 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af77b7-3260-4431-863e-bdc8ffc6d3d3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:20.074059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af77b7-3260-4431-863e-bdc8ffc6d3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:20.074174 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af77b7-3260-4431-863e-bdc8ffc6d3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:20.092794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f7af77b7-3260-4431-863e-bdc8ffc6d3d3 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:20.094065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f7af77b7-3260-4431-863e-bdc8ffc6d3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:20.152789 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1363/2711] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:20.160414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78eb8d-2c59-4755-9fbf-4e51f71f4caf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:20.160720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78eb8d-2c59-4755-9fbf-4e51f71f4caf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:20.160997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78eb8d-2c59-4755-9fbf-4e51f71f4caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:20.179461 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ed78eb8d-2c59-4755-9fbf-4e51f71f4caf None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:20.180629 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ed78eb8d-2c59-4755-9fbf-4e51f71f4caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:20.188649 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1349/2712] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:20.192735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af77b7-3260-4431-863e-bdc8ffc6d3d3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:20.203498 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af77b7-3260-4431-863e-bdc8ffc6d3d3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:20.208036 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f03b69-e7a8-4ae8-9181-920912a950a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:20.208680 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f03b69-e7a8-4ae8-9181-920912a950a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:20.208961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f03b69-e7a8-4ae8-9181-920912a950a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:20.209236 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f03b69-e7a8-4ae8-9181-920912a950a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:20.210469 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f03b69-e7a8-4ae8-9181-920912a950a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:17:20.210809 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f03b69-e7a8-4ae8-9181-920912a950a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:20.212466 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f03b69-e7a8-4ae8-9181-920912a950a5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:20.223524 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1364/2713] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:17:20.228476 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78eb8d-2c59-4755-9fbf-4e51f71f4caf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:20.237326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78eb8d-2c59-4755-9fbf-4e51f71f4caf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:20.242080 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f36d8-0ffb-4d0e-9b3f-ef2844ff192a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:20.242710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f36d8-0ffb-4d0e-9b3f-ef2844ff192a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:20.242990 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f36d8-0ffb-4d0e-9b3f-ef2844ff192a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:20.243294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f36d8-0ffb-4d0e-9b3f-ef2844ff192a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:20.243970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f36d8-0ffb-4d0e-9b3f-ef2844ff192a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:20.245829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f36d8-0ffb-4d0e-9b3f-ef2844ff192a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:20.339532 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1350/2714] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:17:20 2022] POST /identity/v3/projects => generated 355 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:20.342896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f03b69-e7a8-4ae8-9181-920912a950a5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:20.353322 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f03b69-e7a8-4ae8-9181-920912a950a5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:20.410382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164c33d-b64f-475e-af24-246e206e6d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:20.411118 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164c33d-b64f-475e-af24-246e206e6d49 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:20.411447 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164c33d-b64f-475e-af24-246e206e6d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:20.411780 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164c33d-b64f-475e-af24-246e206e6d49 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:20.412460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164c33d-b64f-475e-af24-246e206e6d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:20.415836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164c33d-b64f-475e-af24-246e206e6d49 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:20.670745 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1365/2715] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:17:20 2022] POST /identity/v3/users => generated 278 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:20.674947 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f36d8-0ffb-4d0e-9b3f-ef2844ff192a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:20.685099 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f36d8-0ffb-4d0e-9b3f-ef2844ff192a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:20.690016 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70f30b-477e-4062-8a0d-52e3a0a6ad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:20.690671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70f30b-477e-4062-8a0d-52e3a0a6ad48 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:20.690955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70f30b-477e-4062-8a0d-52e3a0a6ad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:20.691276 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70f30b-477e-4062-8a0d-52e3a0a6ad48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:20.692010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70f30b-477e-4062-8a0d-52e3a0a6ad48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:20.693601 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70f30b-477e-4062-8a0d-52e3a0a6ad48 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:20.704509 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1351/2716] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:20.708446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164c33d-b64f-475e-af24-246e206e6d49 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:20.718658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164c33d-b64f-475e-af24-246e206e6d49 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:20.723076 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc457b-b0d8-4c51-8138-4f4b02031b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:20.723760 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc457b-b0d8-4c51-8138-4f4b02031b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:20.724035 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc457b-b0d8-4c51-8138-4f4b02031b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:20.724305 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc457b-b0d8-4c51-8138-4f4b02031b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:20.725017 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc457b-b0d8-4c51-8138-4f4b02031b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:20.726584 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc457b-b0d8-4c51-8138-4f4b02031b22 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:20.736106 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1366/2717] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:20.740187 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70f30b-477e-4062-8a0d-52e3a0a6ad48 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:20.749896 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70f30b-477e-4062-8a0d-52e3a0a6ad48 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:20.754415 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdd95a-2c2f-4a87-8a83-b61729be6b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:20.755379 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdd95a-2c2f-4a87-8a83-b61729be6b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:20.755664 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdd95a-2c2f-4a87-8a83-b61729be6b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:20.755939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdd95a-2c2f-4a87-8a83-b61729be6b03 admin admin] PATH_INFO: `/v3/projects/c87af3055ce14cd796e9d94534ec8b48/users/e6b56feb839c485693849720d395e11c/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:20.770668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdd95a-2c2f-4a87-8a83-b61729be6b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87af3055ce14cd796e9d94534ec8b48, user_id=e6b56feb839c485693849720d395e11c, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:20.773862 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdd95a-2c2f-4a87-8a83-b61729be6b03 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:20.888616 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1352/2718] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:20 2022] PUT /identity/v3/projects/c87af3055ce14cd796e9d94534ec8b48/users/e6b56feb839c485693849720d395e11c/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:20.900607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0bc45-c3e5-4a68-a1d2-f91d77802f80 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:20.900922 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0bc45-c3e5-4a68-a1d2-f91d77802f80 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:20.901203 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0bc45-c3e5-4a68-a1d2-f91d77802f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:20.927331 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-dea0bc45-c3e5-4a68-a1d2-f91d77802f80 None None] MFA Rules not processed for user `e6b56feb839c485693849720d395e11c`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:20.929059 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dea0bc45-c3e5-4a68-a1d2-f91d77802f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:20.990467 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1367/2719] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:20 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:20.995679 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdd95a-2c2f-4a87-8a83-b61729be6b03 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:21.057075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdd95a-2c2f-4a87-8a83-b61729be6b03 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:21.061720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92201b73-d4da-425b-9eb5-d7a3fccd27e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:21.062362 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92201b73-d4da-425b-9eb5-d7a3fccd27e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:21.062643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92201b73-d4da-425b-9eb5-d7a3fccd27e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:21.063203 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92201b73-d4da-425b-9eb5-d7a3fccd27e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:21.063877 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92201b73-d4da-425b-9eb5-d7a3fccd27e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:21.065755 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92201b73-d4da-425b-9eb5-d7a3fccd27e5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:21.191787 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1353/2720] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:17:20 2022] POST /identity/v3/projects => generated 353 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:21.196617 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0bc45-c3e5-4a68-a1d2-f91d77802f80 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:21.207013 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0bc45-c3e5-4a68-a1d2-f91d77802f80 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:21.261433 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fd9f5-86fc-4118-94ef-0062d44b8f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:21.262081 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fd9f5-86fc-4118-94ef-0062d44b8f56 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:21.262358 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fd9f5-86fc-4118-94ef-0062d44b8f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:21.262628 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fd9f5-86fc-4118-94ef-0062d44b8f56 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:21.263334 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fd9f5-86fc-4118-94ef-0062d44b8f56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:21.265213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fd9f5-86fc-4118-94ef-0062d44b8f56 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:21.352639 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1368/2721] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:17:21 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:21.356759 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92201b73-d4da-425b-9eb5-d7a3fccd27e5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:21.367390 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92201b73-d4da-425b-9eb5-d7a3fccd27e5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:21.371901 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30b39a-9955-4576-a078-70546a1c5c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:21.372547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30b39a-9955-4576-a078-70546a1c5c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:21.372827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30b39a-9955-4576-a078-70546a1c5c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:21.373102 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30b39a-9955-4576-a078-70546a1c5c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:21.373852 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30b39a-9955-4576-a078-70546a1c5c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:21.375485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30b39a-9955-4576-a078-70546a1c5c6a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:21.385617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1354/2722] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:21.389644 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fd9f5-86fc-4118-94ef-0062d44b8f56 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:21.399612 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fd9f5-86fc-4118-94ef-0062d44b8f56 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:21.404133 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b33659-50da-4285-ab7c-285d45d52823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:21.404993 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33659-50da-4285-ab7c-285d45d52823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:21.405276 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33659-50da-4285-ab7c-285d45d52823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:21.405553 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33659-50da-4285-ab7c-285d45d52823 admin admin] PATH_INFO: `/v3/projects/34b5dbfb50d44ed09d8338c43a954034/users/294d996971dc4148b3d1bf256805b282/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:21.420241 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b33659-50da-4285-ab7c-285d45d52823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b5dbfb50d44ed09d8338c43a954034, user_id=294d996971dc4148b3d1bf256805b282, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:21.422878 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b33659-50da-4285-ab7c-285d45d52823 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:21.505910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1369/2723] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:21 2022] PUT /identity/v3/projects/34b5dbfb50d44ed09d8338c43a954034/users/294d996971dc4148b3d1bf256805b282/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:21.509846 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30b39a-9955-4576-a078-70546a1c5c6a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:21.519696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30b39a-9955-4576-a078-70546a1c5c6a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:21.577141 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26dadd1-74c2-481b-823d-655bb2dedd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:21.577814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dadd1-74c2-481b-823d-655bb2dedd01 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:21.578101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dadd1-74c2-481b-823d-655bb2dedd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:21.578379 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dadd1-74c2-481b-823d-655bb2dedd01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:21.579136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26dadd1-74c2-481b-823d-655bb2dedd01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:21.580699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26dadd1-74c2-481b-823d-655bb2dedd01 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:21.590903 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1355/2724] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:21.594864 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b33659-50da-4285-ab7c-285d45d52823 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:21.605740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b33659-50da-4285-ab7c-285d45d52823 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:21.610213 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e152d17-8349-424b-9ce4-94a552e90aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:21.611082 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e152d17-8349-424b-9ce4-94a552e90aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:21.611385 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e152d17-8349-424b-9ce4-94a552e90aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:21.611656 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e152d17-8349-424b-9ce4-94a552e90aa9 admin admin] PATH_INFO: `/v3/projects/34b5dbfb50d44ed09d8338c43a954034/users/294d996971dc4148b3d1bf256805b282/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:21.613742 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e152d17-8349-424b-9ce4-94a552e90aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b5dbfb50d44ed09d8338c43a954034, user_id=294d996971dc4148b3d1bf256805b282, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:21.616415 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e152d17-8349-424b-9ce4-94a552e90aa9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:21.626152 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1370/2725] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:21 2022] PUT /identity/v3/projects/34b5dbfb50d44ed09d8338c43a954034/users/294d996971dc4148b3d1bf256805b282/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:21.636255 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98e5ac-6afb-4f1e-9be8-018c7810cfa4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:21.636548 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98e5ac-6afb-4f1e-9be8-018c7810cfa4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:21.636827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98e5ac-6afb-4f1e-9be8-018c7810cfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:21.664558 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-af98e5ac-6afb-4f1e-9be8-018c7810cfa4 None None] MFA Rules not processed for user `294d996971dc4148b3d1bf256805b282`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:21.665826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-af98e5ac-6afb-4f1e-9be8-018c7810cfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:21.731491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1356/2726] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:21 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:21.742779 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e152d17-8349-424b-9ce4-94a552e90aa9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:21.744466 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2e152d17-8349-424b-9ce4-94a552e90aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:21.800702 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e152d17-8349-424b-9ce4-94a552e90aa9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:21.804257 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0cfd9-6bf3-4312-b49f-8d37eafe7dfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:21.805033 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0cfd9-6bf3-4312-b49f-8d37eafe7dfb service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:21.805311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0cfd9-6bf3-4312-b49f-8d37eafe7dfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:21.805939 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0cfd9-6bf3-4312-b49f-8d37eafe7dfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:21.814847 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0cfd9-6bf3-4312-b49f-8d37eafe7dfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:21.816286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0cfd9-6bf3-4312-b49f-8d37eafe7dfb service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:21.825268 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1371/2727] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:21 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:22.073748 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98e5ac-6afb-4f1e-9be8-018c7810cfa4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:22.083101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98e5ac-6afb-4f1e-9be8-018c7810cfa4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:22.086768 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44157a0c-7fcd-4a4d-8121-09ea698f6dc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:22.087451 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44157a0c-7fcd-4a4d-8121-09ea698f6dc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:22.088297 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44157a0c-7fcd-4a4d-8121-09ea698f6dc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:22.088576 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44157a0c-7fcd-4a4d-8121-09ea698f6dc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:22.142721 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44157a0c-7fcd-4a4d-8121-09ea698f6dc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:22.144311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44157a0c-7fcd-4a4d-8121-09ea698f6dc6 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:22.155735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1357/2728] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:22 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:17:35.403208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0cfd9-6bf3-4312-b49f-8d37eafe7dfb service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:35.404581 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f7f0cfd9-6bf3-4312-b49f-8d37eafe7dfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:35.469400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0cfd9-6bf3-4312-b49f-8d37eafe7dfb service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:35.473996 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad585d-cd67-49a9-841f-b72e89fd2a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:35.475449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad585d-cd67-49a9-841f-b72e89fd2a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:35.475851 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad585d-cd67-49a9-841f-b72e89fd2a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:35.476129 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad585d-cd67-49a9-841f-b72e89fd2a1c admin admin] PATH_INFO: `/v3/users/21ea798de9b6493895851b3aedbb40ca` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:35.477296 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad585d-cd67-49a9-841f-b72e89fd2a1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ea798de9b6493895851b3aedbb40ca)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:35.479232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad585d-cd67-49a9-841f-b72e89fd2a1c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:35.673257 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bcad585d-cd67-49a9-841f-b72e89fd2a1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ea798de9b6493895851b3aedbb40ca'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:35.684485 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bcad585d-cd67-49a9-841f-b72e89fd2a1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ea798de9b6493895851b3aedbb40ca'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:35.809467 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bcad585d-cd67-49a9-841f-b72e89fd2a1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ea798de9b6493895851b3aedbb40ca'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:35.810091 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bcad585d-cd67-49a9-841f-b72e89fd2a1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ea798de9b6493895851b3aedbb40ca'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:35.810696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bcad585d-cd67-49a9-841f-b72e89fd2a1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ea798de9b6493895851b3aedbb40ca'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:35.823927 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1372/2729] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:17:35 2022] DELETE /identity/v3/users/21ea798de9b6493895851b3aedbb40ca => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:35.828424 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06447d5-874b-4848-8516-2745ee9f21dd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:35.828956 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06447d5-874b-4848-8516-2745ee9f21dd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:35.828956 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06447d5-874b-4848-8516-2745ee9f21dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:35.846091 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e06447d5-874b-4848-8516-2745ee9f21dd None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:35.847329 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e06447d5-874b-4848-8516-2745ee9f21dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:35.908527 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1358/2730] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:35.918442 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad585d-cd67-49a9-841f-b72e89fd2a1c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:35.919910 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bcad585d-cd67-49a9-841f-b72e89fd2a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:35.977124 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad585d-cd67-49a9-841f-b72e89fd2a1c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:35.980937 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f54912-ea5a-46b6-a606-0c6ae8574769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:35.981576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f54912-ea5a-46b6-a606-0c6ae8574769 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:35.981862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f54912-ea5a-46b6-a606-0c6ae8574769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:35.982141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f54912-ea5a-46b6-a606-0c6ae8574769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:35.991003 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f54912-ea5a-46b6-a606-0c6ae8574769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:35.992459 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f54912-ea5a-46b6-a606-0c6ae8574769 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:36.002532 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1373/2731] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:36.460548 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06447d5-874b-4848-8516-2745ee9f21dd None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:36.461970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e06447d5-874b-4848-8516-2745ee9f21dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:36.477916 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06447d5-874b-4848-8516-2745ee9f21dd None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:36.486728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46af32-5f02-4743-8783-df0bc9b189a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:36.487660 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46af32-5f02-4743-8783-df0bc9b189a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:36.487946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46af32-5f02-4743-8783-df0bc9b189a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:36.488224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46af32-5f02-4743-8783-df0bc9b189a9 admin admin] PATH_INFO: `/v3/projects/ca03fe99c55a49cc8c965679f9003575` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:36.489492 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46af32-5f02-4743-8783-df0bc9b189a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca03fe99c55a49cc8c965679f9003575)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:36.491426 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46af32-5f02-4743-8783-df0bc9b189a9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:36.625757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc46af32-5f02-4743-8783-df0bc9b189a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca03fe99c55a49cc8c965679f9003575', 'request_id': 'req-fc46af32-5f02-4743-8783-df0bc9b189a9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:36.717238 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc46af32-5f02-4743-8783-df0bc9b189a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca03fe99c55a49cc8c965679f9003575', 'request_id': 'req-fc46af32-5f02-4743-8783-df0bc9b189a9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:36.722955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc46af32-5f02-4743-8783-df0bc9b189a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca03fe99c55a49cc8c965679f9003575', 'request_id': 'req-fc46af32-5f02-4743-8783-df0bc9b189a9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:36.734088 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc46af32-5f02-4743-8783-df0bc9b189a9 admin admin] The token cache is being invalidate because project ca03fe99c55a49cc8c965679f9003575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:36.734370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc46af32-5f02-4743-8783-df0bc9b189a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:36.735043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fc46af32-5f02-4743-8783-df0bc9b189a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:36.736583 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1359/2732] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:36 2022] DELETE /identity/v3/projects/ca03fe99c55a49cc8c965679f9003575 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:36.741400 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796588f-5108-4bdd-9951-c63289b018b8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:36.741893 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796588f-5108-4bdd-9951-c63289b018b8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:36.742000 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796588f-5108-4bdd-9951-c63289b018b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:36.760484 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e796588f-5108-4bdd-9951-c63289b018b8 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:36.762212 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e796588f-5108-4bdd-9951-c63289b018b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:36.817735 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1374/2733] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:36.826186 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243863e-4742-4e3c-b64c-165108af7e81 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:36.826478 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243863e-4742-4e3c-b64c-165108af7e81 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:36.826757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243863e-4742-4e3c-b64c-165108af7e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:36.845070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9243863e-4742-4e3c-b64c-165108af7e81 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:36.846244 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9243863e-4742-4e3c-b64c-165108af7e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:36.854030 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1360/2734] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:36.858203 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796588f-5108-4bdd-9951-c63289b018b8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:36.867538 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796588f-5108-4bdd-9951-c63289b018b8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:36.872540 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760c742-820a-487c-86f3-138b6166ceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:36.873180 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760c742-820a-487c-86f3-138b6166ceb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:36.873456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760c742-820a-487c-86f3-138b6166ceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:36.873725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760c742-820a-487c-86f3-138b6166ceb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:36.874432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760c742-820a-487c-86f3-138b6166ceb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:17:36.874737 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760c742-820a-487c-86f3-138b6166ceb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:36.876368 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760c742-820a-487c-86f3-138b6166ceb0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:36.888096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1375/2735] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:17:36.892409 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243863e-4742-4e3c-b64c-165108af7e81 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:36.902200 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243863e-4742-4e3c-b64c-165108af7e81 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:36.906917 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6bcad-8eeb-44f2-9b75-93ec33a372ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:36.907604 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6bcad-8eeb-44f2-9b75-93ec33a372ff admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:36.907896 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6bcad-8eeb-44f2-9b75-93ec33a372ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:36.908165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6bcad-8eeb-44f2-9b75-93ec33a372ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:36.908866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6bcad-8eeb-44f2-9b75-93ec33a372ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:36.910921 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6bcad-8eeb-44f2-9b75-93ec33a372ff admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:37.010334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1361/2736] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:17:36 2022] POST /identity/v3/projects => generated 397 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:37.015127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760c742-820a-487c-86f3-138b6166ceb0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:37.025173 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760c742-820a-487c-86f3-138b6166ceb0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:37.080195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07e216-327c-40eb-9be7-08842798d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:37.080858 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07e216-327c-40eb-9be7-08842798d78b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:37.081141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07e216-327c-40eb-9be7-08842798d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:37.081414 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07e216-327c-40eb-9be7-08842798d78b admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:37.082091 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07e216-327c-40eb-9be7-08842798d78b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:37.084026 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07e216-327c-40eb-9be7-08842798d78b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:37.172978 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1376/2737] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:17:37 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:37.177147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6bcad-8eeb-44f2-9b75-93ec33a372ff admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:37.188892 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6bcad-8eeb-44f2-9b75-93ec33a372ff admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:37.193479 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab43fc3-f67c-4744-b765-ffbaeb933853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:37.194132 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab43fc3-f67c-4744-b765-ffbaeb933853 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:37.194414 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab43fc3-f67c-4744-b765-ffbaeb933853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:37.194686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab43fc3-f67c-4744-b765-ffbaeb933853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:37.195468 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab43fc3-f67c-4744-b765-ffbaeb933853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:37.197012 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab43fc3-f67c-4744-b765-ffbaeb933853 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:37.208764 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1362/2738] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:37.212886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07e216-327c-40eb-9be7-08842798d78b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:37.223836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07e216-327c-40eb-9be7-08842798d78b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:37.228451 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1de25-0faa-41b0-8523-c8ea593c3562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:37.229105 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1de25-0faa-41b0-8523-c8ea593c3562 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:37.229520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1de25-0faa-41b0-8523-c8ea593c3562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:37.229803 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1de25-0faa-41b0-8523-c8ea593c3562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:37.230525 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1de25-0faa-41b0-8523-c8ea593c3562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:37.232156 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1de25-0faa-41b0-8523-c8ea593c3562 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:37.243177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1377/2739] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:37.247283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab43fc3-f67c-4744-b765-ffbaeb933853 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:37.257680 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab43fc3-f67c-4744-b765-ffbaeb933853 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:37.263491 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153f13c-477c-493f-8125-b11325a236e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:37.264446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153f13c-477c-493f-8125-b11325a236e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:37.264811 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153f13c-477c-493f-8125-b11325a236e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:37.265010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153f13c-477c-493f-8125-b11325a236e0 admin admin] PATH_INFO: `/v3/projects/f0082b9e8f4e415fad5325973435a1d8/users/88d5bd48d3dd4466ae68bb3e4b8e6a0e/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:37.281284 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153f13c-477c-493f-8125-b11325a236e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0082b9e8f4e415fad5325973435a1d8, user_id=88d5bd48d3dd4466ae68bb3e4b8e6a0e, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:37.283977 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153f13c-477c-493f-8125-b11325a236e0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:37.363537 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1363/2740] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:37 2022] PUT /identity/v3/projects/f0082b9e8f4e415fad5325973435a1d8/users/88d5bd48d3dd4466ae68bb3e4b8e6a0e/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:37.375525 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d2c27-64e8-4686-a960-cc7435c1552d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:37.375814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d2c27-64e8-4686-a960-cc7435c1552d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:37.376089 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d2c27-64e8-4686-a960-cc7435c1552d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:37.402411 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-446d2c27-64e8-4686-a960-cc7435c1552d None None] MFA Rules not processed for user `88d5bd48d3dd4466ae68bb3e4b8e6a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:37.403637 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-446d2c27-64e8-4686-a960-cc7435c1552d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:37.469087 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1378/2741] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:37.480517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153f13c-477c-493f-8125-b11325a236e0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:37.482346 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8153f13c-477c-493f-8125-b11325a236e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:37.538619 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153f13c-477c-493f-8125-b11325a236e0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:37.542309 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b91e44-62fd-4c39-b142-f5c1f4871f72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:37.542889 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b91e44-62fd-4c39-b142-f5c1f4871f72 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:37.543219 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b91e44-62fd-4c39-b142-f5c1f4871f72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:37.543472 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b91e44-62fd-4c39-b142-f5c1f4871f72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:37.551572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b91e44-62fd-4c39-b142-f5c1f4871f72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:37.552979 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b91e44-62fd-4c39-b142-f5c1f4871f72 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:37.562606 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1364/2742] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:17:45.164297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d2c27-64e8-4686-a960-cc7435c1552d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:45.165755 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-446d2c27-64e8-4686-a960-cc7435c1552d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:45.228746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d2c27-64e8-4686-a960-cc7435c1552d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:45.233833 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e682ad7-1779-44e9-8ac0-b40c882a2da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:45.234689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e682ad7-1779-44e9-8ac0-b40c882a2da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:45.234968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e682ad7-1779-44e9-8ac0-b40c882a2da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:45.235271 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e682ad7-1779-44e9-8ac0-b40c882a2da9 admin admin] PATH_INFO: `/v3/users/e6b56feb839c485693849720d395e11c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:45.236442 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e682ad7-1779-44e9-8ac0-b40c882a2da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b56feb839c485693849720d395e11c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:45.238343 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e682ad7-1779-44e9-8ac0-b40c882a2da9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:45.445231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b91e44-62fd-4c39-b142-f5c1f4871f72 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:45.456615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b91e44-62fd-4c39-b142-f5c1f4871f72 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:45.461058 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e167-5246-42ed-a202-34c3cd7c824e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:45.461895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e167-5246-42ed-a202-34c3cd7c824e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:45.462175 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e167-5246-42ed-a202-34c3cd7c824e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:45.462449 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e167-5246-42ed-a202-34c3cd7c824e admin admin] PATH_INFO: `/v3/users/88d5bd48d3dd4466ae68bb3e4b8e6a0e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:45.463694 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e167-5246-42ed-a202-34c3cd7c824e admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d5bd48d3dd4466ae68bb3e4b8e6a0e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:45.465551 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e682ad7-1779-44e9-8ac0-b40c882a2da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b56feb839c485693849720d395e11c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:45.465701 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e167-5246-42ed-a202-34c3cd7c824e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:45.483023 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e682ad7-1779-44e9-8ac0-b40c882a2da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b56feb839c485693849720d395e11c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:45.580291 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e682ad7-1779-44e9-8ac0-b40c882a2da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b56feb839c485693849720d395e11c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:45.580913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e682ad7-1779-44e9-8ac0-b40c882a2da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b56feb839c485693849720d395e11c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:45.581522 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8e682ad7-1779-44e9-8ac0-b40c882a2da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b56feb839c485693849720d395e11c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:45.595159 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1379/2743] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:17:45 2022] DELETE /identity/v3/users/e6b56feb839c485693849720d395e11c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:45.603569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db893c-8531-459e-8737-23d03f2b89a8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:45.603569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db893c-8531-459e-8737-23d03f2b89a8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:45.603569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db893c-8531-459e-8737-23d03f2b89a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:45.618360 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-42db893c-8531-459e-8737-23d03f2b89a8 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:45.619620 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-42db893c-8531-459e-8737-23d03f2b89a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:45.676716 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1380/2744] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:17:45.684244 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bb3e167-5246-42ed-a202-34c3cd7c824e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d5bd48d3dd4466ae68bb3e4b8e6a0e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:45.686571 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db893c-8531-459e-8737-23d03f2b89a8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:45.687970 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-42db893c-8531-459e-8737-23d03f2b89a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:45.696395 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bb3e167-5246-42ed-a202-34c3cd7c824e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d5bd48d3dd4466ae68bb3e4b8e6a0e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:45.697093 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bb3e167-5246-42ed-a202-34c3cd7c824e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d5bd48d3dd4466ae68bb3e4b8e6a0e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:45.740153 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bb3e167-5246-42ed-a202-34c3cd7c824e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d5bd48d3dd4466ae68bb3e4b8e6a0e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:45.740770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bb3e167-5246-42ed-a202-34c3cd7c824e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d5bd48d3dd4466ae68bb3e4b8e6a0e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:45.743418 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db893c-8531-459e-8737-23d03f2b89a8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:45.747239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e2352-36d2-4437-9235-6e33c6e708d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:45.747883 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e2352-36d2-4437-9235-6e33c6e708d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:45.748181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e2352-36d2-4437-9235-6e33c6e708d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:45.748437 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e2352-36d2-4437-9235-6e33c6e708d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:45.750209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bc6e2352-36d2-4437-9235-6e33c6e708d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:45.754495 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1365/2745] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:17:45 2022] DELETE /identity/v3/users/88d5bd48d3dd4466ae68bb3e4b8e6a0e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:17:45.758866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102b603-35b7-4982-9854-6b839ce25903 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:45.759172 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102b603-35b7-4982-9854-6b839ce25903 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:45.759461 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102b603-35b7-4982-9854-6b839ce25903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:45.762325 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e2352-36d2-4437-9235-6e33c6e708d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:45.763788 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e2352-36d2-4437-9235-6e33c6e708d9 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:45.773191 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1381/2746] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:45.777154 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e102b603-35b7-4982-9854-6b839ce25903 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:45.778358 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e102b603-35b7-4982-9854-6b839ce25903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:45.836473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1366/2747] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:45.846440 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e2352-36d2-4437-9235-6e33c6e708d9 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:45.847889 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bc6e2352-36d2-4437-9235-6e33c6e708d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:45.858566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e2352-36d2-4437-9235-6e33c6e708d9 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:45.907679 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bec14-8c71-4b77-a577-4d7806fc1ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:45.908330 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bec14-8c71-4b77-a577-4d7806fc1ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:45.908612 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bec14-8c71-4b77-a577-4d7806fc1ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:45.908885 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bec14-8c71-4b77-a577-4d7806fc1ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:45.918401 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bec14-8c71-4b77-a577-4d7806fc1ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:45.919868 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bec14-8c71-4b77-a577-4d7806fc1ca0 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:45.936036 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1382/2748] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:46.225688 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102b603-35b7-4982-9854-6b839ce25903 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:46.227129 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e102b603-35b7-4982-9854-6b839ce25903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:46.251564 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102b603-35b7-4982-9854-6b839ce25903 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:46.257387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1749d13-066c-48c1-942f-d0c718a658e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:46.258340 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1749d13-066c-48c1-942f-d0c718a658e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:46.258695 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1749d13-066c-48c1-942f-d0c718a658e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:46.258956 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1749d13-066c-48c1-942f-d0c718a658e1 admin admin] PATH_INFO: `/v3/projects/c87af3055ce14cd796e9d94534ec8b48` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:46.260323 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1749d13-066c-48c1-942f-d0c718a658e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c87af3055ce14cd796e9d94534ec8b48)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:46.262239 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1749d13-066c-48c1-942f-d0c718a658e1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:46.335867 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bec14-8c71-4b77-a577-4d7806fc1ca0 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:46.337672 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0c6bec14-8c71-4b77-a577-4d7806fc1ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:46.351064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bec14-8c71-4b77-a577-4d7806fc1ca0 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:46.357615 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3302f2-13f0-475d-b8c1-9a155f5d9880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:46.363202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3302f2-13f0-475d-b8c1-9a155f5d9880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:46.363202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3302f2-13f0-475d-b8c1-9a155f5d9880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:46.363202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3302f2-13f0-475d-b8c1-9a155f5d9880 admin admin] PATH_INFO: `/v3/projects/f0082b9e8f4e415fad5325973435a1d8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:46.363202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3302f2-13f0-475d-b8c1-9a155f5d9880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0082b9e8f4e415fad5325973435a1d8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:46.363202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3302f2-13f0-475d-b8c1-9a155f5d9880 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:46.374735 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f1749d13-066c-48c1-942f-d0c718a658e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c87af3055ce14cd796e9d94534ec8b48', 'request_id': 'req-f1749d13-066c-48c1-942f-d0c718a658e1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:46.437799 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f1749d13-066c-48c1-942f-d0c718a658e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c87af3055ce14cd796e9d94534ec8b48', 'request_id': 'req-f1749d13-066c-48c1-942f-d0c718a658e1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:46.444537 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f1749d13-066c-48c1-942f-d0c718a658e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c87af3055ce14cd796e9d94534ec8b48', 'request_id': 'req-f1749d13-066c-48c1-942f-d0c718a658e1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:46.456483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f1749d13-066c-48c1-942f-d0c718a658e1 admin admin] The token cache is being invalidate because project c87af3055ce14cd796e9d94534ec8b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:46.457128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f1749d13-066c-48c1-942f-d0c718a658e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:46.457503 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f1749d13-066c-48c1-942f-d0c718a658e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:46.459157 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1367/2749] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:46 2022] DELETE /identity/v3/projects/c87af3055ce14cd796e9d94534ec8b48 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:46.464384 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1749d13-066c-48c1-942f-d0c718a658e1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:46.465884 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f1749d13-066c-48c1-942f-d0c718a658e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:46.480107 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ce3302f2-13f0-475d-b8c1-9a155f5d9880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0082b9e8f4e415fad5325973435a1d8', 'request_id': 'req-ce3302f2-13f0-475d-b8c1-9a155f5d9880'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:46.486858 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ce3302f2-13f0-475d-b8c1-9a155f5d9880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0082b9e8f4e415fad5325973435a1d8', 'request_id': 'req-ce3302f2-13f0-475d-b8c1-9a155f5d9880'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:46.493692 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ce3302f2-13f0-475d-b8c1-9a155f5d9880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0082b9e8f4e415fad5325973435a1d8', 'request_id': 'req-ce3302f2-13f0-475d-b8c1-9a155f5d9880'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:46.533637 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1749d13-066c-48c1-942f-d0c718a658e1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:46.591200 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f625cd3-c9c3-470a-8275-595cff2a5d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:46.592318 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f625cd3-c9c3-470a-8275-595cff2a5d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:46.592596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f625cd3-c9c3-470a-8275-595cff2a5d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:46.592868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f625cd3-c9c3-470a-8275-595cff2a5d82 admin admin] PATH_INFO: `/v3/users/294d996971dc4148b3d1bf256805b282` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:46.594104 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f625cd3-c9c3-470a-8275-595cff2a5d82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=294d996971dc4148b3d1bf256805b282)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:46.596159 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f625cd3-c9c3-470a-8275-595cff2a5d82 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:46.596521 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ce3302f2-13f0-475d-b8c1-9a155f5d9880 admin admin] The token cache is being invalidate because project f0082b9e8f4e415fad5325973435a1d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:46.596865 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ce3302f2-13f0-475d-b8c1-9a155f5d9880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:46.597793 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ce3302f2-13f0-475d-b8c1-9a155f5d9880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:46.599730 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1383/2750] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:46 2022] DELETE /identity/v3/projects/f0082b9e8f4e415fad5325973435a1d8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:17:46.816125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f625cd3-c9c3-470a-8275-595cff2a5d82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294d996971dc4148b3d1bf256805b282'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:46.829030 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f625cd3-c9c3-470a-8275-595cff2a5d82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294d996971dc4148b3d1bf256805b282'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:46.829783 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f625cd3-c9c3-470a-8275-595cff2a5d82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294d996971dc4148b3d1bf256805b282'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:46.895045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f625cd3-c9c3-470a-8275-595cff2a5d82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294d996971dc4148b3d1bf256805b282'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:46.895405 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f625cd3-c9c3-470a-8275-595cff2a5d82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294d996971dc4148b3d1bf256805b282'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:46.908143 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1368/2751] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:17:46 2022] DELETE /identity/v3/users/294d996971dc4148b3d1bf256805b282 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:47.305592 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3302f2-13f0-475d-b8c1-9a155f5d9880 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:47.307025 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ce3302f2-13f0-475d-b8c1-9a155f5d9880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:47.319859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3302f2-13f0-475d-b8c1-9a155f5d9880 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:47.375782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fddee-180d-4918-a1a9-2fdd91ee5c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:47.376640 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fddee-180d-4918-a1a9-2fdd91ee5c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:47.376918 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fddee-180d-4918-a1a9-2fdd91ee5c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:47.377189 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fddee-180d-4918-a1a9-2fdd91ee5c13 admin admin] PATH_INFO: `/v3/projects/34b5dbfb50d44ed09d8338c43a954034` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:47.378355 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fddee-180d-4918-a1a9-2fdd91ee5c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b5dbfb50d44ed09d8338c43a954034)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:47.380338 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fddee-180d-4918-a1a9-2fdd91ee5c13 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:47.521889 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-711fddee-180d-4918-a1a9-2fdd91ee5c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b5dbfb50d44ed09d8338c43a954034', 'request_id': 'req-711fddee-180d-4918-a1a9-2fdd91ee5c13'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:47.528464 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-711fddee-180d-4918-a1a9-2fdd91ee5c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b5dbfb50d44ed09d8338c43a954034', 'request_id': 'req-711fddee-180d-4918-a1a9-2fdd91ee5c13'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:47.533769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-711fddee-180d-4918-a1a9-2fdd91ee5c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b5dbfb50d44ed09d8338c43a954034', 'request_id': 'req-711fddee-180d-4918-a1a9-2fdd91ee5c13'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:47.607642 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-711fddee-180d-4918-a1a9-2fdd91ee5c13 admin admin] The token cache is being invalidate because project 34b5dbfb50d44ed09d8338c43a954034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:47.607856 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-711fddee-180d-4918-a1a9-2fdd91ee5c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:47.608466 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-711fddee-180d-4918-a1a9-2fdd91ee5c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:47.610047 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1384/2752] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:47 2022] DELETE /identity/v3/projects/34b5dbfb50d44ed09d8338c43a954034 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:47.615827 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dfb33-4744-4daf-b099-e39b49b2fabf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:47.616320 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dfb33-4744-4daf-b099-e39b49b2fabf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:47.616422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dfb33-4744-4daf-b099-e39b49b2fabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:47.633448 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e93dfb33-4744-4daf-b099-e39b49b2fabf None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:47.634616 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e93dfb33-4744-4daf-b099-e39b49b2fabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:47.692046 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1369/2753] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:47.701495 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25caa933-c5ab-4c3a-ba61-e3505edb54bd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:47.701784 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25caa933-c5ab-4c3a-ba61-e3505edb54bd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:47.702064 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25caa933-c5ab-4c3a-ba61-e3505edb54bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:47.720689 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-25caa933-c5ab-4c3a-ba61-e3505edb54bd None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:47.721884 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-25caa933-c5ab-4c3a-ba61-e3505edb54bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:47.729907 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1385/2754] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:47.734010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dfb33-4744-4daf-b099-e39b49b2fabf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:47.743479 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dfb33-4744-4daf-b099-e39b49b2fabf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:47.748809 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc87ea-f96b-48b2-b210-a9edfd0a5ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:47.749461 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc87ea-f96b-48b2-b210-a9edfd0a5ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:47.749745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc87ea-f96b-48b2-b210-a9edfd0a5ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:47.750016 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc87ea-f96b-48b2-b210-a9edfd0a5ef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:47.750738 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc87ea-f96b-48b2-b210-a9edfd0a5ef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:17:47.751037 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc87ea-f96b-48b2-b210-a9edfd0a5ef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:47.752651 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc87ea-f96b-48b2-b210-a9edfd0a5ef1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:47.768387 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1370/2755] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:17:47.769529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25caa933-c5ab-4c3a-ba61-e3505edb54bd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:47.779398 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25caa933-c5ab-4c3a-ba61-e3505edb54bd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:47.783997 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d8bd2-51be-413d-bc18-2bf88e3d3076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:47.784646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d8bd2-51be-413d-bc18-2bf88e3d3076 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:47.784956 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d8bd2-51be-413d-bc18-2bf88e3d3076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:47.785229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d8bd2-51be-413d-bc18-2bf88e3d3076 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:47.785936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d8bd2-51be-413d-bc18-2bf88e3d3076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:47.787876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d8bd2-51be-413d-bc18-2bf88e3d3076 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:47.882706 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1386/2756] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:17:47 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:47.883824 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc87ea-f96b-48b2-b210-a9edfd0a5ef1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:47.895092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc87ea-f96b-48b2-b210-a9edfd0a5ef1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:47.955075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73b911-3522-4a31-9b17-714691e0c35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:47.955763 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73b911-3522-4a31-9b17-714691e0c35a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:47.956042 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73b911-3522-4a31-9b17-714691e0c35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:47.956315 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73b911-3522-4a31-9b17-714691e0c35a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:47.957052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73b911-3522-4a31-9b17-714691e0c35a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:47.958926 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73b911-3522-4a31-9b17-714691e0c35a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:48.054106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1371/2757] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:17:47 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:17:48.058738 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d8bd2-51be-413d-bc18-2bf88e3d3076 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:48.068965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d8bd2-51be-413d-bc18-2bf88e3d3076 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:48.073690 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1757b90-0cf2-4d81-9aac-11ee769c9e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:48.074327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1757b90-0cf2-4d81-9aac-11ee769c9e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:48.074603 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1757b90-0cf2-4d81-9aac-11ee769c9e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:48.074876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1757b90-0cf2-4d81-9aac-11ee769c9e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:48.075620 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1757b90-0cf2-4d81-9aac-11ee769c9e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:48.077186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1757b90-0cf2-4d81-9aac-11ee769c9e84 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:48.087216 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1387/2758] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:48.091696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73b911-3522-4a31-9b17-714691e0c35a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:48.101595 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73b911-3522-4a31-9b17-714691e0c35a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:48.106925 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1fb97-fdcb-4ad9-ba60-39d3414df9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:48.107611 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1fb97-fdcb-4ad9-ba60-39d3414df9da admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:48.107897 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1fb97-fdcb-4ad9-ba60-39d3414df9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:48.108174 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1fb97-fdcb-4ad9-ba60-39d3414df9da admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:48.108899 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1fb97-fdcb-4ad9-ba60-39d3414df9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:48.110475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1fb97-fdcb-4ad9-ba60-39d3414df9da admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:48.120475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1372/2759] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:48.124352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1757b90-0cf2-4d81-9aac-11ee769c9e84 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:48.133965 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1757b90-0cf2-4d81-9aac-11ee769c9e84 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:48.138986 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f855528-bfbd-4b30-83ca-556942b7fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:48.139886 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f855528-bfbd-4b30-83ca-556942b7fbcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:48.140160 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f855528-bfbd-4b30-83ca-556942b7fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:48.140428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f855528-bfbd-4b30-83ca-556942b7fbcd admin admin] PATH_INFO: `/v3/projects/619aac1a13a3428baf4eaa63307fa24d/users/250031778d534d3b8aafaf08941b81d9/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:48.155286 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f855528-bfbd-4b30-83ca-556942b7fbcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=619aac1a13a3428baf4eaa63307fa24d, user_id=250031778d534d3b8aafaf08941b81d9, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:48.158759 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f855528-bfbd-4b30-83ca-556942b7fbcd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:48.254584 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1388/2760] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:48 2022] PUT /identity/v3/projects/619aac1a13a3428baf4eaa63307fa24d/users/250031778d534d3b8aafaf08941b81d9/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:48.265685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84655801-89c2-4a59-8217-52458f45441a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:48.265983 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84655801-89c2-4a59-8217-52458f45441a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:48.266266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84655801-89c2-4a59-8217-52458f45441a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:48.293450 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-84655801-89c2-4a59-8217-52458f45441a None None] MFA Rules not processed for user `250031778d534d3b8aafaf08941b81d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:48.294647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-84655801-89c2-4a59-8217-52458f45441a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:48.358377 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1373/2761] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:48.362800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f855528-bfbd-4b30-83ca-556942b7fbcd admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:48.423754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f855528-bfbd-4b30-83ca-556942b7fbcd admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:48.428229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b25372-300b-4259-b145-5a34a45ae226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:48.428874 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b25372-300b-4259-b145-5a34a45ae226 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:48.429148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b25372-300b-4259-b145-5a34a45ae226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:48.429416 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b25372-300b-4259-b145-5a34a45ae226 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:48.430096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b25372-300b-4259-b145-5a34a45ae226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:48.432063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b25372-300b-4259-b145-5a34a45ae226 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:48.552919 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1389/2762] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:17:48 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:17:48.556739 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84655801-89c2-4a59-8217-52458f45441a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:48.568128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84655801-89c2-4a59-8217-52458f45441a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:48.623663 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e727215-0dfc-4b95-978b-ba003f8e7d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:48.624338 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e727215-0dfc-4b95-978b-ba003f8e7d87 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:48.624596 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e727215-0dfc-4b95-978b-ba003f8e7d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:48.624868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e727215-0dfc-4b95-978b-ba003f8e7d87 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:48.625598 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e727215-0dfc-4b95-978b-ba003f8e7d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:48.627517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e727215-0dfc-4b95-978b-ba003f8e7d87 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:48.706235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1374/2763] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:17:48 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:48.710148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b25372-300b-4259-b145-5a34a45ae226 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:48.720752 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b25372-300b-4259-b145-5a34a45ae226 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:48.725487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba5dcd-69b3-4d87-ae39-5bd6c612c506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:48.726141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba5dcd-69b3-4d87-ae39-5bd6c612c506 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:48.726422 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba5dcd-69b3-4d87-ae39-5bd6c612c506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:48.726722 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba5dcd-69b3-4d87-ae39-5bd6c612c506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:48.727510 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba5dcd-69b3-4d87-ae39-5bd6c612c506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:48.729380 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba5dcd-69b3-4d87-ae39-5bd6c612c506 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:48.739928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1390/2764] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:48.744014 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e727215-0dfc-4b95-978b-ba003f8e7d87 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:48.754671 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e727215-0dfc-4b95-978b-ba003f8e7d87 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:48.759207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff846d-466f-400f-9099-4d2f3bb4cbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:48.760104 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff846d-466f-400f-9099-4d2f3bb4cbd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:48.761085 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff846d-466f-400f-9099-4d2f3bb4cbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:48.761540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff846d-466f-400f-9099-4d2f3bb4cbd7 admin admin] PATH_INFO: `/v3/projects/e302b56252524f9da793533e60b9ce6a/users/e0094a2e2d5b461bb8c17703d95ce112/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:48.775530 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff846d-466f-400f-9099-4d2f3bb4cbd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e302b56252524f9da793533e60b9ce6a, user_id=e0094a2e2d5b461bb8c17703d95ce112, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:48.778467 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff846d-466f-400f-9099-4d2f3bb4cbd7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:48.847868 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1375/2765] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:48 2022] PUT /identity/v3/projects/e302b56252524f9da793533e60b9ce6a/users/e0094a2e2d5b461bb8c17703d95ce112/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:48.851849 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba5dcd-69b3-4d87-ae39-5bd6c612c506 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:48.861733 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba5dcd-69b3-4d87-ae39-5bd6c612c506 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:48.918887 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2c5ee-a4b8-46db-9417-7e2b7b3eea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:48.919728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2c5ee-a4b8-46db-9417-7e2b7b3eea25 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:48.920010 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2c5ee-a4b8-46db-9417-7e2b7b3eea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:48.920292 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2c5ee-a4b8-46db-9417-7e2b7b3eea25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:48.921023 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2c5ee-a4b8-46db-9417-7e2b7b3eea25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:48.922611 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2c5ee-a4b8-46db-9417-7e2b7b3eea25 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:48.937729 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1391/2766] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:17:48.939594 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff846d-466f-400f-9099-4d2f3bb4cbd7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:48.952246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff846d-466f-400f-9099-4d2f3bb4cbd7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:48.957188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fc072-ed8e-4f0d-977d-7edca74eaec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:48.958008 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fc072-ed8e-4f0d-977d-7edca74eaec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:48.958293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fc072-ed8e-4f0d-977d-7edca74eaec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:48.958574 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fc072-ed8e-4f0d-977d-7edca74eaec0 admin admin] PATH_INFO: `/v3/projects/e302b56252524f9da793533e60b9ce6a/users/e0094a2e2d5b461bb8c17703d95ce112/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:48.960699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fc072-ed8e-4f0d-977d-7edca74eaec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e302b56252524f9da793533e60b9ce6a, user_id=e0094a2e2d5b461bb8c17703d95ce112, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:48.963391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fc072-ed8e-4f0d-977d-7edca74eaec0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:48.974437 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1376/2767] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:48 2022] PUT /identity/v3/projects/e302b56252524f9da793533e60b9ce6a/users/e0094a2e2d5b461bb8c17703d95ce112/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:48.986228 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c2af-32be-49b4-b877-8d725f3388da None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:48.986526 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c2af-32be-49b4-b877-8d725f3388da None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:48.986805 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c2af-32be-49b4-b877-8d725f3388da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:49.013579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-dbe8c2af-32be-49b4-b877-8d725f3388da None None] MFA Rules not processed for user `e0094a2e2d5b461bb8c17703d95ce112`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:49.014766 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dbe8c2af-32be-49b4-b877-8d725f3388da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:49.083527 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1392/2768] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:49.096055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fc072-ed8e-4f0d-977d-7edca74eaec0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:49.097770 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ef0fc072-ed8e-4f0d-977d-7edca74eaec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:49.154360 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fc072-ed8e-4f0d-977d-7edca74eaec0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:49.158024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39560d7c-18d9-4423-abe0-3369ea2505f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:49.158658 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39560d7c-18d9-4423-abe0-3369ea2505f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:49.158939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39560d7c-18d9-4423-abe0-3369ea2505f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:49.159260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39560d7c-18d9-4423-abe0-3369ea2505f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:49.168745 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39560d7c-18d9-4423-abe0-3369ea2505f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:49.170154 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39560d7c-18d9-4423-abe0-3369ea2505f5 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:49.179365 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1377/2769] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:50.170588 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8c2af-32be-49b4-b877-8d725f3388da None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:50.179727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8c2af-32be-49b4-b877-8d725f3388da None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:50.184528 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0ab60-f1b3-4e48-95be-4a795dd7014e tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0094a2e2d5b461bb8c17703d95ce112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e302b56252524f9da793533e60b9ce6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:50.185186 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0ab60-f1b3-4e48-95be-4a795dd7014e tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:50.185470 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0ab60-f1b3-4e48-95be-4a795dd7014e tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:50.185796 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0ab60-f1b3-4e48-95be-4a795dd7014e tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:50.186518 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0ab60-f1b3-4e48-95be-4a795dd7014e tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:17:50.186820 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0ab60-f1b3-4e48-95be-4a795dd7014e tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:50.188713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0ab60-f1b3-4e48-95be-4a795dd7014e tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:50.200734 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1393/2770] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:17:50.204826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39560d7c-18d9-4423-abe0-3369ea2505f5 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:50.214293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39560d7c-18d9-4423-abe0-3369ea2505f5 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:50.218972 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a836c6a-eef9-4f03-a58d-227a468389a1 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0094a2e2d5b461bb8c17703d95ce112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e302b56252524f9da793533e60b9ce6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:50.219647 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a836c6a-eef9-4f03-a58d-227a468389a1 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:50.219936 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a836c6a-eef9-4f03-a58d-227a468389a1 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:50.220216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a836c6a-eef9-4f03-a58d-227a468389a1 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:50.220908 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a836c6a-eef9-4f03-a58d-227a468389a1 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:50.222772 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a836c6a-eef9-4f03-a58d-227a468389a1 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:50.334048 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1378/2771] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:17:50 2022] POST /identity/v3/projects => generated 355 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:50.338089 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0ab60-f1b3-4e48-95be-4a795dd7014e tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:50.349074 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0ab60-f1b3-4e48-95be-4a795dd7014e tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:50.403973 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a445ab-46bd-4677-a1d9-18c71d11be18 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0094a2e2d5b461bb8c17703d95ce112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e302b56252524f9da793533e60b9ce6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:50.404634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a445ab-46bd-4677-a1d9-18c71d11be18 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:50.404921 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a445ab-46bd-4677-a1d9-18c71d11be18 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:50.405199 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a445ab-46bd-4677-a1d9-18c71d11be18 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:50.405913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a445ab-46bd-4677-a1d9-18c71d11be18 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:17:50.406222 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a445ab-46bd-4677-a1d9-18c71d11be18 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:50.407852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a445ab-46bd-4677-a1d9-18c71d11be18 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:50.419004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1394/2772] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:17:50.455391 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a836c6a-eef9-4f03-a58d-227a468389a1 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:50.466126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a836c6a-eef9-4f03-a58d-227a468389a1 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:50.470685 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12c9b7-4800-4a9d-8186-1499717f525d tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0094a2e2d5b461bb8c17703d95ce112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e302b56252524f9da793533e60b9ce6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:50.471560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12c9b7-4800-4a9d-8186-1499717f525d tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:50.471846 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12c9b7-4800-4a9d-8186-1499717f525d tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:50.472118 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12c9b7-4800-4a9d-8186-1499717f525d tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] PATH_INFO: `/v3/projects/947f0f40484e468597c64fa0a9b272f6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:50.473283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12c9b7-4800-4a9d-8186-1499717f525d tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] RBAC: Authorizing `identity:delete_project(project_id=947f0f40484e468597c64fa0a9b272f6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:50.475439 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12c9b7-4800-4a9d-8186-1499717f525d tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:50.617910 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed12c9b7-4800-4a9d-8186-1499717f525d tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947f0f40484e468597c64fa0a9b272f6', 'request_id': 'req-ed12c9b7-4800-4a9d-8186-1499717f525d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:50.682881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed12c9b7-4800-4a9d-8186-1499717f525d tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947f0f40484e468597c64fa0a9b272f6', 'request_id': 'req-ed12c9b7-4800-4a9d-8186-1499717f525d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:50.688761 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed12c9b7-4800-4a9d-8186-1499717f525d tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947f0f40484e468597c64fa0a9b272f6', 'request_id': 'req-ed12c9b7-4800-4a9d-8186-1499717f525d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:50.702648 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed12c9b7-4800-4a9d-8186-1499717f525d tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] The token cache is being invalidate because project 947f0f40484e468597c64fa0a9b272f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:50.703024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed12c9b7-4800-4a9d-8186-1499717f525d tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:50.703907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ed12c9b7-4800-4a9d-8186-1499717f525d tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:50.706038 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1379/2773] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:50 2022] DELETE /identity/v3/projects/947f0f40484e468597c64fa0a9b272f6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:51.632433 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a445ab-46bd-4677-a1d9-18c71d11be18 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:51.634253 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-65a445ab-46bd-4677-a1d9-18c71d11be18 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:51.700763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a445ab-46bd-4677-a1d9-18c71d11be18 tempest-VolumeQuotaClassesTest-1473558215 tempest-VolumeQuotaClassesTest-1473558215-project-admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:51.755516 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8623c6-36d0-480c-891f-a57c39f73071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:51.756381 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8623c6-36d0-480c-891f-a57c39f73071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:51.756658 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8623c6-36d0-480c-891f-a57c39f73071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:51.756928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8623c6-36d0-480c-891f-a57c39f73071 admin admin] PATH_INFO: `/v3/users/250031778d534d3b8aafaf08941b81d9` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:51.758097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8623c6-36d0-480c-891f-a57c39f73071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=250031778d534d3b8aafaf08941b81d9)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:51.760195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8623c6-36d0-480c-891f-a57c39f73071 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:51.969988 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd8623c6-36d0-480c-891f-a57c39f73071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '250031778d534d3b8aafaf08941b81d9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:51.981493 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd8623c6-36d0-480c-891f-a57c39f73071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '250031778d534d3b8aafaf08941b81d9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:52.064565 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd8623c6-36d0-480c-891f-a57c39f73071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '250031778d534d3b8aafaf08941b81d9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:52.065200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd8623c6-36d0-480c-891f-a57c39f73071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '250031778d534d3b8aafaf08941b81d9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:52.065800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd8623c6-36d0-480c-891f-a57c39f73071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '250031778d534d3b8aafaf08941b81d9'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:52.078915 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1395/2774] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:17:51 2022] DELETE /identity/v3/users/250031778d534d3b8aafaf08941b81d9 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:52.083554 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a047b0-194b-4ca4-9aaa-73f8fc4fd652 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:52.084069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a047b0-194b-4ca4-9aaa-73f8fc4fd652 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:52.084179 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a047b0-194b-4ca4-9aaa-73f8fc4fd652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:52.101021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-45a047b0-194b-4ca4-9aaa-73f8fc4fd652 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:52.102231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-45a047b0-194b-4ca4-9aaa-73f8fc4fd652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:52.164497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1380/2775] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:52.174014 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8623c6-36d0-480c-891f-a57c39f73071 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:52.175496 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bd8623c6-36d0-480c-891f-a57c39f73071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:52.239096 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8623c6-36d0-480c-891f-a57c39f73071 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:52.242633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28e97e-fcbd-42f5-b23e-a4081c75e2af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:52.243307 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28e97e-fcbd-42f5-b23e-a4081c75e2af service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:52.243589 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28e97e-fcbd-42f5-b23e-a4081c75e2af service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:52.243862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28e97e-fcbd-42f5-b23e-a4081c75e2af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:52.257067 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28e97e-fcbd-42f5-b23e-a4081c75e2af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:52.260725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28e97e-fcbd-42f5-b23e-a4081c75e2af service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:52.271567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1396/2776] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:52.707493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a047b0-194b-4ca4-9aaa-73f8fc4fd652 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:52.709769 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-45a047b0-194b-4ca4-9aaa-73f8fc4fd652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:52.722621 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a047b0-194b-4ca4-9aaa-73f8fc4fd652 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:52.728126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fad25-b47e-4907-b8e4-367c05ff2c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:52.729691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fad25-b47e-4907-b8e4-367c05ff2c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:52.730133 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fad25-b47e-4907-b8e4-367c05ff2c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:52.730485 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fad25-b47e-4907-b8e4-367c05ff2c6e admin admin] PATH_INFO: `/v3/projects/619aac1a13a3428baf4eaa63307fa24d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:52.731710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fad25-b47e-4907-b8e4-367c05ff2c6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=619aac1a13a3428baf4eaa63307fa24d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:52.733620 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fad25-b47e-4907-b8e4-367c05ff2c6e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:52.899845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e14fad25-b47e-4907-b8e4-367c05ff2c6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619aac1a13a3428baf4eaa63307fa24d', 'request_id': 'req-e14fad25-b47e-4907-b8e4-367c05ff2c6e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:52.963120 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e14fad25-b47e-4907-b8e4-367c05ff2c6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619aac1a13a3428baf4eaa63307fa24d', 'request_id': 'req-e14fad25-b47e-4907-b8e4-367c05ff2c6e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:52.969181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e14fad25-b47e-4907-b8e4-367c05ff2c6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619aac1a13a3428baf4eaa63307fa24d', 'request_id': 'req-e14fad25-b47e-4907-b8e4-367c05ff2c6e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:52.981231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e14fad25-b47e-4907-b8e4-367c05ff2c6e admin admin] The token cache is being invalidate because project 619aac1a13a3428baf4eaa63307fa24d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:52.981521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e14fad25-b47e-4907-b8e4-367c05ff2c6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:52.982173 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e14fad25-b47e-4907-b8e4-367c05ff2c6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:52.986131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1381/2777] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:52 2022] DELETE /identity/v3/projects/619aac1a13a3428baf4eaa63307fa24d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:52.987844 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28e97e-fcbd-42f5-b23e-a4081c75e2af service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:52.998204 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28e97e-fcbd-42f5-b23e-a4081c75e2af service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:53.055382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4fa2d-0650-4450-8244-2d0321012f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:53.056260 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4fa2d-0650-4450-8244-2d0321012f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:53.056541 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4fa2d-0650-4450-8244-2d0321012f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:53.057334 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4fa2d-0650-4450-8244-2d0321012f00 admin admin] PATH_INFO: `/v3/users/e0094a2e2d5b461bb8c17703d95ce112` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:53.059716 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4fa2d-0650-4450-8244-2d0321012f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0094a2e2d5b461bb8c17703d95ce112)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:53.059850 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afef89-fd5a-4f57-9c1e-d74d5f043f3d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:53.060066 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afef89-fd5a-4f57-9c1e-d74d5f043f3d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:53.060320 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afef89-fd5a-4f57-9c1e-d74d5f043f3d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:53.061691 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4fa2d-0650-4450-8244-2d0321012f00 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:53.061829 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1382/2778] 10.222.0.24 () {54 vars in 921 bytes} [Tue May 17 22:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 22:17:53.067805 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd899b-5be9-4100-ba16-26867a818183 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:53.068224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd899b-5be9-4100-ba16-26867a818183 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:53.068693 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd899b-5be9-4100-ba16-26867a818183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:53.090549 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-83bd899b-5be9-4100-ba16-26867a818183 None None] MFA Rules not processed for user `c084b56d682c44119654743809109bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:53.091798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-83bd899b-5be9-4100-ba16-26867a818183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:53.142125 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1383/2779] 10.222.0.24 () {58 vars in 1018 bytes} [Tue May 17 22:17:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:53.154278 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd899b-5be9-4100-ba16-26867a818183 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:53.155680 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-83bd899b-5be9-4100-ba16-26867a818183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:53.165779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd899b-5be9-4100-ba16-26867a818183 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:53.169521 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bb8f0-9e8c-4e37-967e-90885f0d07be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:53.170159 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bb8f0-9e8c-4e37-967e-90885f0d07be service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:53.170442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bb8f0-9e8c-4e37-967e-90885f0d07be service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:53.170720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bb8f0-9e8c-4e37-967e-90885f0d07be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:53.177655 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bb8f0-9e8c-4e37-967e-90885f0d07be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:53.179065 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bb8f0-9e8c-4e37-967e-90885f0d07be service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:53.187505 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1384/2780] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:17:53.249878 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fbd4fa2d-0650-4450-8244-2d0321012f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0094a2e2d5b461bb8c17703d95ce112'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:53.261631 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fbd4fa2d-0650-4450-8244-2d0321012f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0094a2e2d5b461bb8c17703d95ce112'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:53.273337 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b0003-8185-4609-ba9b-aebb46f587b8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:53.273628 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b0003-8185-4609-ba9b-aebb46f587b8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:53.273903 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b0003-8185-4609-ba9b-aebb46f587b8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:53.275325 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1385/2781] 10.222.0.24 () {54 vars in 921 bytes} [Tue May 17 22:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 22:17:53.281128 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1da8e6-fdc1-4d7c-99f5-334534114da2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:53.281412 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1da8e6-fdc1-4d7c-99f5-334534114da2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:53.281689 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1da8e6-fdc1-4d7c-99f5-334534114da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:53.300617 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cd1da8e6-fdc1-4d7c-99f5-334534114da2 None None] MFA Rules not processed for user `8d06113649924eae83d04bc22337bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:53.301823 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cd1da8e6-fdc1-4d7c-99f5-334534114da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:53.338881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fbd4fa2d-0650-4450-8244-2d0321012f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0094a2e2d5b461bb8c17703d95ce112'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:53.339513 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fbd4fa2d-0650-4450-8244-2d0321012f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0094a2e2d5b461bb8c17703d95ce112'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:53.340102 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fbd4fa2d-0650-4450-8244-2d0321012f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0094a2e2d5b461bb8c17703d95ce112'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:53.353016 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1397/2782] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:17:52 2022] DELETE /identity/v3/users/e0094a2e2d5b461bb8c17703d95ce112 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:53.367657 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1386/2783] 10.222.0.24 () {58 vars in 1018 bytes} [Tue May 17 22:17:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:17:53.379154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4fa2d-0650-4450-8244-2d0321012f00 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:53.380568 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fbd4fa2d-0650-4450-8244-2d0321012f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:53.437959 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4fa2d-0650-4450-8244-2d0321012f00 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:53.441982 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b86f78-d50b-4cf0-826e-040b3d0109bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:53.442618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b86f78-d50b-4cf0-826e-040b3d0109bf service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:53.442896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b86f78-d50b-4cf0-826e-040b3d0109bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:53.443200 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b86f78-d50b-4cf0-826e-040b3d0109bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:53.508529 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b86f78-d50b-4cf0-826e-040b3d0109bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:53.510030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b86f78-d50b-4cf0-826e-040b3d0109bf service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:53.521127 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1398/2784] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:54.010452 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1da8e6-fdc1-4d7c-99f5-334534114da2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:54.012220 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cd1da8e6-fdc1-4d7c-99f5-334534114da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:54.028494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1da8e6-fdc1-4d7c-99f5-334534114da2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:54.085895 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514994cd-aed6-44d4-9665-eda2b8245e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:54.086748 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514994cd-aed6-44d4-9665-eda2b8245e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:54.087075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514994cd-aed6-44d4-9665-eda2b8245e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:54.087380 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514994cd-aed6-44d4-9665-eda2b8245e6e admin admin] PATH_INFO: `/v3/projects/e302b56252524f9da793533e60b9ce6a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:54.088696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514994cd-aed6-44d4-9665-eda2b8245e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e302b56252524f9da793533e60b9ce6a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:54.090597 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514994cd-aed6-44d4-9665-eda2b8245e6e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:54.185393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-514994cd-aed6-44d4-9665-eda2b8245e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e302b56252524f9da793533e60b9ce6a', 'request_id': 'req-514994cd-aed6-44d4-9665-eda2b8245e6e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:54.265767 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-514994cd-aed6-44d4-9665-eda2b8245e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e302b56252524f9da793533e60b9ce6a', 'request_id': 'req-514994cd-aed6-44d4-9665-eda2b8245e6e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:54.271838 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-514994cd-aed6-44d4-9665-eda2b8245e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e302b56252524f9da793533e60b9ce6a', 'request_id': 'req-514994cd-aed6-44d4-9665-eda2b8245e6e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:54.282905 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-514994cd-aed6-44d4-9665-eda2b8245e6e admin admin] The token cache is being invalidate because project e302b56252524f9da793533e60b9ce6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:17:54.283231 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-514994cd-aed6-44d4-9665-eda2b8245e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:54.283866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-514994cd-aed6-44d4-9665-eda2b8245e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:17:54.285547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1387/2785] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:17:54 2022] DELETE /identity/v3/projects/e302b56252524f9da793533e60b9ce6a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:54.290514 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7454d5-f638-4117-8715-c7aad23bedf0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:54.291039 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7454d5-f638-4117-8715-c7aad23bedf0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:54.291673 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7454d5-f638-4117-8715-c7aad23bedf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:54.312814 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6b7454d5-f638-4117-8715-c7aad23bedf0 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:54.314417 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6b7454d5-f638-4117-8715-c7aad23bedf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:54.380897 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1399/2786] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:54.382479 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b996f9-2d3c-49c1-9dcc-57be6b653738 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:54.382807 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b996f9-2d3c-49c1-9dcc-57be6b653738 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:54.383126 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b996f9-2d3c-49c1-9dcc-57be6b653738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:54.401911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f1b996f9-2d3c-49c1-9dcc-57be6b653738 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:54.403135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f1b996f9-2d3c-49c1-9dcc-57be6b653738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:54.411301 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1388/2787] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:54.415607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7454d5-f638-4117-8715-c7aad23bedf0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:54.425525 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7454d5-f638-4117-8715-c7aad23bedf0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:54.430136 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36234fa1-e6f6-4ef5-8133-d828a5c3762f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:54.430783 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36234fa1-e6f6-4ef5-8133-d828a5c3762f admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:54.431062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36234fa1-e6f6-4ef5-8133-d828a5c3762f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:54.431369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36234fa1-e6f6-4ef5-8133-d828a5c3762f admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:54.432897 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36234fa1-e6f6-4ef5-8133-d828a5c3762f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:17:54.433209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36234fa1-e6f6-4ef5-8133-d828a5c3762f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:54.434813 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36234fa1-e6f6-4ef5-8133-d828a5c3762f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:54.446553 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1400/2788] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:17:54.451018 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b996f9-2d3c-49c1-9dcc-57be6b653738 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:54.460259 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b996f9-2d3c-49c1-9dcc-57be6b653738 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:54.465054 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118882d-f06d-41d6-ab38-ba10a161ff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:54.465699 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118882d-f06d-41d6-ab38-ba10a161ff72 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:54.465983 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118882d-f06d-41d6-ab38-ba10a161ff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:54.466258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118882d-f06d-41d6-ab38-ba10a161ff72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:54.466941 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118882d-f06d-41d6-ab38-ba10a161ff72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:54.468859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118882d-f06d-41d6-ab38-ba10a161ff72 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:54.588510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1389/2789] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:17:54 2022] POST /identity/v3/projects => generated 407 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:54.591234 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36234fa1-e6f6-4ef5-8133-d828a5c3762f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:54.601066 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36234fa1-e6f6-4ef5-8133-d828a5c3762f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:54.658841 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12e96d-73b8-42d3-89f3-80db8e8cfabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:54.659490 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12e96d-73b8-42d3-89f3-80db8e8cfabb admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:54.659767 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12e96d-73b8-42d3-89f3-80db8e8cfabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:54.660068 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12e96d-73b8-42d3-89f3-80db8e8cfabb admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:54.660800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12e96d-73b8-42d3-89f3-80db8e8cfabb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:54.662683 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12e96d-73b8-42d3-89f3-80db8e8cfabb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:54.740495 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1401/2790] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:17:54 2022] POST /identity/v3/users => generated 304 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:54.745134 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118882d-f06d-41d6-ab38-ba10a161ff72 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:54.755223 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118882d-f06d-41d6-ab38-ba10a161ff72 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:54.760428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c6eed-8eac-4e78-a2cb-4d89db4bf277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:54.761561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c6eed-8eac-4e78-a2cb-4d89db4bf277 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:54.762051 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c6eed-8eac-4e78-a2cb-4d89db4bf277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:54.762430 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c6eed-8eac-4e78-a2cb-4d89db4bf277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:54.763860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c6eed-8eac-4e78-a2cb-4d89db4bf277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:54.765999 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c6eed-8eac-4e78-a2cb-4d89db4bf277 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:54.784006 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1390/2791] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:54.788102 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12e96d-73b8-42d3-89f3-80db8e8cfabb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:54.798616 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12e96d-73b8-42d3-89f3-80db8e8cfabb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:54.803148 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b0b38-6c8b-4504-be95-dcceeba393ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:54.803806 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b0b38-6c8b-4504-be95-dcceeba393ae admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:54.804081 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b0b38-6c8b-4504-be95-dcceeba393ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:54.804352 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b0b38-6c8b-4504-be95-dcceeba393ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:54.805093 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b0b38-6c8b-4504-be95-dcceeba393ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:54.806666 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b0b38-6c8b-4504-be95-dcceeba393ae admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:54.816751 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1402/2792] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:54.820882 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c6eed-8eac-4e78-a2cb-4d89db4bf277 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:54.832828 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c6eed-8eac-4e78-a2cb-4d89db4bf277 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:54.839542 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42050c8-5f15-498c-9776-557ea5e96ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:54.840535 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42050c8-5f15-498c-9776-557ea5e96ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:54.840896 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42050c8-5f15-498c-9776-557ea5e96ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:54.841173 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42050c8-5f15-498c-9776-557ea5e96ceb admin admin] PATH_INFO: `/v3/projects/07efd5885d254960b18520449af45a0b/users/6492bf88a2c347b38a7b2de78ed18ed0/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:54.856763 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42050c8-5f15-498c-9776-557ea5e96ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=07efd5885d254960b18520449af45a0b, user_id=6492bf88a2c347b38a7b2de78ed18ed0, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:54.859457 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42050c8-5f15-498c-9776-557ea5e96ceb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:54.927930 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1391/2793] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:54 2022] PUT /identity/v3/projects/07efd5885d254960b18520449af45a0b/users/6492bf88a2c347b38a7b2de78ed18ed0/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:54.938935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b0663-40e3-4f1f-8597-6b430a79f4b0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:54.939263 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b0663-40e3-4f1f-8597-6b430a79f4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:54.939545 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b0663-40e3-4f1f-8597-6b430a79f4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:54.966551 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6e0b0663-40e3-4f1f-8597-6b430a79f4b0 None None] MFA Rules not processed for user `6492bf88a2c347b38a7b2de78ed18ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:54.967782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6e0b0663-40e3-4f1f-8597-6b430a79f4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:55.032261 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1403/2794] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:55.036846 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42050c8-5f15-498c-9776-557ea5e96ceb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:55.098925 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42050c8-5f15-498c-9776-557ea5e96ceb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:55.103700 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c7be8-32c3-47d9-8657-3a08f770b345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:55.104641 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c7be8-32c3-47d9-8657-3a08f770b345 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:55.104925 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c7be8-32c3-47d9-8657-3a08f770b345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:55.105200 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c7be8-32c3-47d9-8657-3a08f770b345 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:55.105884 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c7be8-32c3-47d9-8657-3a08f770b345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:55.107920 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c7be8-32c3-47d9-8657-3a08f770b345 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:55.208474 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1392/2795] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:17:55 2022] POST /identity/v3/projects => generated 409 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:17:55.209580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b0663-40e3-4f1f-8597-6b430a79f4b0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:55.221511 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b0663-40e3-4f1f-8597-6b430a79f4b0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:55.283004 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0670064-d889-48eb-8c64-88078ebafa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:55.284567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0670064-d889-48eb-8c64-88078ebafa17 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:55.284567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0670064-d889-48eb-8c64-88078ebafa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:55.284567 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0670064-d889-48eb-8c64-88078ebafa17 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:55.285046 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0670064-d889-48eb-8c64-88078ebafa17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:55.287020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0670064-d889-48eb-8c64-88078ebafa17 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:55.363778 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1404/2796] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:17:55 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:17:55.367879 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c7be8-32c3-47d9-8657-3a08f770b345 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:55.379561 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c7be8-32c3-47d9-8657-3a08f770b345 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:55.385639 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a13aaa-c258-4ce0-89d3-dcc0ee61bd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:55.386821 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a13aaa-c258-4ce0-89d3-dcc0ee61bd77 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:55.387142 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a13aaa-c258-4ce0-89d3-dcc0ee61bd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:55.387427 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a13aaa-c258-4ce0-89d3-dcc0ee61bd77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:55.388155 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a13aaa-c258-4ce0-89d3-dcc0ee61bd77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:55.389743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a13aaa-c258-4ce0-89d3-dcc0ee61bd77 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:55.401000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1393/2797] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:17:55.406142 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0670064-d889-48eb-8c64-88078ebafa17 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:55.420580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0670064-d889-48eb-8c64-88078ebafa17 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:55.425188 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a58a-1f58-42f4-9d42-15b9667200c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:55.426062 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a58a-1f58-42f4-9d42-15b9667200c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:55.426337 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a58a-1f58-42f4-9d42-15b9667200c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:55.426610 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a58a-1f58-42f4-9d42-15b9667200c0 admin admin] PATH_INFO: `/v3/projects/2227f55def9543dc902ac7f5a506a900/users/30c43a8041d54a56ad05619bc84ea240/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:55.450209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871a58a-1f58-42f4-9d42-15b9667200c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2227f55def9543dc902ac7f5a506a900, user_id=30c43a8041d54a56ad05619bc84ea240, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:55.452907 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871a58a-1f58-42f4-9d42-15b9667200c0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:55.534899 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1405/2798] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:55 2022] PUT /identity/v3/projects/2227f55def9543dc902ac7f5a506a900/users/30c43a8041d54a56ad05619bc84ea240/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:55.539080 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a13aaa-c258-4ce0-89d3-dcc0ee61bd77 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:55.549428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a13aaa-c258-4ce0-89d3-dcc0ee61bd77 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:55.605890 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16667693-24be-478b-9882-0a9cce1ad769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:55.606551 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667693-24be-478b-9882-0a9cce1ad769 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:55.606831 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667693-24be-478b-9882-0a9cce1ad769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:55.607118 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667693-24be-478b-9882-0a9cce1ad769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:55.607849 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16667693-24be-478b-9882-0a9cce1ad769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:55.609413 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16667693-24be-478b-9882-0a9cce1ad769 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:55.618833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1394/2799] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 22:17:55.623696 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a58a-1f58-42f4-9d42-15b9667200c0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:55.633715 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a58a-1f58-42f4-9d42-15b9667200c0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:55.639129 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80ff65-fec5-409a-b8e9-ee97eb95e47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:55.640031 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80ff65-fec5-409a-b8e9-ee97eb95e47d admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:55.640309 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80ff65-fec5-409a-b8e9-ee97eb95e47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:55.640580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80ff65-fec5-409a-b8e9-ee97eb95e47d admin admin] PATH_INFO: `/v3/projects/2227f55def9543dc902ac7f5a506a900/users/30c43a8041d54a56ad05619bc84ea240/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:55.642486 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80ff65-fec5-409a-b8e9-ee97eb95e47d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2227f55def9543dc902ac7f5a506a900, user_id=30c43a8041d54a56ad05619bc84ea240, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:55.645097 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80ff65-fec5-409a-b8e9-ee97eb95e47d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:55.655247 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1406/2800] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:17:55 2022] PUT /identity/v3/projects/2227f55def9543dc902ac7f5a506a900/users/30c43a8041d54a56ad05619bc84ea240/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:17:55.674633 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0ea2d-ccfc-4c96-b4f4-deb0f6f8644d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:55.674969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0ea2d-ccfc-4c96-b4f4-deb0f6f8644d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:55.675283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0ea2d-ccfc-4c96-b4f4-deb0f6f8644d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:55.711454 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f0e0ea2d-ccfc-4c96-b4f4-deb0f6f8644d None None] MFA Rules not processed for user `30c43a8041d54a56ad05619bc84ea240`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:17:55.712661 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f0e0ea2d-ccfc-4c96-b4f4-deb0f6f8644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:55.779751 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1395/2801] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:17:55 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:17:55.790873 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80ff65-fec5-409a-b8e9-ee97eb95e47d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:55.792879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fa80ff65-fec5-409a-b8e9-ee97eb95e47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:17:55.852792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80ff65-fec5-409a-b8e9-ee97eb95e47d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:55.856537 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e6ee0-d48e-4951-acc3-e5f589c62c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:55.857181 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e6ee0-d48e-4951-acc3-e5f589c62c60 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:55.857461 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e6ee0-d48e-4951-acc3-e5f589c62c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:55.857732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e6ee0-d48e-4951-acc3-e5f589c62c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:55.867792 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e6ee0-d48e-4951-acc3-e5f589c62c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:55.869312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e6ee0-d48e-4951-acc3-e5f589c62c60 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:55.878783 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1407/2802] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:55 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:17:56.216940 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0ea2d-ccfc-4c96-b4f4-deb0f6f8644d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:17:56.226668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0ea2d-ccfc-4c96-b4f4-deb0f6f8644d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:17:56.230982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6011aab-aa9a-4f04-8e75-6c135a911a60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:17:56.231686 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6011aab-aa9a-4f04-8e75-6c135a911a60 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:17:56.231964 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6011aab-aa9a-4f04-8e75-6c135a911a60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:17:56.232241 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6011aab-aa9a-4f04-8e75-6c135a911a60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:17:56.289003 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6011aab-aa9a-4f04-8e75-6c135a911a60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:17:56.290443 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6011aab-aa9a-4f04-8e75-6c135a911a60 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:17:56.300555 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1396/2803] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:17:56 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:18:05.011406 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e6ee0-d48e-4951-acc3-e5f589c62c60 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:05.073469 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e6ee0-d48e-4951-acc3-e5f589c62c60 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:05.078074 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614b272-9419-4669-9f3e-c80ce6647516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:05.078942 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b272-9419-4669-9f3e-c80ce6647516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:05.079256 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b272-9419-4669-9f3e-c80ce6647516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:05.079619 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b272-9419-4669-9f3e-c80ce6647516 admin admin] PATH_INFO: `/v3/users/6492bf88a2c347b38a7b2de78ed18ed0` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:05.080732 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614b272-9419-4669-9f3e-c80ce6647516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6492bf88a2c347b38a7b2de78ed18ed0)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:05.082618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614b272-9419-4669-9f3e-c80ce6647516 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:05.278229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a614b272-9419-4669-9f3e-c80ce6647516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6492bf88a2c347b38a7b2de78ed18ed0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:05.289540 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a614b272-9419-4669-9f3e-c80ce6647516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6492bf88a2c347b38a7b2de78ed18ed0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:05.391194 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a614b272-9419-4669-9f3e-c80ce6647516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6492bf88a2c347b38a7b2de78ed18ed0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:05.391795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a614b272-9419-4669-9f3e-c80ce6647516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6492bf88a2c347b38a7b2de78ed18ed0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:05.392379 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a614b272-9419-4669-9f3e-c80ce6647516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6492bf88a2c347b38a7b2de78ed18ed0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:05.404598 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1408/2804] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:18:05 2022] DELETE /identity/v3/users/6492bf88a2c347b38a7b2de78ed18ed0 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:05.409129 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c1297-a55c-4416-ade9-aef8697f7489 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:05.409608 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c1297-a55c-4416-ade9-aef8697f7489 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:05.409710 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c1297-a55c-4416-ade9-aef8697f7489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:05.426970 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-118c1297-a55c-4416-ade9-aef8697f7489 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:05.428224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-118c1297-a55c-4416-ade9-aef8697f7489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:05.485826 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1397/2805] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:18:05.496178 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614b272-9419-4669-9f3e-c80ce6647516 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:05.497728 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a614b272-9419-4669-9f3e-c80ce6647516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:05.553374 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614b272-9419-4669-9f3e-c80ce6647516 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:05.557747 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df2ee9-112b-48b7-b280-9086677c5085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:05.558393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df2ee9-112b-48b7-b280-9086677c5085 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:05.558681 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df2ee9-112b-48b7-b280-9086677c5085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:05.559001 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df2ee9-112b-48b7-b280-9086677c5085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:05.568345 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df2ee9-112b-48b7-b280-9086677c5085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:05.569777 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df2ee9-112b-48b7-b280-9086677c5085 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:05.579152 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1409/2806] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:18:05.942573 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c1297-a55c-4416-ade9-aef8697f7489 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:05.944447 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-118c1297-a55c-4416-ade9-aef8697f7489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:05.957041 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c1297-a55c-4416-ade9-aef8697f7489 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:05.962156 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe35eec-9721-4c76-be9c-31bf1a534589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:05.963751 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe35eec-9721-4c76-be9c-31bf1a534589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:05.964038 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe35eec-9721-4c76-be9c-31bf1a534589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:05.964317 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe35eec-9721-4c76-be9c-31bf1a534589 admin admin] PATH_INFO: `/v3/projects/07efd5885d254960b18520449af45a0b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:05.965563 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe35eec-9721-4c76-be9c-31bf1a534589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07efd5885d254960b18520449af45a0b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:05.967592 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe35eec-9721-4c76-be9c-31bf1a534589 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:06.082725 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dfe35eec-9721-4c76-be9c-31bf1a534589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07efd5885d254960b18520449af45a0b', 'request_id': 'req-dfe35eec-9721-4c76-be9c-31bf1a534589'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:06.156922 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dfe35eec-9721-4c76-be9c-31bf1a534589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07efd5885d254960b18520449af45a0b', 'request_id': 'req-dfe35eec-9721-4c76-be9c-31bf1a534589'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:06.162412 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dfe35eec-9721-4c76-be9c-31bf1a534589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07efd5885d254960b18520449af45a0b', 'request_id': 'req-dfe35eec-9721-4c76-be9c-31bf1a534589'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:06.173516 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dfe35eec-9721-4c76-be9c-31bf1a534589 admin admin] The token cache is being invalidate because project 07efd5885d254960b18520449af45a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:18:06.173800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dfe35eec-9721-4c76-be9c-31bf1a534589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:06.174428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dfe35eec-9721-4c76-be9c-31bf1a534589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:06.176051 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1398/2807] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:18:05 2022] DELETE /identity/v3/projects/07efd5885d254960b18520449af45a0b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:06.179987 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df2ee9-112b-48b7-b280-9086677c5085 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:06.189794 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df2ee9-112b-48b7-b280-9086677c5085 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:06.258298 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f12ce-9d5d-489f-982e-e8b3de7eabd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:06.259179 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f12ce-9d5d-489f-982e-e8b3de7eabd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:06.260005 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f12ce-9d5d-489f-982e-e8b3de7eabd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:06.260273 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f12ce-9d5d-489f-982e-e8b3de7eabd7 admin admin] PATH_INFO: `/v3/users/30c43a8041d54a56ad05619bc84ea240` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:06.261446 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f12ce-9d5d-489f-982e-e8b3de7eabd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30c43a8041d54a56ad05619bc84ea240)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:06.263398 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f12ce-9d5d-489f-982e-e8b3de7eabd7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:06.439257 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9c5f12ce-9d5d-489f-982e-e8b3de7eabd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30c43a8041d54a56ad05619bc84ea240'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:06.450723 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9c5f12ce-9d5d-489f-982e-e8b3de7eabd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30c43a8041d54a56ad05619bc84ea240'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:06.533613 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9c5f12ce-9d5d-489f-982e-e8b3de7eabd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30c43a8041d54a56ad05619bc84ea240'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:06.534223 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9c5f12ce-9d5d-489f-982e-e8b3de7eabd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30c43a8041d54a56ad05619bc84ea240'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:06.534824 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9c5f12ce-9d5d-489f-982e-e8b3de7eabd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30c43a8041d54a56ad05619bc84ea240'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:06.548171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1410/2808] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:18:06 2022] DELETE /identity/v3/users/30c43a8041d54a56ad05619bc84ea240 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:06.929924 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe35eec-9721-4c76-be9c-31bf1a534589 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:06.933867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dfe35eec-9721-4c76-be9c-31bf1a534589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:06.951057 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe35eec-9721-4c76-be9c-31bf1a534589 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:07.017092 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07bdac-aa39-4867-a613-5c35f6f7b46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:07.018063 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07bdac-aa39-4867-a613-5c35f6f7b46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:07.018347 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07bdac-aa39-4867-a613-5c35f6f7b46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:07.018622 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07bdac-aa39-4867-a613-5c35f6f7b46d admin admin] PATH_INFO: `/v3/projects/2227f55def9543dc902ac7f5a506a900` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:07.019836 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07bdac-aa39-4867-a613-5c35f6f7b46d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2227f55def9543dc902ac7f5a506a900)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:07.022197 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07bdac-aa39-4867-a613-5c35f6f7b46d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:07.158748 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9c07bdac-aa39-4867-a613-5c35f6f7b46d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2227f55def9543dc902ac7f5a506a900', 'request_id': 'req-9c07bdac-aa39-4867-a613-5c35f6f7b46d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:07.214567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9c07bdac-aa39-4867-a613-5c35f6f7b46d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2227f55def9543dc902ac7f5a506a900', 'request_id': 'req-9c07bdac-aa39-4867-a613-5c35f6f7b46d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:07.220529 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9c07bdac-aa39-4867-a613-5c35f6f7b46d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2227f55def9543dc902ac7f5a506a900', 'request_id': 'req-9c07bdac-aa39-4867-a613-5c35f6f7b46d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:07.231642 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9c07bdac-aa39-4867-a613-5c35f6f7b46d admin admin] The token cache is being invalidate because project 2227f55def9543dc902ac7f5a506a900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:18:07.231931 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9c07bdac-aa39-4867-a613-5c35f6f7b46d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:07.232560 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9c07bdac-aa39-4867-a613-5c35f6f7b46d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:07.234105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1399/2809] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:18:06 2022] DELETE /identity/v3/projects/2227f55def9543dc902ac7f5a506a900 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:07.238945 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd0ed-df95-43ea-a268-c9561f5888ef None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:07.239449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd0ed-df95-43ea-a268-c9561f5888ef None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:07.239549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd0ed-df95-43ea-a268-c9561f5888ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:07.257881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-487fd0ed-df95-43ea-a268-c9561f5888ef None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:07.259063 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-487fd0ed-df95-43ea-a268-c9561f5888ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:07.318170 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1411/2810] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:18:07.327010 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b883c18-6e7d-45e0-848f-ba824788c0c0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:07.327466 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b883c18-6e7d-45e0-848f-ba824788c0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:07.327756 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b883c18-6e7d-45e0-848f-ba824788c0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:07.346054 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1b883c18-6e7d-45e0-848f-ba824788c0c0 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:07.347294 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1b883c18-6e7d-45e0-848f-ba824788c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:07.355867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1400/2811] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:18:07.359974 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fd0ed-df95-43ea-a268-c9561f5888ef None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:07.369433 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fd0ed-df95-43ea-a268-c9561f5888ef None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:07.373967 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7ffbd-857c-428a-90bc-b445d8754b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:07.374614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7ffbd-857c-428a-90bc-b445d8754b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:07.374898 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7ffbd-857c-428a-90bc-b445d8754b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:07.375205 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7ffbd-857c-428a-90bc-b445d8754b2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:07.375927 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7ffbd-857c-428a-90bc-b445d8754b2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:18:07.376232 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7ffbd-857c-428a-90bc-b445d8754b2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:07.377815 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7ffbd-857c-428a-90bc-b445d8754b2b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:07.389030 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1412/2812] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:18:07.393227 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b883c18-6e7d-45e0-848f-ba824788c0c0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:07.403075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b883c18-6e7d-45e0-848f-ba824788c0c0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:07.407873 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657a19f-c192-4f48-a8ba-4b60f0782532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:07.408517 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657a19f-c192-4f48-a8ba-4b60f0782532 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:07.408855 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657a19f-c192-4f48-a8ba-4b60f0782532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:07.409082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657a19f-c192-4f48-a8ba-4b60f0782532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:07.409773 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657a19f-c192-4f48-a8ba-4b60f0782532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:07.411743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657a19f-c192-4f48-a8ba-4b60f0782532 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:07.506673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1401/2813] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:18:07 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:18:07.511347 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7ffbd-857c-428a-90bc-b445d8754b2b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:07.521301 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7ffbd-857c-428a-90bc-b445d8754b2b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:07.576509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6a1d9-d9c2-470a-bf00-9281ce9ed485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:07.577161 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6a1d9-d9c2-470a-bf00-9281ce9ed485 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:07.577441 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6a1d9-d9c2-470a-bf00-9281ce9ed485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:07.577713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6a1d9-d9c2-470a-bf00-9281ce9ed485 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:07.578389 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6a1d9-d9c2-470a-bf00-9281ce9ed485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:07.580329 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6a1d9-d9c2-470a-bf00-9281ce9ed485 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:07.671924 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1413/2814] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:18:07 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:18:07.675946 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657a19f-c192-4f48-a8ba-4b60f0782532 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:07.687210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657a19f-c192-4f48-a8ba-4b60f0782532 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:07.692288 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed3efc-c568-4b7a-9735-de0a2b515c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:07.693042 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed3efc-c568-4b7a-9735-de0a2b515c3e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:07.693330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed3efc-c568-4b7a-9735-de0a2b515c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:07.693615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed3efc-c568-4b7a-9735-de0a2b515c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:07.694376 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed3efc-c568-4b7a-9735-de0a2b515c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:07.695997 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed3efc-c568-4b7a-9735-de0a2b515c3e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:07.707653 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1402/2815] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:18:07.711713 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6a1d9-d9c2-470a-bf00-9281ce9ed485 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:07.721782 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6a1d9-d9c2-470a-bf00-9281ce9ed485 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:07.726393 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aa0f6-1629-43b2-aedd-4e2cbc9451aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:07.727058 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa0f6-1629-43b2-aedd-4e2cbc9451aa admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:07.727373 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa0f6-1629-43b2-aedd-4e2cbc9451aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:07.727650 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa0f6-1629-43b2-aedd-4e2cbc9451aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:07.728883 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aa0f6-1629-43b2-aedd-4e2cbc9451aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:07.730463 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aa0f6-1629-43b2-aedd-4e2cbc9451aa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:07.740241 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1414/2816] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:18:07.745074 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed3efc-c568-4b7a-9735-de0a2b515c3e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:07.755084 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed3efc-c568-4b7a-9735-de0a2b515c3e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:07.759828 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa837b-7bb4-4389-8624-4c154ccec763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:07.760718 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa837b-7bb4-4389-8624-4c154ccec763 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:07.760982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa837b-7bb4-4389-8624-4c154ccec763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:07.761266 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa837b-7bb4-4389-8624-4c154ccec763 admin admin] PATH_INFO: `/v3/projects/a9fed27cccb04d73b87f39cbef32c8a2/users/02fe537b4838448d86e0b570b8117f95/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:07.776375 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa837b-7bb4-4389-8624-4c154ccec763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9fed27cccb04d73b87f39cbef32c8a2, user_id=02fe537b4838448d86e0b570b8117f95, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:07.779072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa837b-7bb4-4389-8624-4c154ccec763 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:07.824783 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1403/2817] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:18:07 2022] PUT /identity/v3/projects/a9fed27cccb04d73b87f39cbef32c8a2/users/02fe537b4838448d86e0b570b8117f95/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:07.834994 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0d7a0-7c5c-4f31-a129-2ef524892c2f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:07.835354 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0d7a0-7c5c-4f31-a129-2ef524892c2f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:07.835636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0d7a0-7c5c-4f31-a129-2ef524892c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:07.862255 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-73c0d7a0-7c5c-4f31-a129-2ef524892c2f None None] MFA Rules not processed for user `02fe537b4838448d86e0b570b8117f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:07.863554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-73c0d7a0-7c5c-4f31-a129-2ef524892c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:07.926682 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1415/2818] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:18:07.931052 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa837b-7bb4-4389-8624-4c154ccec763 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:07.994808 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa837b-7bb4-4389-8624-4c154ccec763 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:08.000181 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3cbbe-4345-4063-97b6-36bba286e661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:08.000845 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3cbbe-4345-4063-97b6-36bba286e661 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:08.001132 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3cbbe-4345-4063-97b6-36bba286e661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:08.001409 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3cbbe-4345-4063-97b6-36bba286e661 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:08.002176 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3cbbe-4345-4063-97b6-36bba286e661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:08.004298 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3cbbe-4345-4063-97b6-36bba286e661 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:08.099088 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1404/2819] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:18:07 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:18:08.100336 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0d7a0-7c5c-4f31-a129-2ef524892c2f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:08.111800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0d7a0-7c5c-4f31-a129-2ef524892c2f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:08.166719 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43948997-094b-448d-bd1f-e1c82c1b6d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:08.167413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43948997-094b-448d-bd1f-e1c82c1b6d80 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:08.167690 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43948997-094b-448d-bd1f-e1c82c1b6d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:08.167980 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43948997-094b-448d-bd1f-e1c82c1b6d80 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:08.168661 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43948997-094b-448d-bd1f-e1c82c1b6d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:08.170547 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43948997-094b-448d-bd1f-e1c82c1b6d80 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:08.255542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1416/2820] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:18:08 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:18:08.262081 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3cbbe-4345-4063-97b6-36bba286e661 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:08.272234 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3cbbe-4345-4063-97b6-36bba286e661 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:08.277495 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60739be-b18a-44ff-96b0-e8f2df0fd9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:08.278157 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60739be-b18a-44ff-96b0-e8f2df0fd9af admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:08.278449 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60739be-b18a-44ff-96b0-e8f2df0fd9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:08.278717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60739be-b18a-44ff-96b0-e8f2df0fd9af admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:08.279479 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60739be-b18a-44ff-96b0-e8f2df0fd9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:08.281086 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60739be-b18a-44ff-96b0-e8f2df0fd9af admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:08.295136 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1405/2821] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:18:08.296506 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43948997-094b-448d-bd1f-e1c82c1b6d80 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:08.307046 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43948997-094b-448d-bd1f-e1c82c1b6d80 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:08.313149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6990c8-f328-46e5-90d2-b3bfa6487133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:08.315298 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6990c8-f328-46e5-90d2-b3bfa6487133 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:08.315649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6990c8-f328-46e5-90d2-b3bfa6487133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:08.315997 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6990c8-f328-46e5-90d2-b3bfa6487133 admin admin] PATH_INFO: `/v3/projects/34f9ecaf609d44f0ad2d601f945e12a5/users/1d904a11ce3249ebaa31a47f5a97b84a/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:08.335043 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6990c8-f328-46e5-90d2-b3bfa6487133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f9ecaf609d44f0ad2d601f945e12a5, user_id=1d904a11ce3249ebaa31a47f5a97b84a, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:08.338362 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6990c8-f328-46e5-90d2-b3bfa6487133 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:08.419171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1417/2822] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:18:08 2022] PUT /identity/v3/projects/34f9ecaf609d44f0ad2d601f945e12a5/users/1d904a11ce3249ebaa31a47f5a97b84a/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:18:08.423027 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60739be-b18a-44ff-96b0-e8f2df0fd9af admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:08.433145 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60739be-b18a-44ff-96b0-e8f2df0fd9af admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:08.489290 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138eae24-015f-4152-85ef-fa7b815df4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:08.489881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eae24-015f-4152-85ef-fa7b815df4af admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:08.490168 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eae24-015f-4152-85ef-fa7b815df4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:08.490446 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eae24-015f-4152-85ef-fa7b815df4af admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:08.491202 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138eae24-015f-4152-85ef-fa7b815df4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:08.492800 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138eae24-015f-4152-85ef-fa7b815df4af admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:08.502385 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1406/2823] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:18:08.506500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6990c8-f328-46e5-90d2-b3bfa6487133 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:08.517566 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6990c8-f328-46e5-90d2-b3bfa6487133 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:08.522168 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb507c3-22bf-4036-9c3a-c0dc3238b33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:08.523037 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb507c3-22bf-4036-9c3a-c0dc3238b33a admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:08.523364 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb507c3-22bf-4036-9c3a-c0dc3238b33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:08.523641 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb507c3-22bf-4036-9c3a-c0dc3238b33a admin admin] PATH_INFO: `/v3/projects/34f9ecaf609d44f0ad2d601f945e12a5/users/1d904a11ce3249ebaa31a47f5a97b84a/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:08.526187 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb507c3-22bf-4036-9c3a-c0dc3238b33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f9ecaf609d44f0ad2d601f945e12a5, user_id=1d904a11ce3249ebaa31a47f5a97b84a, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:08.528823 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb507c3-22bf-4036-9c3a-c0dc3238b33a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:08.538533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1418/2824] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:18:08 2022] PUT /identity/v3/projects/34f9ecaf609d44f0ad2d601f945e12a5/users/1d904a11ce3249ebaa31a47f5a97b84a/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:08.549494 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67cb26-d7ba-44f8-9c1e-7dde7582714f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:08.549790 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67cb26-d7ba-44f8-9c1e-7dde7582714f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:08.550070 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67cb26-d7ba-44f8-9c1e-7dde7582714f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:08.576348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6e67cb26-d7ba-44f8-9c1e-7dde7582714f None None] MFA Rules not processed for user `1d904a11ce3249ebaa31a47f5a97b84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:08.577534 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6e67cb26-d7ba-44f8-9c1e-7dde7582714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:08.642568 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1407/2825] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:18:08.653499 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb507c3-22bf-4036-9c3a-c0dc3238b33a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:08.655132 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bcb507c3-22bf-4036-9c3a-c0dc3238b33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:08.711983 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb507c3-22bf-4036-9c3a-c0dc3238b33a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:08.715690 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e8471-2cf6-4729-957f-c407e4dfb57c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:08.716326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e8471-2cf6-4729-957f-c407e4dfb57c service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:08.716607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e8471-2cf6-4729-957f-c407e4dfb57c service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:08.716881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e8471-2cf6-4729-957f-c407e4dfb57c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:08.771474 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e8471-2cf6-4729-957f-c407e4dfb57c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:08.772834 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e8471-2cf6-4729-957f-c407e4dfb57c service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:08.782235 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1419/2826] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:18:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:18:11.818591 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67cb26-d7ba-44f8-9c1e-7dde7582714f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:11.878861 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67cb26-d7ba-44f8-9c1e-7dde7582714f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:11.883326 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c0667-eae7-4224-b05f-e232e7cec93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:11.884208 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c0667-eae7-4224-b05f-e232e7cec93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:11.885045 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c0667-eae7-4224-b05f-e232e7cec93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:11.885320 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c0667-eae7-4224-b05f-e232e7cec93a admin admin] PATH_INFO: `/v3/users/02fe537b4838448d86e0b570b8117f95` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:11.886510 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c0667-eae7-4224-b05f-e232e7cec93a admin admin] RBAC: Authorizing `identity:delete_user(user_id=02fe537b4838448d86e0b570b8117f95)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:11.888447 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c0667-eae7-4224-b05f-e232e7cec93a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:12.101232 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b74c0667-eae7-4224-b05f-e232e7cec93a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02fe537b4838448d86e0b570b8117f95'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:12.113403 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b74c0667-eae7-4224-b05f-e232e7cec93a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02fe537b4838448d86e0b570b8117f95'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:12.114106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b74c0667-eae7-4224-b05f-e232e7cec93a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02fe537b4838448d86e0b570b8117f95'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:12.197107 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b74c0667-eae7-4224-b05f-e232e7cec93a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02fe537b4838448d86e0b570b8117f95'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:12.197757 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b74c0667-eae7-4224-b05f-e232e7cec93a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02fe537b4838448d86e0b570b8117f95'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:12.211408 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1408/2827] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:18:11 2022] DELETE /identity/v3/users/02fe537b4838448d86e0b570b8117f95 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:12.215931 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663c334-3872-4e6e-8bd2-ac12744020cd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:12.216404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663c334-3872-4e6e-8bd2-ac12744020cd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:12.216646 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663c334-3872-4e6e-8bd2-ac12744020cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:12.235574 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8663c334-3872-4e6e-8bd2-ac12744020cd None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:12.236870 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8663c334-3872-4e6e-8bd2-ac12744020cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:12.294149 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1420/2828] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:18:12.303754 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c0667-eae7-4224-b05f-e232e7cec93a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:12.305143 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b74c0667-eae7-4224-b05f-e232e7cec93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:12.361082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c0667-eae7-4224-b05f-e232e7cec93a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:12.364554 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a1f64-fa61-4308-bdc9-8d28705f319e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:12.365192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a1f64-fa61-4308-bdc9-8d28705f319e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:12.365475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a1f64-fa61-4308-bdc9-8d28705f319e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:12.365753 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a1f64-fa61-4308-bdc9-8d28705f319e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:12.375283 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a1f64-fa61-4308-bdc9-8d28705f319e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:12.376696 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a1f64-fa61-4308-bdc9-8d28705f319e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:12.386173 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1409/2829] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:18:12.890443 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663c334-3872-4e6e-8bd2-ac12744020cd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:12.892003 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8663c334-3872-4e6e-8bd2-ac12744020cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:12.908424 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663c334-3872-4e6e-8bd2-ac12744020cd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:12.916417 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:12.922065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:12.922065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:12.922065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64 admin admin] PATH_INFO: `/v3/projects/a9fed27cccb04d73b87f39cbef32c8a2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:12.922065 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9fed27cccb04d73b87f39cbef32c8a2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:12.924412 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:13.078539 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9fed27cccb04d73b87f39cbef32c8a2', 'request_id': 'req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:13.084675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9fed27cccb04d73b87f39cbef32c8a2', 'request_id': 'req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:13.091525 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9fed27cccb04d73b87f39cbef32c8a2', 'request_id': 'req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:13.207574 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64 admin admin] The token cache is being invalidate because project a9fed27cccb04d73b87f39cbef32c8a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:18:13.207795 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:13.208387 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:13.209968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1421/2830] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:18:12 2022] DELETE /identity/v3/projects/a9fed27cccb04d73b87f39cbef32c8a2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:13.214486 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a1f64-fa61-4308-bdc9-8d28705f319e service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:13.223875 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a1f64-fa61-4308-bdc9-8d28705f319e service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:13.279654 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c319b-e60d-4778-961b-02470fae57f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:13.280535 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c319b-e60d-4778-961b-02470fae57f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:13.280819 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c319b-e60d-4778-961b-02470fae57f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:13.281096 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c319b-e60d-4778-961b-02470fae57f3 admin admin] PATH_INFO: `/v3/users/1d904a11ce3249ebaa31a47f5a97b84a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:13.282289 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c319b-e60d-4778-961b-02470fae57f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d904a11ce3249ebaa31a47f5a97b84a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:13.284251 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c319b-e60d-4778-961b-02470fae57f3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:13.473497 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-681c319b-e60d-4778-961b-02470fae57f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d904a11ce3249ebaa31a47f5a97b84a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:13.485371 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-681c319b-e60d-4778-961b-02470fae57f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d904a11ce3249ebaa31a47f5a97b84a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:13.486020 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-681c319b-e60d-4778-961b-02470fae57f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d904a11ce3249ebaa31a47f5a97b84a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:13.579681 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-681c319b-e60d-4778-961b-02470fae57f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d904a11ce3249ebaa31a47f5a97b84a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:13.580281 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-681c319b-e60d-4778-961b-02470fae57f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d904a11ce3249ebaa31a47f5a97b84a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:13.592627 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1410/2831] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:18:13 2022] DELETE /identity/v3/users/1d904a11ce3249ebaa31a47f5a97b84a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:13.986245 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:13.987884 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:14.002177 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c63d57-cbcf-4500-84d7-3c5fc314dc64 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:14.061020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe65755-f724-45f7-81b5-5ce7893586e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:14.061873 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65755-f724-45f7-81b5-5ce7893586e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:14.062152 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65755-f724-45f7-81b5-5ce7893586e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:14.062422 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65755-f724-45f7-81b5-5ce7893586e3 admin admin] PATH_INFO: `/v3/projects/34f9ecaf609d44f0ad2d601f945e12a5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:14.063953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe65755-f724-45f7-81b5-5ce7893586e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34f9ecaf609d44f0ad2d601f945e12a5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:14.065853 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe65755-f724-45f7-81b5-5ce7893586e3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:14.183957 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cbe65755-f724-45f7-81b5-5ce7893586e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34f9ecaf609d44f0ad2d601f945e12a5', 'request_id': 'req-cbe65755-f724-45f7-81b5-5ce7893586e3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:14.190105 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cbe65755-f724-45f7-81b5-5ce7893586e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34f9ecaf609d44f0ad2d601f945e12a5', 'request_id': 'req-cbe65755-f724-45f7-81b5-5ce7893586e3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:14.195386 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cbe65755-f724-45f7-81b5-5ce7893586e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34f9ecaf609d44f0ad2d601f945e12a5', 'request_id': 'req-cbe65755-f724-45f7-81b5-5ce7893586e3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:14.287364 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cbe65755-f724-45f7-81b5-5ce7893586e3 admin admin] The token cache is being invalidate because project 34f9ecaf609d44f0ad2d601f945e12a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:18:14.287653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cbe65755-f724-45f7-81b5-5ce7893586e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:14.288289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cbe65755-f724-45f7-81b5-5ce7893586e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:14.289842 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1422/2832] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:18:13 2022] DELETE /identity/v3/projects/34f9ecaf609d44f0ad2d601f945e12a5 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:14.295402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3e318-adfb-4816-a8b8-31e7dc7169f9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:14.295928 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3e318-adfb-4816-a8b8-31e7dc7169f9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:14.296050 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3e318-adfb-4816-a8b8-31e7dc7169f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:14.314203 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-15d3e318-adfb-4816-a8b8-31e7dc7169f9 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:14.315421 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-15d3e318-adfb-4816-a8b8-31e7dc7169f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:14.377627 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1411/2833] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:18:14.385890 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff91d8-5a03-414d-8f5f-364533af6757 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:14.386176 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff91d8-5a03-414d-8f5f-364533af6757 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:14.386456 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff91d8-5a03-414d-8f5f-364533af6757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:14.404934 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a1ff91d8-5a03-414d-8f5f-364533af6757 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:14.406122 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a1ff91d8-5a03-414d-8f5f-364533af6757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:14.413935 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1423/2834] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:18:14.418134 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3e318-adfb-4816-a8b8-31e7dc7169f9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:14.427571 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3e318-adfb-4816-a8b8-31e7dc7169f9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:14.432106 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bf5b2-dc11-4c51-a8dd-43039d201394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:14.432748 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bf5b2-dc11-4c51-a8dd-43039d201394 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:14.433029 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bf5b2-dc11-4c51-a8dd-43039d201394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:14.433302 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bf5b2-dc11-4c51-a8dd-43039d201394 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:14.434020 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877bf5b2-dc11-4c51-a8dd-43039d201394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:18:14.434329 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877bf5b2-dc11-4c51-a8dd-43039d201394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:14.435937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877bf5b2-dc11-4c51-a8dd-43039d201394 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:14.447969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1412/2835] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:18:14.452054 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff91d8-5a03-414d-8f5f-364533af6757 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:14.461033 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff91d8-5a03-414d-8f5f-364533af6757 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:14.466278 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e237ec1-8b6f-43dc-8893-b005b4ef4300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:14.466914 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e237ec1-8b6f-43dc-8893-b005b4ef4300 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:14.467241 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e237ec1-8b6f-43dc-8893-b005b4ef4300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:14.467520 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e237ec1-8b6f-43dc-8893-b005b4ef4300 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:14.468211 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e237ec1-8b6f-43dc-8893-b005b4ef4300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:14.470088 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e237ec1-8b6f-43dc-8893-b005b4ef4300 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:14.570303 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1424/2836] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:18:14 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:18:14.575000 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bf5b2-dc11-4c51-a8dd-43039d201394 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:14.584864 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877bf5b2-dc11-4c51-a8dd-43039d201394 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:14.638386 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc3247-5664-4a04-8b15-bf07db44070e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:14.639051 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc3247-5664-4a04-8b15-bf07db44070e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:14.639363 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc3247-5664-4a04-8b15-bf07db44070e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:14.639640 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc3247-5664-4a04-8b15-bf07db44070e admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:14.640330 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc3247-5664-4a04-8b15-bf07db44070e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:14.642255 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc3247-5664-4a04-8b15-bf07db44070e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:14.693458 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1413/2837] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:18:14 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:18:14.698206 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e237ec1-8b6f-43dc-8893-b005b4ef4300 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:14.708765 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e237ec1-8b6f-43dc-8893-b005b4ef4300 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:14.713990 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9150652-68f3-4740-9547-23cd6541dc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:14.714641 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9150652-68f3-4740-9547-23cd6541dc0c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:14.714926 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9150652-68f3-4740-9547-23cd6541dc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:14.715369 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9150652-68f3-4740-9547-23cd6541dc0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:14.716099 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9150652-68f3-4740-9547-23cd6541dc0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:14.717682 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9150652-68f3-4740-9547-23cd6541dc0c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:14.727845 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1425/2838] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:18:14.731803 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc3247-5664-4a04-8b15-bf07db44070e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:14.741490 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc3247-5664-4a04-8b15-bf07db44070e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:14.746628 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f295175-fbd2-428d-9cf8-285c8dadb670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:14.747310 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f295175-fbd2-428d-9cf8-285c8dadb670 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:14.747595 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f295175-fbd2-428d-9cf8-285c8dadb670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:14.747872 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f295175-fbd2-428d-9cf8-285c8dadb670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:14.748591 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f295175-fbd2-428d-9cf8-285c8dadb670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:14.750159 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f295175-fbd2-428d-9cf8-285c8dadb670 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:14.760624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1414/2839] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:18:14.764262 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9150652-68f3-4740-9547-23cd6541dc0c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:14.773843 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9150652-68f3-4740-9547-23cd6541dc0c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:14.778505 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041239e9-9ddd-494c-9106-02b2c3d3b4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:14.779405 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041239e9-9ddd-494c-9106-02b2c3d3b4da admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:14.779688 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041239e9-9ddd-494c-9106-02b2c3d3b4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:14.779969 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041239e9-9ddd-494c-9106-02b2c3d3b4da admin admin] PATH_INFO: `/v3/projects/a1013320610249089e6a04eda77b2d6a/users/a41a53c29c224464b09e728b17115cca/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:14.794018 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041239e9-9ddd-494c-9106-02b2c3d3b4da admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1013320610249089e6a04eda77b2d6a, user_id=a41a53c29c224464b09e728b17115cca, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:14.796678 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041239e9-9ddd-494c-9106-02b2c3d3b4da admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:14.880972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1426/2840] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:18:14 2022] PUT /identity/v3/projects/a1013320610249089e6a04eda77b2d6a/users/a41a53c29c224464b09e728b17115cca/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:14.892137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1386d-0fcc-4404-934b-d663195f660e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:14.892435 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1386d-0fcc-4404-934b-d663195f660e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:14.892717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1386d-0fcc-4404-934b-d663195f660e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:14.918796 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-75c1386d-0fcc-4404-934b-d663195f660e None None] MFA Rules not processed for user `a41a53c29c224464b09e728b17115cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:14.920018 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-75c1386d-0fcc-4404-934b-d663195f660e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:14.986030 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1415/2841] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:18:14.997602 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041239e9-9ddd-494c-9106-02b2c3d3b4da admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:14.999386 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-041239e9-9ddd-494c-9106-02b2c3d3b4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:15.053933 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041239e9-9ddd-494c-9106-02b2c3d3b4da admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:15.058239 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c3ecf-8dd2-4d94-b160-63ce36d300a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f765ee92b36e43478c04db32227a5872', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:15.058871 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c3ecf-8dd2-4d94-b160-63ce36d300a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:15.059178 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c3ecf-8dd2-4d94-b160-63ce36d300a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:15.059455 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c3ecf-8dd2-4d94-b160-63ce36d300a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:15.067998 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c3ecf-8dd2-4d94-b160-63ce36d300a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:15.069415 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c3ecf-8dd2-4d94-b160-63ce36d300a3 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:15.078746 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1427/2842] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:18:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:18:15.103650 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1386d-0fcc-4404-934b-d663195f660e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:15.164342 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1386d-0fcc-4404-934b-d663195f660e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:15.169467 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb26ee7-0ae8-4f4f-a4b5-81a78c104522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:15.170334 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb26ee7-0ae8-4f4f-a4b5-81a78c104522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:15.170615 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb26ee7-0ae8-4f4f-a4b5-81a78c104522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:15.170888 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb26ee7-0ae8-4f4f-a4b5-81a78c104522 admin admin] PATH_INFO: `/v3/users/a41a53c29c224464b09e728b17115cca` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:15.172107 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb26ee7-0ae8-4f4f-a4b5-81a78c104522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41a53c29c224464b09e728b17115cca)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:15.174032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb26ee7-0ae8-4f4f-a4b5-81a78c104522 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:15.369646 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-aeb26ee7-0ae8-4f4f-a4b5-81a78c104522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41a53c29c224464b09e728b17115cca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:15.381137 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-aeb26ee7-0ae8-4f4f-a4b5-81a78c104522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41a53c29c224464b09e728b17115cca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:15.381810 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-aeb26ee7-0ae8-4f4f-a4b5-81a78c104522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41a53c29c224464b09e728b17115cca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:15.448304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-aeb26ee7-0ae8-4f4f-a4b5-81a78c104522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41a53c29c224464b09e728b17115cca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:15.448856 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-aeb26ee7-0ae8-4f4f-a4b5-81a78c104522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41a53c29c224464b09e728b17115cca'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:15.460860 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1416/2843] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:18:15 2022] DELETE /identity/v3/users/a41a53c29c224464b09e728b17115cca => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:15.465434 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb9149-80b5-4fc3-bf6c-d5f913156cab None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:15.465763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb9149-80b5-4fc3-bf6c-d5f913156cab None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:15.466041 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb9149-80b5-4fc3-bf6c-d5f913156cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:15.484346 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6bdb9149-80b5-4fc3-bf6c-d5f913156cab None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:15.485530 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6bdb9149-80b5-4fc3-bf6c-d5f913156cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:15.542580 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1428/2844] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:18:15.552188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb26ee7-0ae8-4f4f-a4b5-81a78c104522 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:15.553580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-aeb26ee7-0ae8-4f4f-a4b5-81a78c104522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:15.608948 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb26ee7-0ae8-4f4f-a4b5-81a78c104522 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:15.612558 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9fd4c-caf8-4d5b-aafd-81224d885c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:15.613192 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9fd4c-caf8-4d5b-aafd-81224d885c2a service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:15.613477 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9fd4c-caf8-4d5b-aafd-81224d885c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:15.613750 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9fd4c-caf8-4d5b-aafd-81224d885c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:15.623089 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9fd4c-caf8-4d5b-aafd-81224d885c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:15.624535 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9fd4c-caf8-4d5b-aafd-81224d885c2a service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:15.636120 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1417/2845] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:18:16.053862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb9149-80b5-4fc3-bf6c-d5f913156cab None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:16.055304 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6bdb9149-80b5-4fc3-bf6c-d5f913156cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:16.068836 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb9149-80b5-4fc3-bf6c-d5f913156cab None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:16.073808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde2984-0fdc-4b83-ad52-a7e0fc019b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:16.074669 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde2984-0fdc-4b83-ad52-a7e0fc019b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:16.074953 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde2984-0fdc-4b83-ad52-a7e0fc019b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:16.075265 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde2984-0fdc-4b83-ad52-a7e0fc019b96 admin admin] PATH_INFO: `/v3/projects/a1013320610249089e6a04eda77b2d6a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:16.076452 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde2984-0fdc-4b83-ad52-a7e0fc019b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1013320610249089e6a04eda77b2d6a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:16.078342 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde2984-0fdc-4b83-ad52-a7e0fc019b96 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:16.184653 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4cde2984-0fdc-4b83-ad52-a7e0fc019b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1013320610249089e6a04eda77b2d6a', 'request_id': 'req-4cde2984-0fdc-4b83-ad52-a7e0fc019b96'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:16.201489 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4cde2984-0fdc-4b83-ad52-a7e0fc019b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1013320610249089e6a04eda77b2d6a', 'request_id': 'req-4cde2984-0fdc-4b83-ad52-a7e0fc019b96'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:16.206936 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4cde2984-0fdc-4b83-ad52-a7e0fc019b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1013320610249089e6a04eda77b2d6a', 'request_id': 'req-4cde2984-0fdc-4b83-ad52-a7e0fc019b96'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:16.274219 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4cde2984-0fdc-4b83-ad52-a7e0fc019b96 admin admin] The token cache is being invalidate because project a1013320610249089e6a04eda77b2d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:18:16.274509 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4cde2984-0fdc-4b83-ad52-a7e0fc019b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:16.275784 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4cde2984-0fdc-4b83-ad52-a7e0fc019b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:18:16.277341 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1429/2846] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:18:16 2022] DELETE /identity/v3/projects/a1013320610249089e6a04eda77b2d6a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:16.282210 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7a561-fa2f-4b3b-86d2-9bc08b3b4da4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:16.285216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7a561-fa2f-4b3b-86d2-9bc08b3b4da4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:16.285216 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7a561-fa2f-4b3b-86d2-9bc08b3b4da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:16.301424 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-44f7a561-fa2f-4b3b-86d2-9bc08b3b4da4 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:16.302531 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-44f7a561-fa2f-4b3b-86d2-9bc08b3b4da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:16.362643 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1418/2847] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:18:16.371451 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45c0b3-d582-4fbd-9045-c11784d202da None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:16.371748 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45c0b3-d582-4fbd-9045-c11784d202da None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:16.372027 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45c0b3-d582-4fbd-9045-c11784d202da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:16.391006 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ac45c0b3-d582-4fbd-9045-c11784d202da None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:16.392311 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ac45c0b3-d582-4fbd-9045-c11784d202da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:16.400909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1430/2848] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:18:16.405205 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7a561-fa2f-4b3b-86d2-9bc08b3b4da4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:16.414774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7a561-fa2f-4b3b-86d2-9bc08b3b4da4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:16.420060 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ffe73-3b59-419c-9909-9773f989eed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:16.420709 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ffe73-3b59-419c-9909-9773f989eed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:16.420989 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ffe73-3b59-419c-9909-9773f989eed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:16.421293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ffe73-3b59-419c-9909-9773f989eed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:16.422011 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ffe73-3b59-419c-9909-9773f989eed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 22:18:16.422317 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ffe73-3b59-419c-9909-9773f989eed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:16.423939 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ffe73-3b59-419c-9909-9773f989eed6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:16.435040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1419/2849] 10.222.0.24 () {58 vars in 1152 bytes} [Tue May 17 22:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 22:18:16.439579 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45c0b3-d582-4fbd-9045-c11784d202da None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:16.448821 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45c0b3-d582-4fbd-9045-c11784d202da None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:16.453484 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9225ef9-fcb1-46e7-b5f8-3252421cd39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:16.454283 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9225ef9-fcb1-46e7-b5f8-3252421cd39b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:16.454569 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9225ef9-fcb1-46e7-b5f8-3252421cd39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:16.454846 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9225ef9-fcb1-46e7-b5f8-3252421cd39b admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:16.455576 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9225ef9-fcb1-46e7-b5f8-3252421cd39b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:16.457460 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9225ef9-fcb1-46e7-b5f8-3252421cd39b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:16.547675 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1431/2850] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:18:16 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:18:16.551971 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ffe73-3b59-419c-9909-9773f989eed6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:16.561720 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ffe73-3b59-419c-9909-9773f989eed6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:16.616369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dec60f-e819-4ec5-9814-99c0f70e3861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:16.617028 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dec60f-e819-4ec5-9814-99c0f70e3861 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:16.617314 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dec60f-e819-4ec5-9814-99c0f70e3861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:16.617590 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dec60f-e819-4ec5-9814-99c0f70e3861 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:16.618867 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dec60f-e819-4ec5-9814-99c0f70e3861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:16.620806 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dec60f-e819-4ec5-9814-99c0f70e3861 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:16.739475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1420/2851] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:18:16 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 22:18:16.744533 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9225ef9-fcb1-46e7-b5f8-3252421cd39b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:16.754596 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9225ef9-fcb1-46e7-b5f8-3252421cd39b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:16.759451 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f340c31-7905-4c57-aca0-2f03178597b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:16.760193 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f340c31-7905-4c57-aca0-2f03178597b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:16.760487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f340c31-7905-4c57-aca0-2f03178597b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:16.760749 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f340c31-7905-4c57-aca0-2f03178597b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:16.761554 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f340c31-7905-4c57-aca0-2f03178597b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:16.763151 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f340c31-7905-4c57-aca0-2f03178597b7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:16.773289 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1432/2852] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:18:16.777402 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dec60f-e819-4ec5-9814-99c0f70e3861 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:16.787147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dec60f-e819-4ec5-9814-99c0f70e3861 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:16.792609 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708230f-aab9-4cea-86a2-9dd1907cace6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:16.793260 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708230f-aab9-4cea-86a2-9dd1907cace6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:16.793540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708230f-aab9-4cea-86a2-9dd1907cace6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:16.793814 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708230f-aab9-4cea-86a2-9dd1907cace6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:16.794536 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708230f-aab9-4cea-86a2-9dd1907cace6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:16.796164 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708230f-aab9-4cea-86a2-9dd1907cace6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:16.806571 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1421/2853] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:18:16.810365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f340c31-7905-4c57-aca0-2f03178597b7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:16.820449 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f340c31-7905-4c57-aca0-2f03178597b7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:16.825326 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d12c4-f89f-49ce-9ac8-e8f2e1571edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:16.826182 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d12c4-f89f-49ce-9ac8-e8f2e1571edc admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:16.826459 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d12c4-f89f-49ce-9ac8-e8f2e1571edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:16.826727 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d12c4-f89f-49ce-9ac8-e8f2e1571edc admin admin] PATH_INFO: `/v3/projects/3cf34ac8db96460ba3b25bfe4aa0680c/users/4c4de421a8224e89ab11a2a2d88f0315/roles/5c8cdbb338e0490b90a50b0b915f9000` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:16.840913 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d12c4-f89f-49ce-9ac8-e8f2e1571edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf34ac8db96460ba3b25bfe4aa0680c, user_id=4c4de421a8224e89ab11a2a2d88f0315, role_id=5c8cdbb338e0490b90a50b0b915f9000)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:16.843593 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d12c4-f89f-49ce-9ac8-e8f2e1571edc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:16.911392 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1433/2854] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:18:16 2022] PUT /identity/v3/projects/3cf34ac8db96460ba3b25bfe4aa0680c/users/4c4de421a8224e89ab11a2a2d88f0315/roles/5c8cdbb338e0490b90a50b0b915f9000 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:16.917256 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419f389-0626-4ef8-84cf-7e76b5ff7e16 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:16.917543 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419f389-0626-4ef8-84cf-7e76b5ff7e16 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:16.917818 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419f389-0626-4ef8-84cf-7e76b5ff7e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:16.937679 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a419f389-0626-4ef8-84cf-7e76b5ff7e16 None None] MFA Rules not processed for user `aced3dd744eb487b932a627079853c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:16.939553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a419f389-0626-4ef8-84cf-7e76b5ff7e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:17.009349 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1422/2855] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:18:17.019223 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d12c4-f89f-49ce-9ac8-e8f2e1571edc admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:17.020896 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e88d12c4-f89f-49ce-9ac8-e8f2e1571edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:17.082178 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d12c4-f89f-49ce-9ac8-e8f2e1571edc admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:17.085774 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7d328-7bb0-4bb7-a9a0-f3a69726edf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:17.086413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7d328-7bb0-4bb7-a9a0-f3a69726edf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:17.086695 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7d328-7bb0-4bb7-a9a0-f3a69726edf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:17.086970 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7d328-7bb0-4bb7-a9a0-f3a69726edf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:17.096492 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7d328-7bb0-4bb7-a9a0-f3a69726edf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:17.097918 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7d328-7bb0-4bb7-a9a0-f3a69726edf9 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:17.107968 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1434/2856] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:18:22.314627 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cdc3f-c57e-41b0-818a-98b4f4c20cd1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:22.315235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cdc3f-c57e-41b0-818a-98b4f4c20cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:22.315235 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cdc3f-c57e-41b0-818a-98b4f4c20cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:22.354511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-189cdc3f-c57e-41b0-818a-98b4f4c20cd1 None None] MFA Rules not processed for user `4c4de421a8224e89ab11a2a2d88f0315`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:22.356256 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-189cdc3f-c57e-41b0-818a-98b4f4c20cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:22.431005 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1423/2857] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 22:18:22.436041 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7d328-7bb0-4bb7-a9a0-f3a69726edf9 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:22.446128 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7d328-7bb0-4bb7-a9a0-f3a69726edf9 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:22.451829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ca773-8c53-4dd1-a77c-c407850a116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:22.452498 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ca773-8c53-4dd1-a77c-c407850a116a admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:22.452774 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ca773-8c53-4dd1-a77c-c407850a116a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:22.453042 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ca773-8c53-4dd1-a77c-c407850a116a admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:22.453738 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ca773-8c53-4dd1-a77c-c407850a116a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:22.455876 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ca773-8c53-4dd1-a77c-c407850a116a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:22.582077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1435/2858] 10.222.0.24 () {60 vars in 1152 bytes} [Tue May 17 22:18:22 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:18:22.587194 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cdc3f-c57e-41b0-818a-98b4f4c20cd1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:22.599032 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cdc3f-c57e-41b0-818a-98b4f4c20cd1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:22.676702 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639434f6-3487-47e8-b688-f08da9fbbcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:22.677456 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639434f6-3487-47e8-b688-f08da9fbbcff admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:22.679823 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639434f6-3487-47e8-b688-f08da9fbbcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:22.679823 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639434f6-3487-47e8-b688-f08da9fbbcff admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:22.679823 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639434f6-3487-47e8-b688-f08da9fbbcff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:22.680966 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639434f6-3487-47e8-b688-f08da9fbbcff admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:22.778409 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1424/2859] 10.222.0.24 () {60 vars in 1143 bytes} [Tue May 17 22:18:22 2022] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 22:18:22.779859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ca773-8c53-4dd1-a77c-c407850a116a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:22.790744 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ca773-8c53-4dd1-a77c-c407850a116a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:22.796432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d5845-5984-497c-9380-18495f81e6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:22.798575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d5845-5984-497c-9380-18495f81e6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:22.798575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d5845-5984-497c-9380-18495f81e6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:22.798575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d5845-5984-497c-9380-18495f81e6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:22.798575 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d5845-5984-497c-9380-18495f81e6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:22.800209 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d5845-5984-497c-9380-18495f81e6c4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:22.812500 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1436/2860] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:18:22.816622 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639434f6-3487-47e8-b688-f08da9fbbcff admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:22.826955 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639434f6-3487-47e8-b688-f08da9fbbcff admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:22.831802 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b9bf7-6c72-43d6-9786-4d781f6d1ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:22.832701 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b9bf7-6c72-43d6-9786-4d781f6d1ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:22.832982 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b9bf7-6c72-43d6-9786-4d781f6d1ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:22.833258 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b9bf7-6c72-43d6-9786-4d781f6d1ae8 admin admin] PATH_INFO: `/v3/projects/8218df5d9c0a429a9dd7c95a21a62932/users/55e8559d16894b76acbc95d8020d1d16/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:22.848786 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b9bf7-6c72-43d6-9786-4d781f6d1ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8218df5d9c0a429a9dd7c95a21a62932, user_id=55e8559d16894b76acbc95d8020d1d16, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:22.851473 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b9bf7-6c72-43d6-9786-4d781f6d1ae8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:22.957193 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1425/2861] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:18:22 2022] PUT /identity/v3/projects/8218df5d9c0a429a9dd7c95a21a62932/users/55e8559d16894b76acbc95d8020d1d16/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:22.961197 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d5845-5984-497c-9380-18495f81e6c4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:22.974711 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d5845-5984-497c-9380-18495f81e6c4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:23.040971 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32544b41-f0be-4d08-a580-4f8cc637ba32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:23.042942 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32544b41-f0be-4d08-a580-4f8cc637ba32 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:23.043303 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32544b41-f0be-4d08-a580-4f8cc637ba32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:23.043582 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32544b41-f0be-4d08-a580-4f8cc637ba32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:23.044312 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32544b41-f0be-4d08-a580-4f8cc637ba32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:23.045991 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32544b41-f0be-4d08-a580-4f8cc637ba32 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:23.057862 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1437/2862] 10.222.0.24 () {58 vars in 1121 bytes} [Tue May 17 22:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 22:18:23.061263 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b9bf7-6c72-43d6-9786-4d781f6d1ae8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:23.072127 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b9bf7-6c72-43d6-9786-4d781f6d1ae8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:23.076894 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1eeca-8bd8-4cfc-a113-e1172d3fcd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:23.077779 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1eeca-8bd8-4cfc-a113-e1172d3fcd81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:23.078062 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1eeca-8bd8-4cfc-a113-e1172d3fcd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:23.078339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1eeca-8bd8-4cfc-a113-e1172d3fcd81 admin admin] PATH_INFO: `/v3/projects/8218df5d9c0a429a9dd7c95a21a62932/users/55e8559d16894b76acbc95d8020d1d16/roles/5720267cdd3d4ef4aafc2b2a1d067a2e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:23.080618 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1eeca-8bd8-4cfc-a113-e1172d3fcd81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8218df5d9c0a429a9dd7c95a21a62932, user_id=55e8559d16894b76acbc95d8020d1d16, role_id=5720267cdd3d4ef4aafc2b2a1d067a2e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:23.083432 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1eeca-8bd8-4cfc-a113-e1172d3fcd81 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:23.098464 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1426/2863] 10.222.0.24 () {60 vars in 1482 bytes} [Tue May 17 22:18:23 2022] PUT /identity/v3/projects/8218df5d9c0a429a9dd7c95a21a62932/users/55e8559d16894b76acbc95d8020d1d16/roles/5720267cdd3d4ef4aafc2b2a1d067a2e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:18:28.747432 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3432a2c-e027-4691-b795-e5e69f3fb13f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:28.747869 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3432a2c-e027-4691-b795-e5e69f3fb13f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:28.748297 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3432a2c-e027-4691-b795-e5e69f3fb13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:28.778972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c3432a2c-e027-4691-b795-e5e69f3fb13f None None] MFA Rules not processed for user `55e8559d16894b76acbc95d8020d1d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:28.780349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c3432a2c-e027-4691-b795-e5e69f3fb13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:28.878243 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1438/2864] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:18:28.893555 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1eeca-8bd8-4cfc-a113-e1172d3fcd81 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:18:28.895207 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-55d1eeca-8bd8-4cfc-a113-e1172d3fcd81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:28.987736 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1eeca-8bd8-4cfc-a113-e1172d3fcd81 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:18:28.993303 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde68e71-e041-4697-93f2-8ce42d5096c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:18:28.995147 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde68e71-e041-4697-93f2-8ce42d5096c2 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:28.995634 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde68e71-e041-4697-93f2-8ce42d5096c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:28.995915 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde68e71-e041-4697-93f2-8ce42d5096c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:29.054043 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde68e71-e041-4697-93f2-8ce42d5096c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:18:29.055743 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde68e71-e041-4697-93f2-8ce42d5096c2 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:18:29.068348 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1427/2865] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:18:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:18:48.453147 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba20822-c048-43be-aa17-ae432427ded9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:18:48.453639 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba20822-c048-43be-aa17-ae432427ded9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:18:48.453740 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba20822-c048-43be-aa17-ae432427ded9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:18:48.471044 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-dba20822-c048-43be-aa17-ae432427ded9 None None] MFA Rules not processed for user `4c4de421a8224e89ab11a2a2d88f0315`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:18:48.472264 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dba20822-c048-43be-aa17-ae432427ded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:18:48.479424 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1439/2866] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:18:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:19:04.614031 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde68e71-e041-4697-93f2-8ce42d5096c2 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:19:04.615475 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fde68e71-e041-4697-93f2-8ce42d5096c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:19:04.673206 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde68e71-e041-4697-93f2-8ce42d5096c2 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:19:04.676942 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf46a4-85a6-4013-bc3e-a31cfa359bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:19:04.677580 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf46a4-85a6-4013-bc3e-a31cfa359bca service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:19:04.677859 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf46a4-85a6-4013-bc3e-a31cfa359bca service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:19:04.678131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf46a4-85a6-4013-bc3e-a31cfa359bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:19:04.679919 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b5cf46a4-85a6-4013-bc3e-a31cfa359bca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:19:04.693933 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf46a4-85a6-4013-bc3e-a31cfa359bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:19:04.695372 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf46a4-85a6-4013-bc3e-a31cfa359bca service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:19:04.706304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1428/2867] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:19:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:19:07.045070 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba20822-c048-43be-aa17-ae432427ded9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:19:07.054779 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba20822-c048-43be-aa17-ae432427ded9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:19:07.060476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03317dea-cf03-4a31-bf31-d9e16deffd92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:19:07.060476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03317dea-cf03-4a31-bf31-d9e16deffd92 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:19:07.060476 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03317dea-cf03-4a31-bf31-d9e16deffd92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:19:07.060833 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03317dea-cf03-4a31-bf31-d9e16deffd92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:19:07.062428 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-03317dea-cf03-4a31-bf31-d9e16deffd92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:19:07.076877 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03317dea-cf03-4a31-bf31-d9e16deffd92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:19:07.078303 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03317dea-cf03-4a31-bf31-d9e16deffd92 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:19:07.089754 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1440/2868] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:19:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:19:08.536848 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf46a4-85a6-4013-bc3e-a31cfa359bca service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:19:08.545350 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf46a4-85a6-4013-bc3e-a31cfa359bca service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:19:08.548991 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383b0fc-932b-489f-8a18-18ad87992fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:19:08.549625 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383b0fc-932b-489f-8a18-18ad87992fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:19:08.549911 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383b0fc-932b-489f-8a18-18ad87992fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:19:08.550188 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383b0fc-932b-489f-8a18-18ad87992fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:19:08.558886 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383b0fc-932b-489f-8a18-18ad87992fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:19:08.560339 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383b0fc-932b-489f-8a18-18ad87992fd1 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:19:08.569857 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1429/2869] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:19:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:19:22.721801 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03317dea-cf03-4a31-bf31-d9e16deffd92 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:19:22.731937 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03317dea-cf03-4a31-bf31-d9e16deffd92 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:19:22.735723 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719271f-ddce-4334-8d8f-af01a4f86eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:19:22.741032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719271f-ddce-4334-8d8f-af01a4f86eff service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:19:22.741032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719271f-ddce-4334-8d8f-af01a4f86eff service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:19:22.741032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719271f-ddce-4334-8d8f-af01a4f86eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:19:22.741032 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0719271f-ddce-4334-8d8f-af01a4f86eff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:19:22.750887 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719271f-ddce-4334-8d8f-af01a4f86eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:19:22.752601 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719271f-ddce-4334-8d8f-af01a4f86eff service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:19:22.760915 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1441/2870] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:19:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:19:25.154706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383b0fc-932b-489f-8a18-18ad87992fd1 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:19:25.154706 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3383b0fc-932b-489f-8a18-18ad87992fd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:19:25.170135 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383b0fc-932b-489f-8a18-18ad87992fd1 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:19:25.176002 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448ce91-347b-4d79-af2f-fe00f59640ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:19:25.176667 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448ce91-347b-4d79-af2f-fe00f59640ff service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:19:25.176952 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448ce91-347b-4d79-af2f-fe00f59640ff service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:19:25.177293 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448ce91-347b-4d79-af2f-fe00f59640ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:19:25.179100 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6448ce91-347b-4d79-af2f-fe00f59640ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:19:25.192883 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448ce91-347b-4d79-af2f-fe00f59640ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:19:25.194540 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448ce91-347b-4d79-af2f-fe00f59640ff service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:19:25.206165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1430/2871] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:19:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:19:28.073903 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719271f-ddce-4334-8d8f-af01a4f86eff service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:19:28.082542 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719271f-ddce-4334-8d8f-af01a4f86eff service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:19:28.086150 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac21bf9-06af-4ba6-b452-f8ed65aeb92c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:19:28.086774 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac21bf9-06af-4ba6-b452-f8ed65aeb92c service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:19:28.087052 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac21bf9-06af-4ba6-b452-f8ed65aeb92c service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:19:28.087363 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac21bf9-06af-4ba6-b452-f8ed65aeb92c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:19:28.089141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9ac21bf9-06af-4ba6-b452-f8ed65aeb92c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:19:28.151839 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac21bf9-06af-4ba6-b452-f8ed65aeb92c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:19:28.153349 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac21bf9-06af-4ba6-b452-f8ed65aeb92c service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:19:28.162979 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1442/2872] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:19:35.076034 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448ce91-347b-4d79-af2f-fe00f59640ff service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:19:35.078480 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6448ce91-347b-4d79-af2f-fe00f59640ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:19:35.093064 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448ce91-347b-4d79-af2f-fe00f59640ff service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:19:35.097562 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbab250-08b1-4b28-8468-564c6d7b1944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:19:35.101328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbab250-08b1-4b28-8468-564c6d7b1944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:19:35.101328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbab250-08b1-4b28-8468-564c6d7b1944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:19:35.101328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbab250-08b1-4b28-8468-564c6d7b1944 admin admin] PATH_INFO: `/v3/users/692710d8062c42b5a7fabf677bce0598` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:19:35.101328 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbab250-08b1-4b28-8468-564c6d7b1944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=692710d8062c42b5a7fabf677bce0598)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:19:35.102021 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbab250-08b1-4b28-8468-564c6d7b1944 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:19:35.277233 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6cbab250-08b1-4b28-8468-564c6d7b1944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '692710d8062c42b5a7fabf677bce0598'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:35.288411 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6cbab250-08b1-4b28-8468-564c6d7b1944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '692710d8062c42b5a7fabf677bce0598'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:35.289075 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6cbab250-08b1-4b28-8468-564c6d7b1944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '692710d8062c42b5a7fabf677bce0598'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:35.384369 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6cbab250-08b1-4b28-8468-564c6d7b1944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '692710d8062c42b5a7fabf677bce0598'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:35.385016 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6cbab250-08b1-4b28-8468-564c6d7b1944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '692710d8062c42b5a7fabf677bce0598'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:35.397447 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1431/2873] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:19:35 2022] DELETE /identity/v3/users/692710d8062c42b5a7fabf677bce0598 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:19:35.647607 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac21bf9-06af-4ba6-b452-f8ed65aeb92c service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:19:35.661196 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac21bf9-06af-4ba6-b452-f8ed65aeb92c service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:19:35.715881 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504dbeb-eacd-4c7d-b571-613d416a8d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:19:35.716734 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504dbeb-eacd-4c7d-b571-613d416a8d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:19:35.717009 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504dbeb-eacd-4c7d-b571-613d416a8d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:19:35.717277 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504dbeb-eacd-4c7d-b571-613d416a8d26 admin admin] PATH_INFO: `/v3/projects/74eb5524f74d434b87ff129f9997176b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:19:35.718961 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504dbeb-eacd-4c7d-b571-613d416a8d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74eb5524f74d434b87ff129f9997176b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:19:35.721135 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504dbeb-eacd-4c7d-b571-613d416a8d26 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:19:35.880171 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5504dbeb-eacd-4c7d-b571-613d416a8d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74eb5524f74d434b87ff129f9997176b', 'request_id': 'req-5504dbeb-eacd-4c7d-b571-613d416a8d26'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:35.886172 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5504dbeb-eacd-4c7d-b571-613d416a8d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74eb5524f74d434b87ff129f9997176b', 'request_id': 'req-5504dbeb-eacd-4c7d-b571-613d416a8d26'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:35.891909 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5504dbeb-eacd-4c7d-b571-613d416a8d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74eb5524f74d434b87ff129f9997176b', 'request_id': 'req-5504dbeb-eacd-4c7d-b571-613d416a8d26'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:35.965829 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5504dbeb-eacd-4c7d-b571-613d416a8d26 admin admin] The token cache is being invalidate because project 74eb5524f74d434b87ff129f9997176b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:19:35.966114 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5504dbeb-eacd-4c7d-b571-613d416a8d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:35.966743 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5504dbeb-eacd-4c7d-b571-613d416a8d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:35.969012 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1443/2874] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:19:35 2022] DELETE /identity/v3/projects/74eb5524f74d434b87ff129f9997176b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:19:35.972937 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbab250-08b1-4b28-8468-564c6d7b1944 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:19:35.974311 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6cbab250-08b1-4b28-8468-564c6d7b1944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:19:35.987759 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbab250-08b1-4b28-8468-564c6d7b1944 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:19:36.042055 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d81948-d3ce-41c1-9cd7-0a43b783cd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:19:36.042907 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d81948-d3ce-41c1-9cd7-0a43b783cd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:19:36.043218 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d81948-d3ce-41c1-9cd7-0a43b783cd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:19:36.043493 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d81948-d3ce-41c1-9cd7-0a43b783cd06 admin admin] PATH_INFO: `/v3/users/2625be41eca942dc97521526d77c8631` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:19:36.044662 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d81948-d3ce-41c1-9cd7-0a43b783cd06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2625be41eca942dc97521526d77c8631)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:19:36.046635 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d81948-d3ce-41c1-9cd7-0a43b783cd06 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:19:36.208279 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76d81948-d3ce-41c1-9cd7-0a43b783cd06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2625be41eca942dc97521526d77c8631'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:36.220233 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76d81948-d3ce-41c1-9cd7-0a43b783cd06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2625be41eca942dc97521526d77c8631'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:36.220894 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76d81948-d3ce-41c1-9cd7-0a43b783cd06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2625be41eca942dc97521526d77c8631'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:36.269281 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76d81948-d3ce-41c1-9cd7-0a43b783cd06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2625be41eca942dc97521526d77c8631'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:36.269891 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-76d81948-d3ce-41c1-9cd7-0a43b783cd06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2625be41eca942dc97521526d77c8631'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:36.282673 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1432/2875] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:19:35 2022] DELETE /identity/v3/users/2625be41eca942dc97521526d77c8631 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:19:36.517659 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504dbeb-eacd-4c7d-b571-613d416a8d26 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:19:36.519101 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5504dbeb-eacd-4c7d-b571-613d416a8d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:19:36.531863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504dbeb-eacd-4c7d-b571-613d416a8d26 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:19:36.589636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1ac23-7a42-417b-a05f-17150bb8f94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:19:36.590494 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1ac23-7a42-417b-a05f-17150bb8f94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:19:36.590771 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1ac23-7a42-417b-a05f-17150bb8f94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:19:36.591043 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1ac23-7a42-417b-a05f-17150bb8f94c admin admin] PATH_INFO: `/v3/projects/dbb3be42fef14fc89a6a52794b282b76` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:19:36.592258 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1ac23-7a42-417b-a05f-17150bb8f94c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb3be42fef14fc89a6a52794b282b76)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:19:36.594365 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1ac23-7a42-417b-a05f-17150bb8f94c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:19:36.702683 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-79c1ac23-7a42-417b-a05f-17150bb8f94c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb3be42fef14fc89a6a52794b282b76', 'request_id': 'req-79c1ac23-7a42-417b-a05f-17150bb8f94c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:36.709285 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-79c1ac23-7a42-417b-a05f-17150bb8f94c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb3be42fef14fc89a6a52794b282b76', 'request_id': 'req-79c1ac23-7a42-417b-a05f-17150bb8f94c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:36.718549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-79c1ac23-7a42-417b-a05f-17150bb8f94c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb3be42fef14fc89a6a52794b282b76', 'request_id': 'req-79c1ac23-7a42-417b-a05f-17150bb8f94c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:36.800487 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-79c1ac23-7a42-417b-a05f-17150bb8f94c admin admin] The token cache is being invalidate because project dbb3be42fef14fc89a6a52794b282b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:19:36.800769 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-79c1ac23-7a42-417b-a05f-17150bb8f94c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:36.801389 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-79c1ac23-7a42-417b-a05f-17150bb8f94c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:19:36.802933 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1444/2876] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:19:36 2022] DELETE /identity/v3/projects/dbb3be42fef14fc89a6a52794b282b76 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:21:10.816717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9bc7e-31ac-4b1e-a28b-cb55a6368d6d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:21:10.817224 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9bc7e-31ac-4b1e-a28b-cb55a6368d6d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:21:10.817336 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9bc7e-31ac-4b1e-a28b-cb55a6368d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:21:10.844986 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-43f9bc7e-31ac-4b1e-a28b-cb55a6368d6d None None] MFA Rules not processed for user `4c4de421a8224e89ab11a2a2d88f0315`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:21:10.846182 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-43f9bc7e-31ac-4b1e-a28b-cb55a6368d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:21:10.915741 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1433/2877] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:21:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:21:11.221229 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1ac23-7a42-417b-a05f-17150bb8f94c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:21:11.222614 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-79c1ac23-7a42-417b-a05f-17150bb8f94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:21:11.315618 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1ac23-7a42-417b-a05f-17150bb8f94c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:21:11.319231 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e3329-6538-4037-ae00-85772dfe00cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:21:11.319863 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e3329-6538-4037-ae00-85772dfe00cd service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:21:11.320141 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e3329-6538-4037-ae00-85772dfe00cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:21:11.320413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e3329-6538-4037-ae00-85772dfe00cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:21:11.322129 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4f9e3329-6538-4037-ae00-85772dfe00cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:21:11.331974 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e3329-6538-4037-ae00-85772dfe00cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:21:11.333382 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e3329-6538-4037-ae00-85772dfe00cd service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:21:11.341208 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1445/2878] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:21:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:21:12.060304 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9bc7e-31ac-4b1e-a28b-cb55a6368d6d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:21:12.061715 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-43f9bc7e-31ac-4b1e-a28b-cb55a6368d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:21:12.138843 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9bc7e-31ac-4b1e-a28b-cb55a6368d6d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:21:12.143866 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01225aca-fbb8-403d-b15f-9b06c0aa6aeb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cbd89f9b7a24b6cb993ca86e964c54d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:21:12.144470 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01225aca-fbb8-403d-b15f-9b06c0aa6aeb service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:21:12.144751 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01225aca-fbb8-403d-b15f-9b06c0aa6aeb service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:21:12.145024 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01225aca-fbb8-403d-b15f-9b06c0aa6aeb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:21:12.146769 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-01225aca-fbb8-403d-b15f-9b06c0aa6aeb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:21:12.158131 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01225aca-fbb8-403d-b15f-9b06c0aa6aeb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:21:12.159727 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01225aca-fbb8-403d-b15f-9b06c0aa6aeb service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:21:12.169973 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1434/2879] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:21:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:21:27.655549 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e3329-6538-4037-ae00-85772dfe00cd service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:21:27.657636 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4f9e3329-6538-4037-ae00-85772dfe00cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:21:27.741725 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e3329-6538-4037-ae00-85772dfe00cd service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:21:27.750121 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4dba2-0363-4667-8ec6-36febe747c06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:21:27.750852 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4dba2-0363-4667-8ec6-36febe747c06 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:21:27.751152 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4dba2-0363-4667-8ec6-36febe747c06 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:21:27.751485 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4dba2-0363-4667-8ec6-36febe747c06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:21:27.753357 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9ef4dba2-0363-4667-8ec6-36febe747c06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:21:27.768154 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4dba2-0363-4667-8ec6-36febe747c06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:21:27.770166 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4dba2-0363-4667-8ec6-36febe747c06 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:21:27.782035 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1446/2880] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:21:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:22:06.104442 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01225aca-fbb8-403d-b15f-9b06c0aa6aeb service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:22:06.124438 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01225aca-fbb8-403d-b15f-9b06c0aa6aeb service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:22:06.129433 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec851c6e-0edf-48b1-ac10-006ba573acdc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cbd89f9b7a24b6cb993ca86e964c54d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:22:06.130069 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec851c6e-0edf-48b1-ac10-006ba573acdc service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:22:06.130351 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec851c6e-0edf-48b1-ac10-006ba573acdc service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:22:06.130626 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec851c6e-0edf-48b1-ac10-006ba573acdc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:22:06.132392 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ec851c6e-0edf-48b1-ac10-006ba573acdc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:22:06.156798 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec851c6e-0edf-48b1-ac10-006ba573acdc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:22:06.158287 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec851c6e-0edf-48b1-ac10-006ba573acdc service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:22:06.168119 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1435/2881] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:22:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:23:17.693134 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b01ee7-6c48-4ee9-86cb-6d678cab1688 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:23:17.693649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b01ee7-6c48-4ee9-86cb-6d678cab1688 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:23:17.693649 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b01ee7-6c48-4ee9-86cb-6d678cab1688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:23:17.710683 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-47b01ee7-6c48-4ee9-86cb-6d678cab1688 None None] MFA Rules not processed for user `4c4de421a8224e89ab11a2a2d88f0315`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 22:23:17.711889 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-47b01ee7-6c48-4ee9-86cb-6d678cab1688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:23:17.718597 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1447/2882] 10.222.0.24 () {58 vars in 957 bytes} [Tue May 17 22:23:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 22:23:18.023815 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec851c6e-0edf-48b1-ac10-006ba573acdc service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:23:18.033428 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec851c6e-0edf-48b1-ac10-006ba573acdc service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:23:18.037179 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d5ee2-bc7a-4201-b65b-1b53e9a77ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:23:18.037820 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d5ee2-bc7a-4201-b65b-1b53e9a77ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:23:18.038101 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d5ee2-bc7a-4201-b65b-1b53e9a77ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:23:18.038380 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d5ee2-bc7a-4201-b65b-1b53e9a77ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:23:18.040167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-454d5ee2-bc7a-4201-b65b-1b53e9a77ec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:23:18.050479 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d5ee2-bc7a-4201-b65b-1b53e9a77ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:23:18.051904 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d5ee2-bc7a-4201-b65b-1b53e9a77ec9 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:23:18.059812 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1436/2883] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:23:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:23:28.908020 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b01ee7-6c48-4ee9-86cb-6d678cab1688 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:23:28.917721 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b01ee7-6c48-4ee9-86cb-6d678cab1688 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:23:28.921245 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b193ddd-1003-4855-8520-6d8d863b81a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:23:28.921879 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b193ddd-1003-4855-8520-6d8d863b81a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:23:28.922162 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b193ddd-1003-4855-8520-6d8d863b81a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:23:28.922437 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b193ddd-1003-4855-8520-6d8d863b81a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:23:28.924840 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7b193ddd-1003-4855-8520-6d8d863b81a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:23:28.935327 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b193ddd-1003-4855-8520-6d8d863b81a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:23:28.936753 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b193ddd-1003-4855-8520-6d8d863b81a7 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:23:28.946626 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1448/2884] 10.222.0.24 () {60 vars in 1396 bytes} [Tue May 17 22:23:28 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:25:04.876624 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d5ee2-bc7a-4201-b65b-1b53e9a77ec9 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:25:04.885774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d5ee2-bc7a-4201-b65b-1b53e9a77ec9 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:25:04.889500 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db142790-a28c-4771-b1bd-72b972bfbe38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:25:04.890143 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db142790-a28c-4771-b1bd-72b972bfbe38 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:25:04.890430 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db142790-a28c-4771-b1bd-72b972bfbe38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:25:04.890708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db142790-a28c-4771-b1bd-72b972bfbe38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:25:04.892567 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-db142790-a28c-4771-b1bd-72b972bfbe38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:25:04.902708 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db142790-a28c-4771-b1bd-72b972bfbe38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:25:04.904165 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db142790-a28c-4771-b1bd-72b972bfbe38 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:25:04.913036 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1437/2885] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:25:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:25:26.864073 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b193ddd-1003-4855-8520-6d8d863b81a7 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:25:26.897808 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b193ddd-1003-4855-8520-6d8d863b81a7 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:25:26.903822 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba2943-3d1c-4ac7-906c-11908b1d33c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:25:26.904643 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba2943-3d1c-4ac7-906c-11908b1d33c3 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:25:26.904928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba2943-3d1c-4ac7-906c-11908b1d33c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:25:26.905207 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba2943-3d1c-4ac7-906c-11908b1d33c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:25:26.906993 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-76ba2943-3d1c-4ac7-906c-11908b1d33c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:25:26.935452 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba2943-3d1c-4ac7-906c-11908b1d33c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:25:26.937414 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba2943-3d1c-4ac7-906c-11908b1d33c3 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:25:26.949928 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1449/2886] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:25:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 22:25:27.301434 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db142790-a28c-4771-b1bd-72b972bfbe38 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:25:27.310837 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db142790-a28c-4771-b1bd-72b972bfbe38 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:25:27.314572 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dccc4c-04dd-457d-b489-6b63f8f3320d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:25:27.317881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dccc4c-04dd-457d-b489-6b63f8f3320d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:25:27.317881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dccc4c-04dd-457d-b489-6b63f8f3320d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:25:27.317881 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dccc4c-04dd-457d-b489-6b63f8f3320d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:25:27.318338 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c1dccc4c-04dd-457d-b489-6b63f8f3320d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:25:27.331678 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dccc4c-04dd-457d-b489-6b63f8f3320d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:25:27.333817 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dccc4c-04dd-457d-b489-6b63f8f3320d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:25:27.345324 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1438/2887] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:25:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:25:28.524859 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba2943-3d1c-4ac7-906c-11908b1d33c3 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:25:28.533974 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba2943-3d1c-4ac7-906c-11908b1d33c3 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:25:28.538077 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71705ae5-826c-4c79-9a43-f79ae5a2eec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:25:28.538715 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71705ae5-826c-4c79-9a43-f79ae5a2eec9 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:25:28.538995 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71705ae5-826c-4c79-9a43-f79ae5a2eec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:25:28.539307 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71705ae5-826c-4c79-9a43-f79ae5a2eec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:25:28.541040 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-71705ae5-826c-4c79-9a43-f79ae5a2eec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:25:28.555057 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71705ae5-826c-4c79-9a43-f79ae5a2eec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:25:28.556514 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71705ae5-826c-4c79-9a43-f79ae5a2eec9 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:25:28.567633 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1450/2888] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:25:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:25:29.297246 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dccc4c-04dd-457d-b489-6b63f8f3320d service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:25:29.308553 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dccc4c-04dd-457d-b489-6b63f8f3320d service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:25:29.324969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd122632-615b-4b85-a554-d3f0ba1db7df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d06113649924eae83d04bc22337bd6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:25:29.324969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd122632-615b-4b85-a554-d3f0ba1db7df service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:25:29.324969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd122632-615b-4b85-a554-d3f0ba1db7df service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:25:29.324969 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd122632-615b-4b85-a554-d3f0ba1db7df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:25:29.325396 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cd122632-615b-4b85-a554-d3f0ba1db7df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:25:29.329774 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd122632-615b-4b85-a554-d3f0ba1db7df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:25:29.331370 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd122632-615b-4b85-a554-d3f0ba1db7df service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:25:29.342321 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1439/2889] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:25:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:25:40.062976 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71705ae5-826c-4c79-9a43-f79ae5a2eec9 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:25:40.074503 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71705ae5-826c-4c79-9a43-f79ae5a2eec9 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:25:40.078170 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383f0ee-2be7-4ea7-8cce-87e1a450f7cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084b56d682c44119654743809109bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:25:40.078800 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383f0ee-2be7-4ea7-8cce-87e1a450f7cb service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:25:40.079133 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383f0ee-2be7-4ea7-8cce-87e1a450f7cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:25:40.079413 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383f0ee-2be7-4ea7-8cce-87e1a450f7cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:25:40.081170 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5383f0ee-2be7-4ea7-8cce-87e1a450f7cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:25:40.173915 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383f0ee-2be7-4ea7-8cce-87e1a450f7cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:25:40.175377 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383f0ee-2be7-4ea7-8cce-87e1a450f7cb service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:25:40.195415 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1451/2890] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 22:25:47.185105 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd122632-615b-4b85-a554-d3f0ba1db7df service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:25:47.186620 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cd122632-615b-4b85-a554-d3f0ba1db7df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:25:47.202511 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd122632-615b-4b85-a554-d3f0ba1db7df service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:25:47.207264 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d9ef1-9046-4cb5-aff3-afd225271f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:25:47.208122 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d9ef1-9046-4cb5-aff3-afd225271f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:25:47.208429 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d9ef1-9046-4cb5-aff3-afd225271f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:25:47.208728 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d9ef1-9046-4cb5-aff3-afd225271f28 admin admin] PATH_INFO: `/v3/users/4c4de421a8224e89ab11a2a2d88f0315` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:25:47.210072 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d9ef1-9046-4cb5-aff3-afd225271f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c4de421a8224e89ab11a2a2d88f0315)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:25:47.212016 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d9ef1-9046-4cb5-aff3-afd225271f28 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:25:47.344547 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0e6d9ef1-9046-4cb5-aff3-afd225271f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c4de421a8224e89ab11a2a2d88f0315'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:47.356763 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0e6d9ef1-9046-4cb5-aff3-afd225271f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c4de421a8224e89ab11a2a2d88f0315'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:47.357422 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0e6d9ef1-9046-4cb5-aff3-afd225271f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c4de421a8224e89ab11a2a2d88f0315'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:47.399893 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0e6d9ef1-9046-4cb5-aff3-afd225271f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c4de421a8224e89ab11a2a2d88f0315'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:47.400498 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0e6d9ef1-9046-4cb5-aff3-afd225271f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c4de421a8224e89ab11a2a2d88f0315'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:47.412912 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1440/2891] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:25:47 2022] DELETE /identity/v3/users/4c4de421a8224e89ab11a2a2d88f0315 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 22:25:47.641634 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383f0ee-2be7-4ea7-8cce-87e1a450f7cb service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:25:47.652770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383f0ee-2be7-4ea7-8cce-87e1a450f7cb service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:25:47.709763 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:25:47.710535 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:25:47.710815 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:25:47.711090 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa admin admin] PATH_INFO: `/v3/projects/3cf34ac8db96460ba3b25bfe4aa0680c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:25:47.712316 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf34ac8db96460ba3b25bfe4aa0680c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:25:47.714202 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:25:47.839787 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf34ac8db96460ba3b25bfe4aa0680c', 'request_id': 'req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:47.845864 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf34ac8db96460ba3b25bfe4aa0680c', 'request_id': 'req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:47.852055 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf34ac8db96460ba3b25bfe4aa0680c', 'request_id': 'req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:47.925273 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa admin admin] The token cache is being invalidate because project 3cf34ac8db96460ba3b25bfe4aa0680c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:25:47.925560 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:47.926195 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:47.927972 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1452/2892] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:25:47 2022] DELETE /identity/v3/projects/3cf34ac8db96460ba3b25bfe4aa0680c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:25:47.931967 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d9ef1-9046-4cb5-aff3-afd225271f28 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:25:47.933352 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0e6d9ef1-9046-4cb5-aff3-afd225271f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:25:47.947577 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d9ef1-9046-4cb5-aff3-afd225271f28 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:25:48.002232 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6efd24-5ba7-4999-a961-1186e78dd586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:25:48.003082 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6efd24-5ba7-4999-a961-1186e78dd586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:25:48.003393 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6efd24-5ba7-4999-a961-1186e78dd586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:25:48.003665 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6efd24-5ba7-4999-a961-1186e78dd586 admin admin] PATH_INFO: `/v3/users/55e8559d16894b76acbc95d8020d1d16` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:25:48.004833 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6efd24-5ba7-4999-a961-1186e78dd586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e8559d16894b76acbc95d8020d1d16)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:25:48.007569 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6efd24-5ba7-4999-a961-1186e78dd586 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:25:48.202683 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f6efd24-5ba7-4999-a961-1186e78dd586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e8559d16894b76acbc95d8020d1d16'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:48.214794 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f6efd24-5ba7-4999-a961-1186e78dd586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e8559d16894b76acbc95d8020d1d16'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:48.215483 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f6efd24-5ba7-4999-a961-1186e78dd586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e8559d16894b76acbc95d8020d1d16'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:48.274413 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f6efd24-5ba7-4999-a961-1186e78dd586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e8559d16894b76acbc95d8020d1d16'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:48.275040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8f6efd24-5ba7-4999-a961-1186e78dd586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e8559d16894b76acbc95d8020d1d16'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:48.287167 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1441/2893] 10.222.0.24 () {58 vars in 1223 bytes} [Tue May 17 22:25:47 2022] DELETE /identity/v3/users/55e8559d16894b76acbc95d8020d1d16 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:25:48.522372 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:25:48.526605 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:25:48.536770 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260c6f7-dea0-49b8-b4b5-fe4462aaa7fa admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:25:48.594086 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ebb7a-504a-4ab0-b680-4d38f5a06ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aced3dd744eb487b932a627079853c51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a8a72ae1784555b539c1867c54411c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:25:48.596350 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ebb7a-504a-4ab0-b680-4d38f5a06ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:25:48.598404 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ebb7a-504a-4ab0-b680-4d38f5a06ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:25:48.598632 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ebb7a-504a-4ab0-b680-4d38f5a06ac8 admin admin] PATH_INFO: `/v3/projects/8218df5d9c0a429a9dd7c95a21a62932` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:25:48.600697 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ebb7a-504a-4ab0-b680-4d38f5a06ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8218df5d9c0a429a9dd7c95a21a62932)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:25:48.602773 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ebb7a-504a-4ab0-b680-4d38f5a06ac8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:25:48.714203 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9f4ebb7a-504a-4ab0-b680-4d38f5a06ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8218df5d9c0a429a9dd7c95a21a62932', 'request_id': 'req-9f4ebb7a-504a-4ab0-b680-4d38f5a06ac8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:48.721908 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9f4ebb7a-504a-4ab0-b680-4d38f5a06ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8218df5d9c0a429a9dd7c95a21a62932', 'request_id': 'req-9f4ebb7a-504a-4ab0-b680-4d38f5a06ac8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:48.729130 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9f4ebb7a-504a-4ab0-b680-4d38f5a06ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8218df5d9c0a429a9dd7c95a21a62932', 'request_id': 'req-9f4ebb7a-504a-4ab0-b680-4d38f5a06ac8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:48.799421 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9f4ebb7a-504a-4ab0-b680-4d38f5a06ac8 admin admin] The token cache is being invalidate because project 8218df5d9c0a429a9dd7c95a21a62932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 22:25:48.799708 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9f4ebb7a-504a-4ab0-b680-4d38f5a06ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:48.800320 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9f4ebb7a-504a-4ab0-b680-4d38f5a06ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 22:25:48.801904 dv-cinder-839987-6-iscsi devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1453/2894] 10.222.0.24 () {58 vars in 1232 bytes} [Tue May 17 22:25:48 2022] DELETE /identity/v3/projects/8218df5d9c0a429a9dd7c95a21a62932 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 22:27:11.386144 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6efd24-5ba7-4999-a961-1186e78dd586 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 22:27:11.387691 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8f6efd24-5ba7-4999-a961-1186e78dd586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:27:11.455987 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6efd24-5ba7-4999-a961-1186e78dd586 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 22:27:11.518020 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e6b94-c448-4011-9063-18b4440bafc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cbd89f9b7a24b6cb993ca86e964c54d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e90e91d3094e67b09b2b8137f210f4', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 22:27:11.518668 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e6b94-c448-4011-9063-18b4440bafc5 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 22:27:11.518950 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e6b94-c448-4011-9063-18b4440bafc5 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 22:27:11.519259 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e6b94-c448-4011-9063-18b4440bafc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 22:27:11.521040 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ca4e6b94-c448-4011-9063-18b4440bafc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 22:27:11.533717 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e6b94-c448-4011-9063-18b4440bafc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 22:27:11.535286 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e6b94-c448-4011-9063-18b4440bafc5 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 22:27:11.546102 dv-cinder-839987-6-iscsi devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1442/2895] 10.222.0.24 () {60 vars in 1365 bytes} [Tue May 17 22:27:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)